Educational assessment is important. But in the twenty-first century it is easy to feel that schooling and other phases of education are shaped entirely by certain assessments, and that assessment is only about exam results. The idea that test grades can accurately describe the aims and outcomes of education is unfair and reductive. Yet it is a…

When applicants take the ACT® more than once, how do colleges and universities reconcile and make sense of the multiple scores? In terms of validity, fairness, and impact on subgroup differences, are certain score-use polices better than others? The focus of this issue brief is to summarize evidence on the validity and fairness of various…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Differential item functioning (DIF) occurs when an item on a test, questionnaire, or interview has different measurement properties for one group of people versus another, irrespective of true group-mean differences on the constructs being measured. This article is focused on item response theory based likelihood ratio testing for DIF (IRT-LR or…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

In this era of increased accountability in education, there is a need for tools to use in assessing the abilities and instructional levels of young children. Computers have been used successfully to assess older children and adults. However, there is a dearth of empirical research to provide evidence that computer-based testing (CBT) is…

Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

Differential item functioning (DIF) occurs when items on a test or questionnaire have different measurement properties for one group of people versus another, irrespective of group-mean differences on the construct. Methods for testing DIF require matching members of different groups on an estimate of the construct. Preferably, the estimate is…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

The speeches presented at the second national conference on testing deal with models for program evaluation, reporting of test results, minimum competency programs, and the role of state and federal government in educational testing. Various approaches to program evaluation, and its relationship to testing are described by Michael Scriven, Lee J.…

A study of six children (ages 3-9) with autism assessed whether manipulation of variables related to motivation and attention in children with autism would influence performance on standardized tests. Results found the children showed higher scores when conditions were modified to improve the likelihood of responding to test stimuli. (Author/CR)

In this study, fourth-grade special education students (n=78) and general education students (n=403) took a large-scale statewide test using standard test administration procedure and two major accommodations addressing response conditions and test administration. On both reading and math tests, students bubbled in answers on a separate sheet (the…

The application of tests in clinical and counseling work, in educational achievement testing, and in personnel selection is discussed. An analysis of the organizations which comprise the testing industry, including the various publishers and developers of tests and also the test scoring organizations, is given. The concept of an assessment system…