Describes an approach to addressing issues of validity of inferences and the extrapolation of inferences to target domains beyond the assessment for alternative assessments. Makes the case that in both language testing and educational assessment the roles of language and content knowledge must be considered, and that the design and development of…

An example application of portfolio assessment was developed and the model and estimates of reliability derived from the literature were then used to estimate the characteristics of an operational large-scale portfolio assessment program. Costs were estimated to put results in a realistic context. (SLD)

The accuracy of statistics based on performance assessments that represent percentages of students reaching standards is explored using data from a large-scale performance assessment, the Maryland School Performance Assessment Program. Results with students in grades 3, 5, and 8 support the accuracy of pooling results to produce the statistics.…

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

Gender-related differential item functioning (DIF) was examined in a context in which 3,946 middle school students received mathematics instruction focusing on problem solving. Reasons why four tasks on the performance assessment favored female students and two favored male students are discussed. (SLD)

Researchers in the field of educational measurement need to monitor their own actions to keep their achievements in perspective. Some possible symptoms of obsession with their own significance are explored. Pride, destructive criticism, and misusing others to advance oneself are flaws researchers should strive to eradicate. (SLD)

Current successes and failures in U.S. educational measurement are reviewed, focusing on criterion-referenced testing. Pluses and minuses are listed for the following: (1) the move toward authentic assessment; (2) the dominance of criterion-referenced assessment; and (3) item response theory applications. Each area is a double-edged sword. (SLD)

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

A conceptual framework is presented for the development of the Quantitative Understanding: Amplifying Student Achievement and Reasoning (QUASAR) Cognitive Assessment Instrument (QCAI) that focuses on the ability of middle-school students to problem solve, reason, and communicate mathematically. The instrument will provide programatic rather than…

The development of a hypothetical testing program designed to provide optimum information about student achievement is chronicled. Computer adaptive testing and performance testing are postulated as part of the program. What optimum information really means is discussed. Optimum is only optimal when theory and application are balanced. (SLD)