The article describes practical suggestions for measurement researchers and psychometricians to respond to calls for social responsibility in assessment. The underlying assumption is that personalizing large-scale assessment improves the chances that assessment and the use of test scores will contribute to equity in education. This article…

The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

There are many threats to validity in high-stakes achievement testing. One major threat is construct-irrelevant variance (CIV). This article defines CIV in the context of the contemporary, unitary view of validity and presents logical arguments, hypotheses, and documentation for a variety of CIV sources that commonly threaten interpretations of…

This instructional module presents and illustrates rules for designing performance assessments in a step-by-step strategy through: (1) reason for the assessment; (2) type of performance evaluated; (3) exercises to elicit performance; and (4) systematic rating procedures. Guidelines for maximizing reliability, validity, and economy are presented.…

The collection of verbal reports is one way in which cognitive and developmental psychologists gather data to formulate and corroborate models of problem solving. The current use of verbal reports to design and validate educational assessments reflects the growing trend to fuse cognitive psychological research and educational measurement. However,…

Results of a 1987 report indicating that elementary students of all states were above the national average are assessed. Issues addressed include teaching for standardized tests, the effect of teaching on national norms, and alternatives available to protect the integrity of instruction and the validity of normed test scores. (TJH)

The validity of the SAT as an admissions criterion for Latinos and Asian Americans who are not native English speakers was examined. The analyses, based on 1997 and 1998 UCSB freshmen, focused on the effectiveness of SAT scores and high school grade-point average (HSGPA) in predicting college freshman grade-point average (FGPA). When regression…

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

Results of a 1987 report--indicating that elementary students of all 50 states were above the national average--were assessed via 2 national mail and telephone surveys. Although results of data for 35 states support the general findings of the 1987 report, it appears that more specific results are less sensational. (TJH)