In this article, we consolidate and present in one place what is known about quality indicators for setting standards so that stakeholders may be able to recognize the signs of standard-setting quality. We use the context of setting standards to associate English language test scores with language proficiency descriptions such as those presented…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

Although definitions of validity have evolved considerably since L. J. Cronbach and P. E. Meehl's classic (1955) review, contemporary validity research continues to emphasize correlational analyses assessing predictor-criterion relationships, with most outcome criteria being self-reports. The present article describes an alternative way of…

Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Districts now have access to a wealth of new information that can help target students with appropriate supports and bring focus and coherence to college readiness efforts. However, the abundance of data has brought its own challenges. Schools and school systems are often overwhelmed with the amount of data available. The capacity of districts to…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

Some researchers have argued that discrepant broad index scores invalidate IQs, but others have questioned the fundamental logic of that argument. To resolve this debate, the present study used a nationally representative sample of children (N = 1,200) who were matched individually for IQ. Children with significantly uneven broad index score…

This study compared global scores of 26 Australian students (ages 4 to 16) with mental retardation on the third and fourth editions of the Stanford Binet Intelligence Scale. Analysis indicated a fairly strong positive relation between the two tests, suggesting that the fourth edition may be substituted for the older instrument in longitudinal…

Presents a unified concept of test validity that integrates both the scientific and ethical considerations of test interpretation and use. Argues that the appropriateness, meaningfulness, and usefulness of score-based inferences are inseparable, and that this integration is based on construct validity. (FMW)

Value-added models help to evaluate the knowledge that school districts, schools, and teachers add to student learning as students progress through school. In this article, the well-known Education Value-Added Assessment System (EVAAS) is examined. The author presents a practical investigation of the methodological issues associated with the…

Medical College Admission Test (MCAT) score differences were examined for Black and White examinees who entered American medical schools in 1978 and 1979. The incidence of academic difficulty resulting in delayed graduation, withdrawal, or dismissal was also examined. The MCAT provides six scores: biology, chemistry, physics, science problems,…

Statewide minimum competency testing programs have emphasized basic skills in reading, mathematics, and writing. However, continuing concerns are expressed in national reports about the level of achievement, particularly in mathematics and science, and increased testing has been suggested as a means of encouraging curriculum change and evaluating…

This study compared the reliability and validity of two different measures of reading ability, the Degrees of Reading Power (DRP) and the Iowa Tests of Basic Skills (ITBS) Reading test and the ITBS Vocabulary test. The data consisted of scores of 377 grade 5 and grade 6 students on these tests, along with their assigned reading levels in the…

This paper examined test scores and information about test takers collected from the Graduate Record Examination (GRE) national test administration files, GRE validity study data provided by institutional users, and survey questionnaires sent to test repeaters. Data were collected from 200,000 men and women who took the GRE General Test in June…