Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

Teachers are now experiencing the age of quantitative test-driven assessment, in which there is little weight accorded to teacher-based judgement about student progress. In the Australian context, the NAPLaN test has become a driving force in school and teacher accountability. The language of NAPLaN is one of bands and numerical scores and…

In practice, vertical scales have been continually used to measure students' achievement progress across several grade levels and have been considered very challenging psychometric procedures. Recently, such practices have been drawing many criticisms. The major criticisms focus on dimensionality and construct equivalence of the latent trait or…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

In conjunction with the Individuals with Disabilities Education Act of 1997 (IDEA), the No Child Left Behind Act of 2002 (NCLB) calls for specific enhancements to existing assessment and accountability systems within definite timelines. The NCLB Act also stresses the use of reliable and valid data for decision making. The purpose of this study was…

Makes the point that the interpretations and use of high-stakes test scores rely on policy assumptions about what should be taught and the content standards and performance standards that should be applied. The assumptions built into an assessment need to be subjected to scrutiny and criticism if a strong case is to be made for the validity of the…

This report provides historical background on the origins, development and procedures, of Educational Testing Service's (ETS's) Board of Review. Established in 1969, the Board of Review makes final decisions for all test scores of questionable validity. ETS cancels or withholds scores believed to be invalid. Reasons for invalid scores range from…

Large gains in scores have been observed over the first years of the Kentucky Instructional Results Information System (KIRIS) program. The extent to which these gains in scores indicate that student learning improved was evaluated. Previous studies have suggested that KIRIS score gains might be appreciably inflated, something that might result…

This field memo is the third in a series of updates from the Deputy Commissioner of the Office of Elementary, Middle, Secondary and Continuing Education to all teachers and administrators of public and nonpublic schools on standards and assessments in New York. This document explains how the New York State Education Department determines if test…

Summarizes the recent history of education reform and statewide testing in Texas. Suggest that analyses comparing Texas Assessment of Academic Skills (TAAS) reading, writing, and mathematics scores with one another and relevant high school grades raise doubts about the reliability and validity of TAAS scores. Discusses these problems. (SLD)

Due to a concern regarding the validity of Chicago public elementary schools standardized test scores on the Iowa Tests of Basic Skills, a test audit was conducted. The audit was limited to 40 schools. Two schools were selected from each of the 20 administrative districts, with each school testing one seventh- and one eighth-grade class. These…

The validity of various procedures for rank ordering school districts throughout a state on the basis of statewide test results was studied. Data were drawn from the 1987 administration of the Kentucky Essential Skills Test (KEST), which is given each spring to all children enrolled in public school grades kindergarten through 12 in 178 school…