A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…

In this technical report, we document the results of a cross-validation study designed to identify optimal cut-scores for the use of the easyCBM[R] mathematics test in the state of Washington. A large sample, randomly split into two groups of roughly equal size, was used for this study. Students' performance classification on the Washington state…

This technical report presents results from a cross-validation study designed to identify optimal cut scores when using easyCBM[R] reading tests in Oregon. The cross-validation study analyzes data from the 2009-2010 academic year for easyCBM[R] reading measures. A sample of approximately 2,000 students per grade, randomly split into two groups of…

The purpose of this study is to determine the extent of scale drift on a test that employs cut scores. It was essential to examine scale drift for this testing program because new forms in this testing program are often put on scale through a series of intermediate equatings (known as equating chains). This process may cause equating error to…

Test items undergo multiple iterations of review before states and vendors deem them acceptable to be placed in a live statewide assessment. This article reviews three approaches that can add validity evidence to states' item review processes. The first process is a structured sensitivity review process that focuses on universal design…

This study examined the validity of a single-item measure of HIV risk stage of change that HIV prevention contractors were required to collect by the California State Office of AIDS. The single-item measure was compared to the more conventional University of Rhode Island Change Assessment (URICA). Participants were members of Los Angeles…

Many educational testing programs report examinee performance at more than two levels of proficiency. Whether these assessments have the capacity to support these multiple inferences, though, is a topic that has not been widely discussed. This study proposes a method for evaluating the minimum number of measurement opportunities for reporting…

The current study investigates the effect of adding an individual growth measure to the primary definition of AYP. A variety of approaches to measuring growth have already been identified and are in use in schools across the country. In almost every statewide assessment system, a measure of the amount that individual students change from one year…

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…

In November, 1985, the Council of Chief State School Officers adopted a plan for developing educational indicators. The plan provided for the development of a common measure of student achievement to be collected across states beginning in 1988-89. In order to design a student achievement assessment program, the states were asked to give their…

Part of understanding the issues that surround the implementation of transformative federal mandates such as the No Child Left Behind Act of 2001 (NCLB) is the accumulation of sound, evidenced-based findings that are coupled with rich descriptive explanatory findings. By doing so, the research community supports educational practice to continually…

This book shows the advantages of Rasch measurement (G. Rasch) for school district testing programs. The results of Rasch methods are contrasted with conventional statistics for assessing student responses to basic skills testing. Chapter 1 shows how the Rasch probability-based method produces measures that are more useful for students, parents,…

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

The nature of percentile ranks scores is explored using concrete heuristic examples. It is explained why arithmetic operations require measurement on equal-interval scales, and that percentile ranks are not measured on equal-interval scales and therefore may not be added or averaged. The consequences of inappropriately adding percentile ranks are…

The Arizona Student Assessment Program (ASAP) epitomizes the principle on which measurement-driven reform is based, "You get what you assess." This policy study examines the ideologies and intentions of groups instrumental in the creation and implementation of a performance-based assessment reform. The study was conducted by interviewing…