In this article we address the issue of consistency in standard setting in the context of an augmented state testing program. Information gained from the external NRT scores is used to help make an informed decision on the determination of cut scores on the state test. The consistency of cut scores on the CRT across grades is maintained by forcing…

The objectives of this paper are threefold. First, a model is proposed for unifying massive amounts of conceptual and numerical information flowing from the measures of the accountability movement in Ohio and the materials that are publicly available to educators. Second, this model is translated into useable forms of information that help…

This study empirically investigated the potential negative effect of item response theory (IRT) model-data misfit on the degree of invariance of: (1) IRT item parameter estimates (item difficulty and discrimination); and (2) IRT person ability parameter estimates. A large-scale statewide assessment program test database was used, for which the…

An evolved form of the Edwards and Beckworth (1989) model for probability selection for Scholastic Achievement Test takers using truncated normal distributions is presented. It is shown that the arguments of Holland and Wainer are not sufficient to reject this model. (SLD)

This brief makes the case for thoughtful district- or school-driven assessment systems that complement and go beyond what statewide testing systems are able to accomplish. It describes important attributes of model local assessment programs and presents the necessary steps for building a local assessment program that will elicit information that…

In 1979-80, the Arkansas minimum competency tests were administered to a sample of 5,000 students in grades 3, 6, and 8. To determine how well test objectives matched the curriculum, their teachers estimated how many of the four items per objective a randomly selected student would answer correctly. Because chi square test comparisons of teacher…

This is the first report from a 5-year study of the classroom level effects of state assessment reforms. The first year examines changes in the teaching of writing and mathematics in Kentucky elementary and middle schools as a result of the Kentucky Instructional Results Information System and the Kentucky Education Reform Act (KERA). This report…

An analytic framework is presented for examining the properties and objectives of assessments and scoring systems piloted in a number of state and district testing programs. The article explores the application of this framework, which considers the cognitive components of competence described in studies of expertise, to the analysis of science…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Proposed an accountably model that addresses the challenges of allowing school districts to choose the specific strategies they use to measure student performance and evaluated this model using data from multiple sources for all school districts in Florida. Findings identify three strategies that would be useful for this type of accountability…

In spring l977, a five-member team used the Shepard evaluation method to review the Michigan Educational Assessment Program (MEAP). The team's activities were the initial stage of a complete formative MEAP assessment. The Shepard evaluation method consists of a checklist which provides nearly 50 topics to investigate when conducting an evaluation…

The model used by National Assessment for data gathering and reporting on the Citizenship area is described, and the potential uses of the model for state and local assessment, curriculum development, and accountability purposes are discussed. The study was carried out using papers and reports from the National Assessment of Educational Progress,…

Kentucky has been implementing test-based accountability for almost a decade, making it a good site for studying the effects of the milepost testing model. In 1996, a study was undertaken of the impact of standards-based assessment on classroom practices in Kentucky. Kentucky teachers (n=365) were surveyed about their classroom practices and other…

The Schools and Staffing Survey (SASS) of the National Center for Education Statistics offers the most comprehensive picture available of elementary and secondary schools in the United States. The value of the SASS would be even greater if information on districts and schools could be related directly to student outcomes. A relatively inexpensive…

A statistical view was compiled of the impact of Elementary and Secondary Education Act (ESEA) Title I programs on student achievement in 45 of the 55 West Virginia county school districts between 1977-78. The RMC Model A-1 design was used by each district. Nationally normed achievement tests were administered for pretesting and posttesting of the…