This study is an evaluation of the psychometric issues associated with estimating objective level scores, often referred to as "subscores." The article begins by introducing the concepts of reliability and validity for subscores from statewide achievement tests. These issues are discussed with reference to popular scaling techniques, classical…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In this article we address the issue of consistency in standard setting in the context of an augmented state testing program. Information gained from the external NRT scores is used to help make an informed decision on the determination of cut scores on the state test. The consistency of cut scores on the CRT across grades is maintained by forcing…

This handbook outlines procedures for sharing student data between schools and the Ministry of Education, and answers questions pertaining to provincial examinations. It supports the work of both educators and the Ministry, which works with schools to produce transcripts and administer provincial exams. The following are appended: (1) Forms; and…

This handbook describes the responsibilities of district and school assessment coordinators in the administration of the Pennsylvania System of School Assessment (PSSA). This updated guidebook contains the following sections: (1) General Assessment Guidelines for All Assessments; (2) Writing Specific Guidelines; (3) Reading and Mathematics…

The bookmark standard-setting procedure is an item response theory-based method that is widely implemented in state testing programs. This study estimates standard errors for cut scores resulting from bookmark standard settings under a generalizability theory model and investigates the effects of different universes of generalization and error…

The administrative and political ramifications of a form of multiple matrix sampling where all students in the population are tested on a subtest is discussed in the context of a statewide testing program. The conclusion is drawn that large-scale testing programs will have to adopt a testing framework which samples items from the total item domain…

To determine the factors that contribute to or compromise the effectiveness of multiscored items, this study combined analysis of statewide score data from the 1996 Maryland School Performance Assessment Program tests with systematic analyses of 60 activities providing measures of writing, language usage, or both, and one or more content areas.…

Explores three issues to consider regarding statewide standardized tests in higher education: (1) existing statewide testing programs differ markedly from one another in nature and objectives, and it's important to know specifically how and why; (2) a range of substantial implementation issues will be present; and (3) there are promising…

This paper addresses issues of vertical equating for the Arkansas Comprehensive Testing, Assessment and Accountability Program (ACTAAP) assessments as they relate to school accountability and determination of Adequate Yearly Progress (AYP) as required by the recent federal legislation, the No Child Left Behind Act. The paper first provides a brief…

This Compendium is structured so that users may easily seek answers to specific questions about the design and implementation or refinement of state accountability systems. Chapter 1 provides background information. Chapter 2 raises a set of critical questions and major concerns state teams will need to address in designing their accountability…

There is a growing body of literature in the ERIC data base pertaining to state educational assessment and testing programs. Volume I of this bibliography includes abstracts of 39 documents and journal articles describing the design and implementation of programs, as well as the technical and political issues which have been addressed by the…

The purpose of the survey was to obtain information to prepare a profile of state testing programs. One section of the report summarizes the data on the 42 testing programs that were operating in 33 states during the 1972-73 school year. This summary tabulates the findings of eight major areas covering all the questions asked during the…

Two methods to establish a common scale across grades within a content area using a common item design (separate and concurrent) have previously been studied under simulated conditions. Separate estimation is accomplished through separate calibration and grade-by-grade chained linking. Concurrent calibration established the vertical scale in a…

The inclusion of students with disabilities in state and district assessments rests on a fundamental belief: all children can learn. This belief centers on all children who receive educational services, even those whose teachers and therapists work with them at home or in the hospital. The purpose of this chapter is to clarify the rationale for…