Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

In this article we address the issue of consistency in standard setting in the context of an augmented state testing program. Information gained from the external NRT scores is used to help make an informed decision on the determination of cut scores on the state test. The consistency of cut scores on the CRT across grades is maintained by forcing…

Test items undergo multiple iterations of review before states and vendors deem them acceptable to be placed in a live statewide assessment. This article reviews three approaches that can add validity evidence to states' item review processes. The first process is a structured sensitivity review process that focuses on universal design…

Recent implementation of Nebraska's Standards-based Teacher-led Assessment and Reporting System (STARS) introduced a unique opportunity to examine the benefits and drawbacks of a teacher-led state assessment system. STARS is unique among state assessment systems in that statewide tests are replaced by locally developed assessments designed by…

Outlines a framework for considering the validity of standards-based score interpretations and then considers the potential roles of different stakeholder groups and other participants in that process. Suggests study of a new standard-setting method, the "briefing book," which would describe alternative cut scores. (SLD)

Nebraska's approach to standards, assessment, and accountability, the School-based Teacher-led Assessment and Reporting System (STARS) is based upon local control and the belief that classrooms and teachers must be at the heart of student learning and accountability. STARS relies on locally-developed assessment systems to accurately measure and…

Before using the National Teacher Examinations (NTE) for teacher certification, states are required to conduct a state-wide validity study. This paper describes approaches used in 35 studies for 18 states to establish (NTE) content validity through curriculum and job relatedness and to establish minimum performance standards. (BS)

Describes the procedures by which Kentucky's state assessment program synthesized results from three standard setting procedures (Contrasting Groups, Bookmark, and Jaeger-Mills) for the 2000 state assessment. Shows the value of using multiple standard-setting approaches to gather information from each. (SLD)

Introduces the articles of this theme issue focusing on the involvement of key stakeholder groups in the validation of large-scale high-stakes assessments. Each makes a unique but complementary contribution to the understanding of the demands of a comprehensive validation effort. (SLD)

Makes the point that the interpretations and use of high-stakes test scores rely on policy assumptions about what should be taught and the content standards and performance standards that should be applied. The assumptions built into an assessment need to be subjected to scrutiny and criticism if a strong case is to be made for the validity of the…

Three statewide assessment programs in Connecticut developed in response to the State Board of Education's goals and objectives are described. These include: (1) the Connecticut Assessment of Educational Progress; (2) the Educational Evaluation and Remedial Assessment Program; and (3) the Connecticut Mastery Testing Program.

The steady growth of state testing programs and its implications for the measurement community are discussed in terms of testing purposes (monitoring, accountability, and curriculum advancement) and test development, administration, and reporting. It is important that the measurement community address crucial issues to maintain its substantial…

Addresses issues in evaluating the consequences of assessment programs that are developed to hold schools accountable to state standards. Proposes a validation study to obtain consequential evidence for state assessment and accountability programs that includes a validity argument, propositions that follow from the validity argument, a definition…

If annual performance assessments are to yield results that can be compared from year to year, many technical problems must be addressed. It is essential that tests to be equated measure the same construct. Methods of equating performance assessment scores, ways of equating system assessments, and standard setting are discussed. (SLD)

Eight criteria developed by the National Forum on Assessment (Washington, DC) as guidelines for evaluating existing and proposed assessment systems at any level are listed. Criteria call for clear definitions and fair assessments to assist educators and policymakers in improving instruction. Continuous review and improvement are recommended. (SLD)