In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

Large gains in scores have been observed over the first years of the Kentucky Instructional Results Information System (KIRIS) program. The extent to which these gains in scores indicate that student learning improved was evaluated. Previous studies have suggested that KIRIS score gains might be appreciably inflated, something that might result…

This report responds to a request for information about the quality of the tests the City University of New York (CUNY) uses to decide who must take remedial courses and a profile of CUNY freshmen. Roughly 65% of CUNY bachelor's degree students and nearly 90% of associate degree students are required to take remedial courses in reading, writing,…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Because districts in Nebraska are not measured on common instruments, comparisons are difficult. This study examined a district evaluation strategy that classifies districts into school performance ratings (SPR) based on a combination of three factors. Student performance and non-cognitive indicator data for three grade levels and two content…

Explores issues involved in using assessments to define standards and encourage efforts to meet them and compares the European examination system with the American testing system. Also considered are issues of the definition of learning domains in ways that do not encourage narrowly focused training on specific assessment items. (SLD)

Two perspectives on assessment for teacher certification are described: the competency orientation, and the professional orientation. These perspectives are used to discuss current problems, basically validity issues, in teacher assessment: (1) a professional orientation toward assessment; (2) criterion-referenced assessments; and (3) the unit of…

This article examines one of the challenges to the integration of classroom and large-scale portfolio assessment, a challenge posed by the use of a student's classroom portfolio for large-scale assessment of his or her individual competencies. When work is composed with the support of peers, teachers, and parents, whose work is being judged? The…

The validity of various procedures for rank ordering school districts throughout a state on the basis of statewide test results was studied. Data were drawn from the 1987 administration of the Kentucky Essential Skills Test (KEST), which is given each spring to all children enrolled in public school grades kindergarten through 12 in 178 school…

The current trend toward site-based management in education, with its accompanying shift toward decision making at the individual school level, means new responsibilities and roles for principals. Principals are now required to be intimately involved in budgeting, personnel recruitment and hiring, selection of curricula and textbooks, and many…

The statute authorizing the National Assessment of Educational Progress (NAEP) calls for the National Assessment Governing Board (NAGB) to set appropriate achievement levels in all areas and grades tested by the NAEP. These levels are intended to establish what students should know, not just what they do know. In 1990, the NAEP posited three…

A large urban northwest school district is engaged in the construction of a central accountability policy that depends on school-based implementation. As part of this effort, the district has implemented a standards-based exit policy. Each school has identified students as either meeting grade-level standards or not meeting these standards. This…