How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

Discusses issues of validity in high-stakes testing, beginning with some purposes of a testing program and proceeding to some underlying assumptions about testing. Suggests four possible studies to address assumptions often ignored by asking various groups of people about testing. (SLD)

The primary purpose of this investigation was to determine whether the positive consequences associated with high stakes test use and interpretation in Arizona were shared among all grade levels in the elementary school, not just the tested grades. In addition, a curriculum alignment variable was examined to observe its association with curricular…

When the drive to develop and administer tests comes from a public call for accountability in a profession, from the government's response to this call, or from politicians attempting to identify a hot issue, it may be said that the test must first have political validity in order to be implemented. Only after this political validity has been…

L. Cronbach has made the point that for validity arguments to be convincing to diverse audiences, they need to be based on assumptions that are credible to these audiences. The interpretations and uses of high stakes test scores rely on a number of policy assumptions about what should be taught in schools, and more specifically, about the content…

This study was designed to contribute to the validity evidence for the Washington Assessment of Student Learning (WASL) by providing additional descriptive data about the performance standards in reading and mathematics at grades 4, 7, and 10. After the realignment of norm-referenced tests, large numbers of students taking the WASL had…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Because districts in Nebraska are not measured on common instruments, comparisons are difficult. This study examined a district evaluation strategy that classifies districts into school performance ratings (SPR) based on a combination of three factors. Student performance and non-cognitive indicator data for three grade levels and two content…

Content integration in performance assessment involves mixing different areas of knowledge in one assessment. In this type of testing situation, assessment tasks are designed to measure the ability of students to solve problems by applying their knowledge and skills in multiple content areas. This study examined the effect of integrated science…

The consequences of large state testing are often uniformity of expectations for achievement. The largest impact of higher standards, then, are realized by traditionally disenfranchised student populations, particularly the least affluent who are most likely to bear the yoke of low expectation. This paper advances S. Messick's (1981) fundamental…

Two perspectives on assessment for teacher certification are described: the competency orientation, and the professional orientation. These perspectives are used to discuss current problems, basically validity issues, in teacher assessment: (1) a professional orientation toward assessment; (2) criterion-referenced assessments; and (3) the unit of…

Due to a concern regarding the validity of Chicago public elementary schools standardized test scores on the Iowa Tests of Basic Skills, a test audit was conducted. The audit was limited to 40 schools. Two schools were selected from each of the 20 administrative districts, with each school testing one seventh- and one eighth-grade class. These…

The validity of various procedures for rank ordering school districts throughout a state on the basis of statewide test results was studied. Data were drawn from the 1987 administration of the Kentucky Essential Skills Test (KEST), which is given each spring to all children enrolled in public school grades kindergarten through 12 in 178 school…