It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

The utilization of the third grade achievement data reported by the California Assessment Program (CAP) to schools was studied. All elementary school principals in California were surveyed in 1979 regarding the uses they made of the report. Over 70 percent used their score reports to compare results across years looking for trends. Other common…

This paper examines the validity of measures of teacher effectiveness from the Tennessee Value Added Assessment System (TVAAS). It considers the following claims regarding teacher effects: (1) they capture teachers' unique contributions to student learning adequately; (2) they reflect adequate standards of excellence for comparing teachers; (3)…

Multiple measures may mean multiple opportunities to show achievement or the use of multiple assessment formats. A third meaning is the use of assessments from different sources, such as augmenting an external, usually commercial assessment with a state's own assessment. The first two meanings of multiple assessments have been explored…

The new Elementary and Secondary Education Act amendments require states to begin annual testing in grades 3 through 8 in reading and mathematics by the 2005-2006 school year. Only 16 states currently have grade-by-grade tests in reading and mathematics, and only 9 of those have tests aligned with their standards, as the law requires. The rest of…

This paper is designed to initiate discussion about new educational accountability systems and the implications of these systems for educator preparation. Accountability systems are often developed with little regard to a clear definition of accountability, but once the systems are in place, and states are showing (realistic or political)…

Since the passage of the 1997 amendments to the Individuals with Disabilities Education Act, inclusion of all students with disabilities in accountability systems has been mandatory. By 2001, school personnel began to understand that alternate assessment needed to focus on students' performance on state standards, and nearly all states had created…

Examines the purposes of large-scale assessment programs, outlines the dangers and benefits of these assessments, considers the research evidence about the consequences of assessment, discusses how to evaluate assessment quality, and presents some ideas about the variables that influence the probabilities for good and bad assessment. (SLD)

When the drive to develop and administer tests comes from a public call for accountability in a profession, from the government's response to this call, or from politicians attempting to identify a hot issue, it may be said that the test must first have political validity in order to be implemented. Only after this political validity has been…

L. Cronbach has made the point that for validity arguments to be convincing to diverse audiences, they need to be based on assumptions that are credible to these audiences. The interpretations and uses of high stakes test scores rely on a number of policy assumptions about what should be taught in schools, and more specifically, about the content…

A survey, designed to take approximately 15 minutes to complete, was administered to 1,656 elementary school teachers in Michigan to obtain information on a variety of topics related to student assessment and mandated state testing. Most of the teachers were employed in small suburban or urban schools, and 88% were employed in the public schools.…

This paper compares the decision-making strategies which have been incorporated in the Teacher Performance Assessment Instruments in Georgia and the Assessments of Performance in Teaching developed for use in South Carolina. Although both instruments are designed for use with beginning teachers, the decision-making structure of these two…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Matches between questions in the Kentucky Instructional Results Information System for 1995-96 (KIRIS96), the Comprehensive Tests of Basic Skills, Fourth Edition (CTBS4), and the California Achievement Tests, Fifth Edition (CAT5) and the Kentucky Academic Expectations as they are defined in the Kentucky curriculum framework were studied. Each…

In the year 2000, the Alaska High School Graduation Qualifying Examination (HSGQE) was given for the first time. The HSGQE is currently scheduled to be a graduation requirement for all students graduating as of January 2002, but early results from the use of the HSGQE in the Anchorage school district raise serious questions about the use of the…