The administrative and political ramifications of a form of multiple matrix sampling where all students in the population are tested on a subtest is discussed in the context of a statewide testing program. The conclusion is drawn that large-scale testing programs will have to adopt a testing framework which samples items from the total item domain…

Two methods to establish a common scale across grades within a content area using a common item design (separate and concurrent) have previously been studied under simulated conditions. Separate estimation is accomplished through separate calibration and grade-by-grade chained linking. Concurrent calibration established the vertical scale in a…

How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

In state assessment programs in which performance has no real immediate consequence for the individual examinee, the issue of examinee motivation arises. Some examinees may respond to questions in ways that do not reflect their real knowledge of the test domain. In this study, a new approach was developed to identify students who have responded to…

Provides an overview of the recently developed state accountability system for public elementary and secondary schools in Rhode Island. Discusses accountability systems as technologies of social control and considers the costs, benefits, uncertainties, and necessary tensions associated with accountability systems. (Author/SLD)

This brief paper provides an outline for a discussion about the legality of Florida's functional literacy testing program. It defines relevant terms, explains relevant laws, and sets forth the legal basis for the suit and the remedies sought. The discussion is intended to provide a legal and historical framework within which the developments in…

The objectives of this paper are threefold. First, a model is proposed for unifying massive amounts of conceptual and numerical information flowing from the measures of the accountability movement in Ohio and the materials that are publicly available to educators. Second, this model is translated into useable forms of information that help…

This study was patterned after a previous study by Skaggs and Lissitz (1992) in which inconsistency of differential item functioning (DIF) was reported across test administrations. They suggested multidimensionality of test data as one possible reason for inconsistency. Therefore, in this study, DIF indices which were developed recently with a…

Under the Improving America's Schools Act (IASA), Title I programs are evaluated using standards-based multiple measures. In California, school systems would like to use state standards for the evaluation, but state performance standards are still under development and content standards are very new. The Sacramento City Schools (California) has…

The utilization of the third grade achievement data reported by the California Assessment Program (CAP) to schools was studied. All elementary school principals in California were surveyed in 1979 regarding the uses they made of the report. Over 70 percent used their score reports to compare results across years looking for trends. Other common…

A mixed modal study was conducted that compared the results of Mississippi Biology subject area mean scores of students that used 4X4 block, A/B block, and traditional year-long schedules in large, medium, and small-sized schools. This research also explored data about whether schedule configurations allow sufficient time for students to construct…

This paper examines the validity of measures of teacher effectiveness from the Tennessee Value Added Assessment System (TVAAS). It considers the following claims regarding teacher effects: (1) they capture teachers' unique contributions to student learning adequately; (2) they reflect adequate standards of excellence for comparing teachers; (3)…

This paper discusses the use of two theories of item analysis and test construction, their strengths and weaknesses, and applications to the design of the Hawaii State Test of Essential Competencies (HSTEC). Traditional analyses of the data collected from the HSTEC field test were viewed from the perspectives of item difficulty levels and item…

The practices, policies, and procedures used in all 50 states for evaluating school and school district effectiveness were examined, with a focus on the study of methodological and measurement issues in the collection, analysis, and reporting of information for accountability purposes. Data were collected through computerized literature and Web…