A web-based activity and testing system (WATS) has features such as adaptive problem sets, videos, and data-driven tools for instructors to monitor and scaffold student learning. Central to WATS adoption and use are questions about the implementation process: What constitutes "good" implementation and how far from "good" is…

The purpose of this study was to evaluate the combined effects of reduced equating sample size and shortened anchor test length on item response theory (IRT)-based linking and equating results. Data from two independent operational forms of a large-scale testing program were used to establish the baseline results for evaluating the results from…

In view of the strengthening momentum in efforts to reforms in examinations in higher education of India and Kerala in particular, and holding that teacher education is in privileged position to initiate examination reforms in higher education by virtue of its link with both school education and the higher education, this paper focuses attention…

Educators and policy makers in the United States have relied on tests to measure educational progress for more than 150 years, and have used the results for many purposes. They have tried minimum competency testing; portfolios; multiple-choice items, brief and extended constructed-response items; and more. They have contended with concerns about…

Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

The administrative and political ramifications of a form of multiple matrix sampling where all students in the population are tested on a subtest is discussed in the context of a statewide testing program. The conclusion is drawn that large-scale testing programs will have to adopt a testing framework which samples items from the total item domain…

Test disclosure legislation in New York State (LaValle Act) has had a major impact on the national testing programs administered by Educational Testing Services (ETS) for various sponsoring organizations. The paper reviews the immediate operational effects of test disclosure in the following areas: (1) increase in number of test forms developed;…

The author, a former employee of the Educational Testing Service, criticizes that organization for having a stranglehold on American education through its monopoly in admissions testing. He claims that ETS has little concern for consumers. (Author/SJL)

Two methods to establish a common scale across grades within a content area using a common item design (separate and concurrent) have previously been studied under simulated conditions. Separate estimation is accomplished through separate calibration and grade-by-grade chained linking. Concurrent calibration established the vertical scale in a…

The study was designed to develop a greater understanding of how test preparation practices/activities have changed in a state with an established testing program that has recently begun to use test scores for school-level accountability purposes. Teachers within 24 public high schools completed a questionnaire related to the use of test…

This document contains seven policy papers and two comments that focus on those aspects of the No Child Left Behind Act involving state academic standards and testing programs; the intersection of state testing and national assessment; tracking of yearly progress; and accountability at the state, district, and school levels. Papers include: (1)…

This study was designed to carry out a survey of the implementation of continuous assessment (CA) in Nigerian universities. Two research questions and one hypothesis were formulated to guide the study. The sample for the study consisted of 1,340 respondents. A 24 item self-report instrument was used for the study. The data generated, were analyzed…

This module explains test review as it is now performed in most large-scale testing programs. It addresses the fundamental aspects of item review principally for fairness, sensitivity, and bias, and to a lesser degree for content and construct validity. The module is designed for a survey course and thus has a broad, rather than deep, focus. The…

How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

This paper briefly summarizes the findings from a national survey for the Measurement Services Association (MSA) of testing and measurement offices regarding their organizational characteristics and their activities and services. Questionnaires were mailed to all testing offices (n=146) at colleges and universities on the MSA Newsletter mailing…