Test security is not an end in itself; it is important because we want to be able to make valid interpretations from test scores. In this article, I propose a framework for comprehensive test security systems: prevention, detection, investigation, and resolution. The article discusses threats to test security, roles and responsibilities, rigorous…

The article reviews research and findings on problems and issues faced when translating international academic achievement tests. The purpose is to draw attention to the problems, to help to develop the procedures followed when translating the tests, and to provide suggestions for further research. The problems concentrate on the following: the…

A strength of this exploration of testing and test use in the United States is the concern for how tests affect student conceptions of learning and student relation to knowledge. A weakness is a persistent confounding of classroom and large-scale assessment for state and national purposes. (SLD)

If annual performance assessments are to yield results that can be compared from year to year, many technical problems must be addressed. It is essential that tests to be equated measure the same construct. Methods of equating performance assessment scores, ways of equating system assessments, and standard setting are discussed. (SLD)

The increased use of test scores as a measure of school quality is discussed. Legitimate and illegitimate practices of test preparation are considered. Some commercial test preparation programs are reviewed, with some conclusions about their effectiveness and desirability. (SLD)

This paper responds to an article that criticizes S. A. Cohen's position on the application of instructional alignment to teaching test wiseness. The value and ethics of using certain types of norm-referenced tests are criticized, based on data for the Missouri Mastery Achievement Test. (TJH)

Differences between national testing as discussed in the most recent report of the National Council on Education, Standards, and Testing, and by the Office of Technology Assessment are reviewed. National testing is not new, but the political use of nationally standardized achievement tests is a recent and dangerous trend. (SLD)

State legislative action to control and reward teaching quality has resulted in the coming of age of systematic teacher performance evaluation for certification, merit pay, or career ladder advancement decisions. This article overviews issues of credibility and practicality--including test design, validity, and reliability--which arise when…

Implementing measurement specialists' ideas about content validity with licensure examinations and the problem of court litigation are discussed. Validity issues surfacing when sponsors of national licensure examinations conduct validity investigations are considered. Issues include local versus national focus on content validity, job analysis,…

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

Results of a 1987 report indicating that elementary students of all states were above the national average are assessed. Issues addressed include teaching for standardized tests, the effect of teaching on national norms, and alternatives available to protect the integrity of instruction and the validity of normed test scores. (TJH)

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

The extent to which performance assessments can have unintended and undesirable consequences is not yet clear, but preliminary evidence suggests several issues of bias and fairness. Among these is the sheer difficulty of scoring complex performance assessments, as Vermont's experiences with portfolio assessment illustrate. (SLD)

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

National curriculum assessment in England and Wales is explored, focusing on its troubled implementation. The work of the Task Group on Assessment and Testing and teacher resistance to the mandated testing are discussed. Experiences in England and Wales provide insight into what can be expected in a national assessment system. (SLD)