Recent studies indicate that examiners make a number of intentional and unintentional errors when administering reading assessments to students. Because these errors introduce construct-irrelevant variance in scores, the fidelity of test administrations could influence the results of evaluation studies. To determine how assessment fidelity is…

Real and perceived misuses of educational tests, errors in test scoring and test use, and incidents of cheating on tests have been widely reported in local and national media. As educational tests take on additional importance for students, teachers, and schools, there is appropriate concern about the quality of assessments and the appropriate use…

The history and institutional use of cutoff scores is reviewed, emphasizing the changes in these scores used over the years and the rationale used in selecting cutoff scores. A brief description of the College Level Examination Program (CLEP) is provided, as is background about how it works. Cutoff score recommendations of the American Council on…

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

The transcript of a six-part National Public Radio broadcast on standardized testing is presented. The first part focuses on the reasons tests are administered; these reasons are discussed by proponents and opponents of testing. Part Two contains a discussion of the possible bias of tests, and their validity. The third part discusses the…

This report addresses challenges associated with the reporting of test scores of students with disabilities participating in alternate assessments. It summarizes six models currently under construction or already being used by states. Using proficiency levels as a common reporting approach, the six models are: (1) same proficiency levels for…

Using criterion-referenced test item data collected in an empirical study, differences in item selection between Cox and Vargas' pretest-posttest validity index and a latent trait approach (evaluation of the item information function for the mastery score) are analyzed. (Author/GK)

Discrepancies among the standards produced by different criterion-referenced standard-setting techniques may be the result of a failure to adequately define the minimally competent candidate. Current research in this area is reviewed in terms of three categories: studies in which no formal assistance in conceptualization is given to judges,…

Theoretical issues underlying the development of scales of language proficiency are examined. First, a brief classification of scale types is presented, and problems identified in them and advantages they offer are outlined. Discussion then moves to the issues of describing and measuring language proficiency. In this section, behaviorally-based…

Instructional programs organized according to modern educational technology are discussed within the purposes of criterion-referenced measurements used. The problems of criterion-referenced measurements include scoring and score interpretation, item and test analysis, and mastery testing. An overview of solutions and approaches to the problems and…

Introduces controversial issue of subgroup norming, in which normative reference data are based on subgroups of population rather than on total group, in employment testing and briefly highlights two articles that address this issue. Controversy over subgroup norming has increased with passage of Civil Rights Act of 1991, which bans any form of…

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…

Computerized adaptive testing (CAT) has become increasingly common in large-scale testing programs. This paper considers relevant practical issues that are likely to be faced by the developers and managers of a CAT program. The first cluster of issues is that of item pool development and maintenance. It includes such considerations as item pool…

Studies of the mathematics assessments of the National Assessment of Educational Progress (NAEP) are summarized. One study found that omit rates for NAEP test items were higher for African Americans and Hispanics than for whites. The other found that descriptions and examples for the 1992 mathematics achievement levels were misleading. (SLD)

During a three-year project (1977-1980) on computerized adaptive achievement testing, item characteristic curve theory (ICC) and adaptive testing strategies designed almost exclusively for ability testing were applied to achievement testing. Adaptive techniques substantially reduced test length without reducing quality, when applied to three…