The purpose of this ITEMS module is to provide an introduction to subscores. First, examples of subscores from an operational test are provided. Then, a review of methods that can be used to examine if subscores have adequate psychometric quality is provided. It is demonstrated, using results from operational and simulated data, that subscores…

The measurement community needs to better understand how to interact with the media to effectively disseminate important findings from educational testing efforts. To this end, the current paper will review media coverage of educational testing and related issues and elaborate on areas of concern and opportunities for improved communication…

Over the past few decades, those who take tests in the United States have exhibited increasing diversity with respect to native language. Standard psychometric procedures for ensuring item and test fairness that have existed for some time were developed when test-taking groups were predominantly native English speakers. A better understanding of…

Examinees who take high-stakes assessments are usually given an opportunity to repeat the test if they are unsuccessful on their initial attempt. To prevent examinees from obtaining unfair score increases by memorizing the content of specific test items, testing agencies usually assign a different test form to repeat examinees. The use of multiple…

In the current No Child Left Behind era, K-12 teachers and principals are expected to have a sophisticated understanding of standardized test results, use them to improve instruction, and communicate them to others. The goal of our project, funded by the National Science Foundation, was to develop and evaluate three Web-based instructional modules…

In 1982, Lansing (Michigan) Public Schools took the stance that their low Michigan Educational Assessment Program (MEAP) scores were not reflective of what their students really knew and that, with some short- and long-range planning, scores would improve dramatically. The districtwide effort is briefly described here. (BW)

Incidents affecting the implementation of large-scale testing programs are described to illustrate associated problems. Issues addressed include creation of test materials, preparation of answer documents, transportation of test materials, scoring and analysis of tests, and dissemination and utilization of test results. (TJH)

The author argues that scoring, reporting, and deriving final grades can be considerably assisted by using a computer. He also contends that the savings in time and the computer database formed will allow instructors to determine test quality and reflect on the quality of instruction. (BW)

The increased use of test scores as a measure of school quality is discussed. Legitimate and illegitimate practices of test preparation are considered. Some commercial test preparation programs are reviewed, with some conclusions about their effectiveness and desirability. (SLD)

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

The relevance of state results on tests of the National Assessment of Educational Progress (NAEP) is illustrated with data from the "Digest of Education Statistics--1990" (U.S. Department of Education). Evidence indicates that the contributions of state differences such as economic or demographic differences to NAEP results cannot be…

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

How state educational authorities in Kentucky use statewide test data to rank the state's 178 school districts was studied, using data from the "Kentucky Essential Skills Test: Statewide Testing Results" (1987). The methods used, means of refining those methods, the fairness/accuracy/validity of resulting interpretations, and problems…

Normal Curve Equivalents (NCEs), a new score system for standardized tests, are used by school districts in reporting results to federal funding agencies. The author uses a quiz format to answer questions on the use of NCE scores. (EGS)

Testing programs enacted by the state legislature are changing and improving Florida's educational system in five areas: (1) setting standards for students; (2) making schools more accountable; (3) creating growth through competiton; (4) evaluating educational programs; and (5) assuring the competency of educators. (BS)