Atkinson and Geiser (2009) make a strong argument for moving to a new form of college admissions testing using curriculum-based achievement tests. In making their case, however, they exaggerate the weaknesses of current tests such as the ACT and SAT by minimizing these tests' predictive utility and claiming a stronger relationship to socioeconomic…

When test data from different sources conflict, the truth is often found somewhere in the middle. As this article shows, reports of achievement trends can be heavily influenced by the particular definition of achievement represented and by testing conditions. Recent progress in science and mathematics must be carefully nurtured in the nineties.…

Use of the Rasch model for vertical equating of tests is discussed. Although use of the model is promising, empirical results raise questions about the adequacy of the Rasch model. Latent trait models with more parameters may be necessary. (JKS)

The validity of interpretations of National Assessment of Educational Progress (NAEP) achievement levels is evaluated by focusing on evidence regarding three types of discrepancies: (1) between standards; (2) among descriptions of achievement levels; and (3) between assessments and content standards. All of these discrepancies raise serious…

Current discussions of the effects of test administration conditions (i.e., testing stakes) and the motivational levels associated with them on achievement test performance are reviewed. Results of a nonexperimental study suggest that, in contrast to a moderate-stakes testing environment, the National Assessment of Educational Progress does not…

The contribution of item response theory to the validity of interpretations of achievement test results is reviewed in the context of four applications. The applications include construction of scales for achievement tests, test construction, development of customized tests, and investigation of the influence of instruction on achievement tests.…

Reviews the Anchor Test Study which had two major objectives: to provide a method for translating a child's score on any one of eight widely used standardized reading tests into a score on any of the other tests and to provide new nationally representative norms for each of these eight tests. (Author/BJG)

The purpose of this investigation was to examine the interaction of item content and group membership on achievement test items. Estimates of the parameters of the three parameter logistic model were obtained on the 46 item math test for the sample of eighth grade students (N = 2055) participating in the Illinois Inventory of Educational Progress,…

The three-parameter logistic model has been used for identifying test items that may be biased. An approach is presented here that is applicable even when one of the subgroups is relatively small. Interactions between item content and group membership, commonly called item bias, may be conceptualized as multidimensionality. (Author/BW)

Effects of instructional coverage variations on item characteristic functions were examined, using eighth-grade data from the Second International Mathematics Study (1985). Although some differences in item response curves were large, better performance was not necessarily related to greater learning opportunity. Item curve response differences…

During the past 6 years, under a contract from the National Center for Education Statistics, a Technical Review Panel has overseen and conducted a series of research studies addressing a range of validity questions relevant to the various uses and interpretations of the National Assessment of Educational Progress (NAEP). Study topics included: (1)…

Currently in the United States there is considerable interest in developing a system of examinations that is substantially different from the large-scale testing programs presently in use in this country. These new exams would involve a different form of assessment than current tests and would also enable greater local control over the…

In considering the problem of measuring achievement for the evaluation of school effectiveness, there are at least three questions that need to be answered: (1) What is to be measured? (2) How is it to be measured? (3) How are the results to be analyzed? Following a discussion related to the first two questions--determining content objectives and…

Student achievement test results are the coin of the realm in educational accountability systems in the United States. For a number of years, both states and the federal government have relied heavily on tests to judge the quality of schools. The exact characteristics of the accountability systems have evolved over the years and vary a good deal…