In Programme for International Student Assessment (PISA), item response theory (IRT) scaling is used to examine the psychometric properties of items and scales and to provide comparable test scores across participating countries and over time. To balance the comparability of IRT item parameter estimations across countries with the best possible…

This study sought to investigate how states communicate results for academic achievement and English language proficiency (ELP) assessments to parents who are English learners (EL). This objective was addressed by evaluating: (a) whether score reports and interpretive guides for state academic achievement and ELP assessments in each state were…

The Programme for International Student Assessment (PISA) is an important international study of 15-olds' knowledge and skills. New results are released every 3 years, and have a substantial impact upon education policy. Yet, despite its influence, the methodology underpinning PISA has received significant criticism. Much of this criticism has…

Postsecondary schools have traditionally relied on admissions tests such as the SAT and ACT to select students. With high school achievement assessments in place in many states, it is important to ascertain whether scores from those exams can either supplement or supplant conventional admissions tests. In this study we examined whether the Arizona…

The author addresses issues raised by Burket (TM 510 174) about the Iowa Test of Basic Skills scaling procedures. Further reasons for his criticism of Thurstone scale scores and item response theory scale scores for elementary school achievement tests are given. (BS)

Many educational testing programs report examinee performance at more than two levels of proficiency. Whether these assessments have the capacity to support these multiple inferences, though, is a topic that has not been widely discussed. This study proposes a method for evaluating the minimum number of measurement opportunities for reporting…

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

Two major problems related to the identification of learning disabilities with individually administered achievement tests are discussed: (1) the appropriateness of standard versus developmental scores for determining the severity of discrepancy; and (2) the limitations of existing developmental score scales. Characteristics of the developmental…

Multiple-choice items are a mainstay of achievement testing. The need to adequately cover the content domain to certify achievement proficiency by producing meaningful precise scores requires many high-quality items. More 3-option items can be administered than 4- or 5-option items per testing time while improving content coverage, without…

There are many threats to validity in high-stakes achievement testing. One major threat is construct-irrelevant variance (CIV). This article defines CIV in the context of the contemporary, unitary view of validity and presents logical arguments, hypotheses, and documentation for a variety of CIV sources that commonly threaten interpretations of…

Although it is assumed that student cognition contributes to student performance on achievement tests, it may be that current testing models lack the degree of specification necessary to warrant such inferences. With test score interpretations as the referent, the authors in this special issue address the role of student cognition in learning and…

The relationships between ratings on the Idaho Alternate Assessment (IAA) for 116 students with significant disabilities and corresponding ratings for the same students on two norm-referenced teacher rating scales were examined to gain evidence about the validity of resulting IAA scores. To contextualize these findings, another group of 54…

A Friends for Education (FFE) survey revealed that no state is below the norm at the elementary school level on six nationally normed commercially available achievement tests. Tests use a norm group from the past for comparison, but FFE suspects that inaccurate initial norms and teaching the test may cause high scores. (SLD)

Officials of the United States Department of Education conclude that the pervasive "above average" achievement reported by J. J. Cannell (1988) results from a combination of testing practices and procedures among school testing programs. Causative factors of this paradox, dubbed the "Lake Wobegon Phenomenon," are discussed.…

Representatives of the Riverside Publishing Company discuss the "Lake Wobegon Phenomenon," the reported "above average" achievement of most elementary schools nationwide that was discussed by J. J. Cannell (1988) of the Friends for Education. More appropriate use of normative comparisons and more complete reporting of test…