It is widely accepted dogma that consequential decisions are better made with multiple measures, because using but a single one is thought more likely to be laden with biases and errors that can be better controlled with a wider source of evidence for making judgments. Unfortunately, advocates of using multiple measures too rarely provide detailed…

"Uneducated Guesses" challenges everything our policymakers thought they knew about education and education reform, from how to close the achievement gap in public schools to admission standards for top universities. In this explosive book, Howard Wainer uses statistical evidence to show why some of the most widely held beliefs in…

The screening for flaws done for multiple-choice items is often not done for large items. Examines continuous item weighting as a way to manage the influence of differential item functioning (DIF). Data from the College Board Advanced Placement History Test are used to illustrate the method. (SLD)

The attempt by D.Edwards and C. B. Cummings to adjust state mean Scholastic Aptitude Test Scores for differential participation rates with a "fuzzy truncation model" satisfies three criteria the authors previously defined but falls short for two. Omission of sensitivity studies mars the otherwise exemplary study. (SLD)

This study examined the Law School Admission Test (LSAT) through the use of testlet methods to model its inherent, locally dependent structure. Precision, measured by reliability, and fairness, measured by the comparability of performance across all identified subgroups of examinees, were the focus of the study. The polytomous item response theory…

A mathematics item on the Scholastic Aptitude Test (SAT) was found to be faulty and received wide publicity. A detailed investigation into its mathematical and psychometric properties is presented. It was found that the problem could be considered ambiguous but that almost no one noticed the ambiguity. (Author/JKS)

Techniques of exploratory data analysis (EDA) were used to decompose data tables portraying performance of ethnic groups on the Scholastic Aptitude Test. These analyses indicate the size and structure of differences in performance among groups studied, nature of changes across time, and interactions between group membership and time. (Author/DWH)

A testlet is an integrated group of test items presented as a unit. The concept of testlet differential item functioning (testlet DIF) is defined, and a statistical method is presented to detect testlet DIF. Data from a testlet-based experimental version of the Scholastic Aptitude Test illustrate the methodology. (SLD)

Between 1980 and 1984 SAT scores rose 8 points for whites and 15 points for non-whites, but the overall mean increased only 7 points. This article explains that this is not an arithmetic error, but an example of a statistical phenomenon called Simpson's Paradox. It describes how to avoid it. (JAZ)

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

Describes recent research attempts to draw inferences about the relative standing of the states on the basis of mean SAT scores. This paper identifies five serious errors that call into question the validity of such inferences. Some plausible ways to avoid the errors are described. (Author/LMO)

The low and decreasing validity of the Scholastic Aptitude Test (SAT) for predicting first-year grades at the University of Hawaii (Manoa) for Hawaiian students is explored. No explanation is derived, but it does not appear to be an artifact caused by improper grouping of students. (SLD)

It is important to estimate the number of examinees who reached a test item, because item difficulty is defined by the number who answered correctly divided by the number who reached the item. A new method is presented and compared to the previously used definition of three categories of response to an item: (1) answered; (2) omitted--a…

Discusses changes in testing as a result of the availability of extensive inexpensive computing and some recent developments in statistical test theory. Describes the role of the Computerized Adaptive Test (CAT) and modern Item Response Theory (IRT) in ability testing tailored to each student's knowledge and ability. (JAC)

In June 1993 the "Wall Street Journal" carried a table of data prepared by the Heritage Foundation that listed the states in order of the average amount they expend on each public school student. The table also contained each state's rank on the average score on the Scholastic Aptitude Test (SAT) and the rank of each state in the average…