The arrival of ChatGPT and other artificial intelligence (AI) has caused considerable concern for educators worldwide, many of whom are still recovering from the impact of the COVID-19 pandemic. Although the debate continues around the use of AI in education, one approach to ensure students are achieving their learning objectives, the oral exam or…

A recent, widely publicized scandal involved students who obtained fraudulent diagnoses of learning disabilities in an effort to get accommodations on college admissions tests. Although the exact circumstances of the scandal are unusual, the methods used to obtain diagnoses and accommodations illustrate widespread problems with current policies.…

Early presidents of the American Educational Research Association were leaders in the testing movement. Their intentions were to improve education by means of testing, which included both IQ and achievement tests. Early measurement experts acknowledged in scholarly articles that IQ tests could not measure inherited ability of groups with vastly…

Single-timepoint educational measurement practices are capable of assessing student ability at the time of testing but are not designed to be informative of student capacity for developing in any particular academic domain, despite commonly being used in such a manner. For this reason, such measurement practice systematically underestimates the…

This essay briefly describes some of the early AERA presidents who were empiricists, several of them directors of research, and how their work connects with some of the issues of design, measurement, analysis, and interpretation today. Beginning with the first president of AERA, a number of presidents through the late 1940s are highlighted, as…

The New York City Department of Education (NYC DOE) gifted-and-talented programs aim to support all students of exceptional learning potential within the public school system. Using proprietary data made available to us by the NYC DOE, we show, however, that substantial disparities exist in the rates of gifted-and-talented admission test taking,…

Since 2001 Colorado, Illinois, and Maine have all enacted policies that require high school juniors to take college entrance exams--the SAT or the ACT. One goal of these policies was to increase college enrollment based on the belief that requiring students to take these exams would make students more likely to consider college as a viable option.…

There has been a recent upsurge of interest in exploring how choices of methods and timing of instruction affect the rate and persistence of learning. The authors review three lines of experimentation--all conducted using educationally relevant materials and time intervals--that call into question important aspects of common instructional…

Atkinson and Geiser (2009) make a strong argument for moving to a new form of college admissions testing using curriculum-based achievement tests. In making their case, however, they exaggerate the weaknesses of current tests such as the ACT and SAT by minimizing these tests' predictive utility and claiming a stronger relationship to socioeconomic…

Instructional alignment is the extent to which stimulus conditions match three instructional components. This paper demonstrates a new perspective in which instructional alignment generates larger effects in research and practice for less "cost" than other instructional constructs. (VM)

Examines practices that encourage false negatives and false positives on licensing and certification tests designed to protect the public. Recommends increasing the amount of testing or raising the required passing score for repeat test takers. (FMW)

Lissitz and Samuelsen (2007) argue that the unitary conception of validity for educational assessments is too broad to guide applied work. They call for attention to considerations and procedures that focus on "test development and analysis of the test itself" and propose that those activities be collectively termed "content validity." The author…

Using the method of qualitative metasynthesis, this study analyzes 49 qualitative studies to interrogate how high-stakes testing affects curriculum, defined here as embodying content, knowledge form, and pedagogy. The findings from this study complicate the understanding of the relationship between high-stakes testing and classroom practice by…

Lissitz and Samuelsen (2007) have proposed a framework that seemingly deems construct validity evidence irrelevant to supporting educational test meaning. The author of this article agrees with Lissitz and Samuelsen that internal evidence establishes test meaning, but she argues that construct validity need not be removed from the validity sphere.…

In response to Lissitz and Samuelsen (2007), the author reconstructs the historical arguments for the more comprehensive unitary concept of validity and the principles of scientific inquiry underlying it. Her response is organized in terms of four questions: (a) How did validity in educational measurement come to be conceptualized as unitary, and…