This article offers a critique of the validity argument put forward by Camara, Mattern, Croft, and Vispoel (2019) regarding the use of college-admissions tests in high school assessment systems. We challenge their argument in two main ways. First, we illustrate why their argument fails to address broader issues related to consequences of using…

The six primary papers in this issue of "Assessment in Education" emphasise a single primary point: the concept of validity is a complex one. Essentially, validity is a collective noun. That is, just as a group of players may be called a team and a group of geese a flock, so too does validity represent a variety of processes and…

As the number of candidates who repeat English language proficiency tests more than once to meet a certain cutscore (e.g., for university admission) or to demonstrate progress (e.g., after instruction) continues to increase dramatically, there is a need for more research on the attributes and test performance of test repeaters. This article…

Naomi Gafni, director of Research and Development, National Institute for Testing and Evaluation, Jerusalem, Israel, has devoted a substantial part of her career to the development of admissions tests and other educational tests and to the investigation of their validity. As such she is keenly aware of the complexities involved in this process.…

The usual role of a discussant is to clarify and correct the paper being discussed, but in this case, the author, Howard Wainer, generally agrees with everything David Thissen says in his essay, "Bad Questions: An Essay Involving Item Response Theory." This essay expands on David Thissen's statement that there are typically two principal…

David Thissen is a professor in the Department of Psychology & Neuroscience, Quantitative Program at the University of North Carolina. His research interests include psychological testing, measurement, and item response theory. Here Thissen expresses his gratitude to Howard Wainer for his illuminating discussion of the oral presentation upon…

In the United States, students have historically taken large-scale assessments for many different purposes. One purpose that is shared with many other countries is a desire to monitor aggregate trends in educational attainment in core subject domains such as literacy, mathematics, and science. In this commentary, the author examines testing,…

In this rejoinder, the authors describe the aim of the original study as an effort to conduct a critical test of an important postulate underlying the Cross-Battery Assessment PSW approach (XBA PSW; Kranzler, Floyd, Benson, Zaboski, & Thibodaux, this issue). The authors used classification agreement analysis to examine the concordance between…

Over the past few years, students by the thousands have refused to take their state's standardized tests. This "opt-out" phenomenon has prompted debate in state legislatures and in Washington, putting states at risk of losing Title I funds. Advocates describe opt-out as a grassroots movement of parents concerned about overtesting,…

Whenever a major intelligence or achievement test is revised, there is always renewed interest in the underlying structure of the test as well as a renewed interest in the scoring, administration, and interpretation changes. In this interview, Amy Gabel discusses the most recent revision of the "Wechsler Intelligence Scale for Children-Fifth…

This article presents arguments that the correlation measure "r" of halo is not conceptually more appropriate than the standard deviation (SD) measure. It also describes conditions under which halo effects occur and when the SD and r measures can be used. Neither measure is uniformly superior to the other. (SLD)

A basic consideration in conducting a career education needs assessment is whether to select published tests or to develop new instruments and evaluation techniques. Advantages of published tests are availability and convenience and ease to use. Advantages in using self-developed measures can be seen by examining a needs assessment study in which…

This paper considers the size of the marketplace for education testing. The discussion is focused on commercial standardized achievement tests produced for the elementary and secondary market, the "Elhi" market. A few testing companies now account for the bulk of the test sales in the Elhi market, but it is difficult to obtain exact…

The issue of test user competency arises from the question of restrictions on the use of psychological tests. The only justifiable basis for restricting test use is one that reflects the skills and competencies of the user. Ultimately, only professional judgment determines whether a test is properly used. (SLD)

Technology and testing have become two popular prescriptions for improving education. The technology nostrum suggests that the infusion of modern technology into schools will bolster teaching and learning and will prepare students for an increasingly technological workplace. The testing prescription holds that using standardized test scores to…