The objective of this paper is to comment on the think-aloud methods presented in the three papers included in this special issue. The commentary offered stems from the author's own psychological investigations of unobservable information processes and the conditions under which the most defensible claims can be advanced. The structure of this…

Self-report is required to assess mental states in nuanced ways. By implication, self-report is indispensable to capture the psychological processes driving human learning, such as learners' emotions, motivation, strategy use, and metacognition. As shown in the contributions to this special issue, self-report related to learning shows convergent…

In this commentary we first examine psychometric issues in the ambitious enterprise of cross-cultural application of the Parental Burnout Assessment (PBA). The present reports span a wide range of cultural places. Overall, the PBA presents good face validity and a strong replication of factor structure; future multi-group confirmatory factor…

This article is a commentary on McGill et al.'s (2020) article "Use of Translated and Adapted Versions of the WISC-V: Caveat Emptor." McGill et al. use caveat emptor in their title to indicate that the buyer of an assessment must be careful about the product being purchased, presumably because the seller of the assessment is not being…

As editors for this special journal, Graves and Woods have compiled a discussion of the accuracy of the labels for Black children. It is exciting that they have brought together a team of scholars to tackle the very specific question posed by Hilliard (1991) and Guthrie (1976/2002) about the validity of IQ testing in regards to accurately and…

When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

The six primary papers in this issue of "Assessment in Education" emphasise a single primary point: the concept of validity is a complex one. Essentially, validity is a collective noun. That is, just as a group of players may be called a team and a group of geese a flock, so too does validity represent a variety of processes and…

The target paper, "Rethinking Traditional Methods of Survey Validation" (Andrew Maul), raises some interesting critical ideas, both old and new, about the validation of self-report surveys. As indicated by Dr. Maul, recent policy initiatives in the United States (e.g., ESSA) have led to a demand for assessments of…

In this commentary, the authors have set out some areas where they see overlaps between the original position paper and the current discussion around theory and practice in language assessment, the key consideration of washback, and the need for a greater awareness of, and engagement with, the assessment literacy of policy-makers and other key…

As the number of candidates who repeat English language proficiency tests more than once to meet a certain cutscore (e.g., for university admission) or to demonstrate progress (e.g., after instruction) continues to increase dramatically, there is a need for more research on the attributes and test performance of test repeaters. This article…

Naomi Gafni, director of Research and Development, National Institute for Testing and Evaluation, Jerusalem, Israel, has devoted a substantial part of her career to the development of admissions tests and other educational tests and to the investigation of their validity. As such she is keenly aware of the complexities involved in this process.…

This special issue of "Assessment in Education" contains the type of debate needed about what Cizek (2015) calls a "… lingering flaw in the concept of validity…." Some practitioners might not agree that the current theory of validation is flawed. Specifically, the debate Jon Twing is referencing concerns the role of the…

Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

Kathleen Slaney, associate professor in the History, Quantitative and Theoretical Psychology stream in the Department of Psychology at Simon Fraser University, comments on three issues she considers central to a fruitful discussion of how "validity" should be used in the context of testing.

In this commentary, Kuhn and Ranger hypothesize that most people are aware that talent does not guarantee success in case one is lazy. This is also true for the performance in achievement tests that depends on, among other factors, achievement potential (ability) and willingness to achieve (test-taking motivation) of the test taker. They add that…