Over the past few years, students by the thousands have refused to take their state's standardized tests. This "opt-out" phenomenon has prompted debate in state legislatures and in Washington, putting states at risk of losing Title I funds. Advocates describe opt-out as a grassroots movement of parents concerned about overtesting,…

This article provides guidelines for an entry-level course that prepares psychology students and practitioners to acquire entry-level skills, abilities, knowledge, and attitudes important to the individual assessment of intellectual abilities of children and youth. The article reviews prominent international, regional, and national policies,…

International Large-Scale Assessments (ILSAs) have been used to draw comparisons among countries on a variety of topics in education and, more broadly, for example, in adolescent development. These assessments can inform the public about influential factors on the micro and macro levels, foster interdisciplinary and international collaboration,…

At the outset of his thoughtful and thought-provoking article, Haertel (this issue) clearly identifies the issue with which he will be dealing: The disjunct, or gap, in current approaches to evaluating the merits of a given test, between the intended uses of that test and the validity of its score-based interpretations. The author thinks that…

Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

Language tests are increasingly being used as gatekeeping tools in a globalised world. This article examines the processes of linguistic gatekeeping by the use of language tests in the context of migration. We draw on half a dozen cases of test-takers of the International English Language Testing System (IELTS) test who applied for entry into…

We describe the development and validation of a three-tiered diagnostic test of the water cycle (DTWC) and use it to evaluate the impact of prior learning experiences on undergraduates' misconceptions. While most approaches to instrument validation take a positivist perspective using singular criteria such as reliability and fit with a measurement…

The use of validated conceptual assessments alongside conventional course exams to measure student learning in introductory courses has become standard practice in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters,…

This article examines the impact of the reading assessment, DIBELS (Dynamic Indicators of Basic Early Literacy Skills), on literacy education through the Habermasian lens. It argues that DIBELS, along with other systemic forces, has surged beyond its domain as a mere assessment and colonized the lifeworld of literacy education by distorting the…

In 2012, Edward Haertel received the NCME Career Contributions Award. The focus article for this issue emerged from his address on the topic "How Is Testing Supposed to Improve Schooling?" His focus article provides a discussion of the relationships between testing and schooling in which he issues a call to action to the measurement community to…

In his thoughtful focus article, Haertel (this issue) pushes testing experts to broaden the scope of their validation efforts and to invite scholars from other disciplines to join them. He credits existing validation frameworks for helping the measurement community to identify incomplete or nonexistent validity arguments. However, he notes his…

The author is deeply gratified by the commentators' thoughtful responses and finds almost nothing to disagree with in any of them. Each offers additional insights prompting further reflection. In drawing out just a few common themes, this brief rejoinder omits many important ideas from the individual contributions. As stated in his title, the…

In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

The ubiquitous use of standardized test results to make varied judgments about educators, students, and schools within the public school system raises concerns of validity. If the test results have not been validated for making multiple determinations, then the decisions made about educators, students, schools, and school districts based on the…

States increasingly are incorporating Kindergarten Entry Assessments (KEAs) into their comprehensive assessment systems with the goal of helping educators identify gaps in children's competencies, target instruction to children's individual needs, engage parents to better support their child's learning, and identify needs for expanding and…