Maul's paper, "Rethinking Traditional Methods of Survey Validation," is a clever and pointed indictment of a set of specific but widespread practices in psychological measurement and the social sciences at large. Through it, Maul highlights central issues in the way to approach theory building and theory testing, bringing to mind the…

The paper reports on trends in language testing taking place over the years and aim at critical perspectives of testing and promoting inclusion, equity and justice. It begins with critical theories by Messick, Foucault and Bourdieu, leading to critical language testing (CLT) which focused on consequences and uses of tests. Given the power of tests…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

Purpose: Nonword repetition (NWR) has been proposed as a culturally and linguistically fair measure of children's language abilities that is useful for the identification of specific language impairment (SLI). However, Moyle, Heilmann, and Finneran (2014) suggested that the density of a child's nonmainstream forms also influences NWR in ways that…

Blue Valley, the fourth largest school district in Kansas, covers 91 square miles. More than 20,000 K-12 students attend its 34 schools (five high schools, nine middle schools, and 20 elementary schools). Blue Valley began using MAP® Growth™ in 2005 to track students' academic growth over time and independently of grade level. In 2010 the district…

Despite the often-negative discussion about testing in schools, assessments are a necessary and useful tool in the teaching and learning process. This is especially true when it comes to diagnostic and formative assessments, which give teachers real-time direction for what students need to learn to master course content. It is this space where the…

The six primary papers in this issue of "Assessment in Education" emphasise a single primary point: the concept of validity is a complex one. Essentially, validity is a collective noun. That is, just as a group of players may be called a team and a group of geese a flock, so too does validity represent a variety of processes and…

The purpose of this embedded-descriptive single-case study was to provide insight into one prekindergarten school's efforts to build teacher capacity in foundational skills. An embedded-descriptive single-case study was a suitable design for the study because the researcher could not manipulate the school's efforts; the setting was contemporary…

Research has found that the "a"-stratified item selection strategy (STR) for computerized adaptive tests (CATs) may lead to insufficient use of high a items at later stages of the tests and thus to reduced measurement precision. A refined approach, unequal item selection across strata (USTR), effectively improves test precision over the…

A few years ago, Marnie O. Malone and her team at Elmira City Schools found themselves facing a challenge that's all too common: How can we best support students who we know aren't likely to meet grade-level standards? To find an answer, they looked to the MAP® Suite of assessments from NWEA®. This brief case study describes how Malone and her…

The purpose of this embedded-descriptive single-case study was to inform prekindergarten principals of an instructional leader's efforts to build teacher capacity in foundational skills of executive function, fine motor integration skills, and associated challenges of laterality of hand and eye dominance. Despite Texas Education Agency's (TEA)…

Recently a novel instrument -- the Core Academic Language Instrument (CALS-I) -- aimed at testing a constellation of school-relevant English language skills was developed and validated for use in the United States (Uccelli, Barr, Dobbs, Galloway, Meneses and Sánchez, 2015. Core Academic Language Skills: An expanded operational construct and a…

Despite the popularity of the TOEIC in the Korean society for over 30 years, few studies have investigated the understanding and usage of TOEIC scores in the Korean context. This research gap needs to be filled to provide test users with useful information in the Korean context. Using an argument-based approach to validation, this study…

The American Chemical Society-Examinations Institute (ACS-EI) released the first ACS Foundations of Inorganic Chemistry Examination in 2016 to better address the two generalized types of inorganic chemistry courses (i.e., at the foundation or second/third-year level and the indepth or third/fourth-year level). The ACS Inorganic Chemistry Exam that…