No Child Left Behind (NCLB) cemented a standardized testing assessment culture in the United States but research has highlighted the inequities (Au, 2020; Dixon, 1978; Grodsky et al., 2008; Khan, 2020; Moses & Nanna, 2007), unreliability (Hunt et al., 2010; Pizmony-Levy & Green Saraisky, 2016) and negative impacts (Berryhill et al., 2009;…

Background: Much is still unknown or unclear about how and where validity issues arise in high stakes testing situations in education, and ways by which we can rectify validity problems in practice and policy contexts. Purpose: This paper is the Foreword to the Special Section in the "Teachers College Record," titled, "When…

The purpose of this study is to develop a theoretically and methodologically sound bidimensional affective scale measuring mathematics anxiety with high psychometric quality. The psychometric properties of a 14-item Mathematics Anxiety Scale-Revised (MAS-R) adapted from Betz's (1978) 10-item Mathematics Anxiety Scale were empirically analyzed on a…

This chapter addresses the psychometric challenges in assessing English language learners (ELLs) and students with disabilities (SWDs). The first section addresses some general considerations in the assessment of ELLs and SWDs, including the prevalence of ELLs and SWDs in the student population, federal and state legislation that requires the…

In the United States, government mandates for educational accountability have prompted an increase in testing in K-12 and higher education settings, resulting in a generation of millennial students who have undergone repeated assessment over the course of their educational careers. The cumulative effects of testing may range from increasingly…

Schools often administer brief intelligence tests as the first step in the identification of students who are cognitively gifted. However, brief measures are often used without consideration of underlying constructs or the psychometric properties of the measures and without regard to the links between screening decisions and educational…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

By the end of the kindergarten, students are expected to possess early academic skills as well as the social maturity to be successful in first grade. Students leaving kindergarten without these readiness skills are sometimes held back in first grade or referred for a special education evaluation in later grades if they fail to make adequate…

The No Child Left Behind Act of 2001 (NCLB, 2002) has produced an explosion of interest in the use of assessment to measure and improve student learning. Initially focused on annual state tests, educators quickly learned that results came too little and too late to identify students who were falling behind. At the same time, evidence from the…

Standards-based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments--their instructional sensitivity--is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

The five papers in this special issue of the "Journal of Applied Testing Technology" address fundamental issues of validity when tests are modified or accommodations are provided to English Language Learners (ELL) or students with disabilities. Three papers employed differential item functioning (DIF) and factor analysis and found the…

The research reported in this paper is focused directly on assessing the validity of the "Teaching Knowledge about Reading and Reading Practices" (TKRRP) assessment. Following the recommendations of the Standards for Educational and Psychological Testing (APA/AERA, 1999), the authors see validation as a process of constructing an…

This study examines the appropriateness of a large-scale state standards-based English-Language Arts (ELA) assessment for students who are deaf or hard of hearing by comparing the internal test structures for these students to students without disabilities. The Grade 4 and 8 ELA assessments were analyzed via a series of parcel-level exploratory…

The early childhood educational field has garnered attention with initiatives to foster skill acquisition in young children prior to kindergarten entry. These initiatives, in conjunction with the rigorous demands of curricular reform and a burgeoning accountability movement, invoke questions regarding the adequacy of the instruments used to assess…