Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

Stopping rules for fixed-form tests with graduated item difficulty are intended to stop administration of a test at the point where students are sufficiently unlikely to provide a correct response following a pattern of incorrect responses. Although widely employed in fixed-form tests in education, little research has been done to empirically…

Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade Mathematics Assessment (EGMA). The EGMA is an assessment that tests young children's foundational mathematics knowledge and has…

Diagnostic assessments are intended to support teachers' instructional decision making by providing instructionally relevant information. In this article, we propose that using cognitive theories of learning to design diagnostic assessments can provide teachers with two diagnostic outcomes: (a) the location of a student's thinking within the…

Students' understanding and proficiency with rational number concepts and operations is considered a key foundational skill for future success in algebra. As middle school students work with these concepts, teachers need timely data to determine whether students are making adequate progress. The purpose of this article is to document the content…

In this paper, we describe the design, development, and initial validity evidence for the Screening to Assign Accommodations Tool (SAAT). The purpose of the SAAT is to identify students for whom construct irrelevant variance (CIV) might obscure measurement of their knowledge, skills, and abilities in mathematics. Once students are identified as…

This paper describes the development and intended uses of the Early Grades Mathematics Assessment (EGMA), which measures essential early mathematical knowledge and skills that are foundational to more sophisticated mathematical abilities, predictive of later achievement, and teachable. Administering the EGMA can provide policy makers,…

In this article, we highlight the need for a precisely defined construct in score-based validation and discuss the contribution of cognitive theories to accurately and comprehensively defining the construct. We propose a framework for integrating cognitively based theoretical and empirical evidence to specify and evaluate the construct. We apply…

Diagnosis is an integral part of instructional decision-making. As the bridge between identification of students who may be at-risk for failure and delivery of carefully designed supplemental interventions, diagnosis provides valuable information about students' persistent misconceptions in the targeted domain. In this paper, we discuss current…

The purpose of this study was to develop general outcome measures (GOM) in mathematics so that teachers could focus their instruction on needed prerequisite skills. We describe in detail, the manner in which content-related evidence was established and then present a number of statistical analyses conducted to evaluate the technical adequacy of…

BRT Math Screening Measures focus on students' mathematics performance in grade-level standards for students in grades 1-8. A total of 24 test forms are available with three test forms per grade corresponding to fall, winter, and spring testing periods. Each form contains computation problems and application problems. BRT Math Screening Measures…

Accommodations influence the measurement of student proficiency. However, with discrepant research findings, it is difficult to evaluate the effects of these practices on the measurement of performance of students with special needs. In this article, we present results from an experimental study investigating the effects of item characteristics…

This paper focuses on the use of accommodations by students with disabilities in large-scale assessment programs. The paper is divided into three sections. The first section summarizes the primary issues relevant to including students with disabilities in large-scale testing. The second sections summarizes the research on such participation in the…

Universal design for assessment (UDA) is intended to increase participation of students with disabilities and English-language learners in general education assessments by addressing student needs through customized testing platforms. Computer-based testing provides an optimal format for creating individually-tailored tests. However, although a…