The KeyMath-3 Diagnostic Assessment (KM-3) is an individually-administered math assessment used in educational placement and diagnostic decisions. It includes 10 subtests making up Basic Concepts, Operations, and Applications indexes and a "Total Test" composite that measures overall math ability. Here, covariances among subtests from…

This study aimed to address the need for a comprehensive assessment tool to evaluate the mathematical abilities of first-grade students through cognitive diagnostic assessment (CDA). The primary challenge involved in this endeavor was to delineate the specific cognitive skills and sub-skills pertinent to first-grade mathematics (FG-M) and to…

Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

Psychometric work with young children faces the particular challenge that children's attention spans are relatively short, and therefore, shorter assessments are required while retaining comprehensive coverage. This article reports on three empirical studies that encompass the development and validation of the research-based early mathematics…

The demand for diagnostic feedback has triggered extensive research on cognitive diagnostic models (CDMs), such as the deterministic input, noisy output "and" gate (DINA) model. This study explored two Q-matrix specifications with the DINA model in a statewide large-scale mathematics assessment. The first Q-matrix was developed based on…

Consequential validity (often referred to as "test fairness" in practice) is an essential aspect of educational measurement. This study evaluated the consequential validity of the Research-Based Early Mathematics Assessment (REMA). A sample of 627 children from PreK to second grade was collected using the short form of the REMA. We…

Extended testing time is a common accommodation given to students with disabilities. However, little is known about whether students who are eligible for the accommodation actually use it, and with what effect. The present study used process data available from the digitally delivered 2017 National Assessment of Educational Progress (NAEP)…

The purpose of this study was to estimate the longitudinal and reciprocal predictive relations between children's social skills, measured by an adaptation of the frequently used Social Skills Rating Scale, and their standardized academic achievement. A large nationally representative sample of elementary school students were assessed at least…

Comparatively little research exists on single-skill math (SSM) curriculum-based measurements (CBMs) for the purpose of monitoring growth, as may be done in practice or when monitoring intervention effectiveness within group or single-case research. Therefore, we examined a common variant of SSM-CBM: 1 digit × 1 digit multiplication. Reflecting…

The quality of diagnostic profiles and probability assignment depends on the validity of the proposed attributes and Q-matrix. The rule-space method (RSM), one of diagnostic classification models, provides the quality indices of diagnostic profiles, such as the classification rate and the squared Mahalanobis distance. The study aims to further…

The goal of this study was to provide normative scores and examine the psychometric properties of the Math Computation subtest of the Wide Range Achievement Test--IV (WRAT-IV) for Mexican adolescents after the completion of junior high school. We group-administered this subtest to 1,318 first-year Mexican high school students. We then obtained its…

This study analyzed the relationship between benchmark scores from the newly published Dynamic Indicators of Basic Early Literacy Skills Math (i.e., Acadience™) math probes and student performance on math and reading sections of a state-mandated high-stakes test. Participants were 420 students enrolled in third, fourth, and fifth grades in a rural…

This study investigated cognitive patterns of strengths and weaknesses (PSW) and their relationship to patterns of math errors on the Kaufman Test of Educational Achievement (KTEA-3). Participants, ages 5 to 18, were selected from the KTEA-3 standardization sample if they met one of two PSW profiles: high crystallized ability (Gc) paired with low…

Given the importance of math in today's society, it is critical that children who are at risk for math difficulty are identified early. We developed and validated a prekindergarten math subtest (i.e., CIRCLE Progress Monitoring [CPM] Math Subtest). This teacher-completed measure evaluates domains considered important for later math development.…

We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…