Diagnostic classification models (DCMs) are psychometric models designed to classify examinees according to their proficiency or nonproficiency of specified latent characteristics. These models are well suited for providing diagnostic and actionable feedback to support intermediate and formative assessment efforts. Several DCMs have been developed…

Diagnostic classification models (DCMs) are psychometric models designed to classify examinees according to their proficiency or nonproficiency of specified latent characteristics. These models are well suited for providing diagnostic and actionable feedback to support intermediate and formative assessment efforts. Several DCMs have been developed…

Correct specifications of hierarchical attribute structures in analyses using diagnostic classification models (DCMs) are pivotal because misspecifications can lead to biased parameter estimations and inaccurate classification profiles. This research is aimed to demonstrate DCM analyses with various hierarchical attribute structures via Bayesian…

Place value is one of the 'big ideas' in number and plays a critical role in helping students develop their number sense, problem solving and computation skills. Yet, the elegant simplicity of our place value system belies the abstract nature of the construct. This paper presents data from 606 Year 3-6 students (ages 8-12) from two metropolitan…

In mathematics, the keyword strategy involves identifying a keyword and using that keyword to determine the operation needed to find a word problem's solution. We analyzed 747 high-stakes released items across grades 3, 4, 5, 6, 7, and 8. Of these, 57 items did not involve written text. Of the 690 text-based items, we classified 69% as directive…

In mathematics, the keyword strategy involves identifying a keyword (e.g., "altogether") and using that keyword to determine the operation needed to find a word problem's solution. We analyzed 747 high-stakes released items across Grades 3, 4, 5, 6, 7, and 8 from the Partnership for Assessment for Readiness for College and Careers and…

This paper introduces AMMORE, a new dataset of 53,000 math open-response question-answer pairs from Rori, a mathematics learning platform used by middle and high school students in several African countries. Using this dataset, we conducted two experiments to evaluate the use of large language models (LLM) for grading particularly challenging…

Children's math performance is strongly correlated with later life outcomes, but early gaps in math skills are stubbornly difficult to close. It is therefore important to identify student math needs early. Using Grade 1-3 student records from Kentucky public schools, the study finds that typically recommended cut scores for widely used early grade…

Reasoning and justification are among the core skills that mathematics education aims for students to acquire. Studies indicate that students having these skills are able to formulate meaningful geometric ideas. It is also important that students know the significance underlying the operations and mathematical ideas employed or, in other words,…

This study aimed to address the need for a comprehensive assessment tool to evaluate the mathematical abilities of first-grade students through cognitive diagnostic assessment (CDA). The primary challenge involved in this endeavor was to delineate the specific cognitive skills and sub-skills pertinent to first-grade mathematics (FG-M) and to…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

The van Hiele theory and van Hiele Geometry Test have been extensively used in mathematics assessments across countries. The purpose of this study is to use classical test theory (CTT) and cognitive diagnostic modeling (CDM) frameworks to examine psychometric properties of the van Hiele Geometry Test and to compare how various classification…

This article presents a latent class model for multilevel data to identify latent subgroups and estimate heterogeneous treatment effects. Unlike sequential approaches that partition data first and then estimate average treatment effects (ATEs) within classes, we employ a Bayesian procedure to jointly estimate mixing probability, selection, and…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…

Drawing from the developmental and cognitive mathematics literature, the purpose of this study was to investigate the reliability, validity, and diagnostic utility of a widely-researched number line task in kindergarten. Specifically, the Number Line Assessment 0-100 (NLA 0-100) as compared to an established kindergarten screening measure was…