This investigation explores the relationship between the use of digital pencil and mathematical problem-solving accuracy among 1,530 students with learning disabilities (LD) and 25,400 general education (GE) peers from the 2017 digital National Assessment of Educational Progress mathematics assessment. The term "digital pencil" in this…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

The National Assessment of Educational Progress (NAEP) program only reports state-level subgroup results if it samples at least 62 students identifying with the subgroup. Since some subgroups constitute small proportions of many states' general student populations, these minority subgroups are seldom sufficiently sampled to meet this sample size…

Constructed response (CR) items are widely used in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district and state-level assessments in the United States. One unique feature of CR items is that they depend on human raters to assess the quality of examinees' work. The judgment of human…

This publication highlights the key concepts and findings of the 2018 National Assessment of Educational Progress (NAEP) Oral Reading Fluency (ORF) study. Oral reading fluency is defined as the ability to read text aloud with speed, accuracy, and proper expression. The NAEP ORF study was administered to a nationally representative sample of over…

Automatic machine learning (AutoML) methods automate the time-consuming, feature-engineering process so that researchers produce accurate student models more quickly and easily. In this paper, we compare two AutoML feature engineering methods in the context of the National Assessment of Educational Progress (NAEP) data mining competition. The…

The 2018 NAEP Oral Reading Fluency (ORF) study is conducted by NCES to examine fourth-grade students' ability to read passages out loud with sufficient speed, accuracy, and expression, as well as foundational skills to gauge underlying sources of poor fluency. Oral reading fluency and foundational skills are important components of reading that…

In this secondary analysis study, the authors explored the relations between reading comprehension and oral reading performance in fourth-grade students, using a data set from the U.S. National Assessment of Educational Progress (NAEP) special study of oral reading. The data set consisted of 1,713 students randomly selected from the 140,000 fourth…

U.S. school districts differ dramatically in their socioeconomic and demographic characteristics (Reardon, Yun, & Eitle, 1999; Stroub & Richards, 2013), and districts have considerable influence over instructional and organizational practices that may affect academic achievement (Whitehurst, Chingos, & Gallaher, 2013). This paper…

Students' explanations of their mathematical thinking and conclusions have become a greater part of the assessment landscape in recent years. With a sample of 71 fourth-grade students at risk for mathematics learning disabilities, we investigated the relation between student accuracy in comparing the magnitude of fractions and the quality of…

Student explanations of their mathematical thinking and conclusions have become a greater part of the assessment landscape in recent years. With a sample of 71 4th-grade students at-risk for mathematics learning disabilities, we investigated the relation between student accuracy in comparing the magnitude of fractions and the quality of students'…

The 3 purposes of this study were to: (a) describe fraction ordering errors among at-risk 4th-grade students; (b) assess the effect of part-whole understanding and accuracy of fraction magnitude estimation on the probability of committing errors; and (c) examine the effect of students' ability to explain comparing problems on the probability of…

The three purposes of this study were to (a) describe fraction ordering errors among at-risk fourth grade students, (b) assess the effect of part-whole understanding and accuracy of fraction magnitude estimation on the probability of committing errors, and (c) examine the effect of students' ability to explain comparing problems on the probability…

This article describes a comprehensive approach to fully automated assessment of children's oral reading fluency (ORF), one of the most informative and frequently administered measures of children's reading ability. Speech recognition and machine learning techniques are described that model the 3 components of oral reading fluency: word accuracy,…

The impact of uncertainty about item parameters on test information functions is investigated. The information function of a test is one of the most important tools in item response theory (IRT). Inaccuracy in the estimation of test information can have substantial consequences on data analyses based on IRT. In this article, the major part (called…