The 2022-2023 Indiana Assessments Policy Manual serves as the foundation for established guidelines regarding appropriate test administration in Indiana for key stakeholders including educators and Test Coordinators. The following document contains policy guidance and contains appendices which pertain to specific aspects of test implementation,…

Current mathematics curricula and assessments emphasize students' ability to communicate mathematical reasoning in writing. Limited research exists, however, on what mathematics writing (MW) is and how to assess the quality of MW. Therefore, based on our definition of MW construct, we explored 4 approaches to scoring MW: (a) holistic rubric…

The use of mixed-format tests made up of multiple-choice (MC) items and constructed response (CR) items is popular in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district- and state-level assessments in the United States. Rater effects, or raters' scoring tendencies that result in…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

Constructed response (CR) items are widely used in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district and state-level assessments in the United States. One unique feature of CR items is that they depend on human raters to assess the quality of examinees' work. The judgment of human…

Educators struggle to assess various aspects of reading in valid and reliable ways. Whether it is comprehension, phonological awareness, vocabulary, or phonics, determining appropriate assessments is challenging across grade levels and student abilities. Also challenging is measuring aspects of fluency: rate, accuracy, and prosody. This article…

This article provides three major contributions to the literature: we provide granular information on the development of student argumentative writing across secondary school; we replicate the MacArthur et al. model of Natural Language Processing (NLP) writing features that predict quality with a younger group of students; and we are able to…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

This publication highlights the key concepts and findings of the 2018 National Assessment of Educational Progress (NAEP) Oral Reading Fluency (ORF) study. Oral reading fluency is defined as the ability to read text aloud with speed, accuracy, and proper expression. The NAEP ORF study was administered to a nationally representative sample of over…

Becoming a fluent reader has been established as important to reading comprehension. Prosody (expression) is an indicator of fluent reading that is linked to improved comprehension in students across elementary, middle, and secondary grades. Fluent reading is most often evaluated by classroom teachers through the use of a rubric, with the most…

The 2018 NAEP Oral Reading Fluency (ORF) study is conducted by NCES to examine fourth-grade students' ability to read passages out loud with sufficient speed, accuracy, and expression, as well as foundational skills to gauge underlying sources of poor fluency. Oral reading fluency and foundational skills are important components of reading that…

The National Assessment of Educational Progress (NAEP) -- often called "The Nation's Report Card" -- is the largest nationally representative and continuing assessment of what students in public and private schools in the United States know and can do in various subjects and has provided policy makers and the public with invaluable…

The article presents the results of a randomized experimental study of a writing curriculum for college developmental writing courses based on strategy instruction with self-regulation integrated with practices common in college composition. Students in a full semester course learned strategies for planning and revising based on rhetorical…

Up until 2020, National Assessment of Educational Progress (NAEP) reading scores had increased only slightly since the early 1990s with large achievement gaps for students of color and students living in poverty. Modest gains in fourth grade reading proficiency since 1992 were erased during the pandemic. The insufficient progress in reading even…