When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models…

Background: In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome.…

Achieving proficiency in core foundational oral language (OL), reading, and writing skills remains difficult for students with specific learning disabilities (SLD) and foundational OL difficulty (National Center for Educational Statistics, 2022). Despite evidence linking OL skills in grammar (morphosyntax, syntax) and vocabulary (semantics) to…

Formative assessment is an important driver in supporting children's writing development. This paper describes a writing rubric designed for use by teachers to formatively assess the writing of children in Pre-K to Grade 2, how the rubric was received by teachers, and its implementation in classrooms. Writing samples from 337 children in 33…

Inference is considered an important factor in comprehension models and has been described as a causal factor in predicting comprehension. To date, specific tests for inference are rare and often rely on specific thematic texts. This reliance on thematic inference may raise some concerns as inference is related to prior text-specific knowledge.…

In this study, children's literature was defined according to a review of the related literature. The value and positive effects of children's literature on children were discussed and opinions of 2nd grade elementary school students' regarding their most and least favourite books were investigated. Participants consisted of 15 students enrolled…

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

Project-based assessment has been used to evaluate coding projects created by students for a long time. Nevertheless, there is a lack of rigorously tested project-based coding rubrics that are developmentally appropriate for early childhood. This study presented the development and testing of a coding rubric to evaluate children's creations with…

Curriculum-based measurement of oral reading fluency (CBM-R) is widely used across the United States as a strong indicator of comprehension and overall reading achievement, but has several limitations including errors in administration and large standard errors of measurement. The purpose of this study is to compare scoring methods and passage…

This study examined the effect of progress monitoring frequency and scoring metric on curriculum-based measurement of written expression (CBM-WE) progress monitoring estimates. The writing progress of 116 second-grade students receiving a classwide writing fluency intervention in their general education classrooms was monitored across 13 weeks…

Background: Children in India are among the lowest performing students on international reading comprehension and writing assessments. Oral language instruction may improve these literacy outcomes. Aim: This pilot study investigated whether a multi-tiered system of language support (MTSLS) improved oral narrative language comprehension, reading…

The purpose of this study was to investigate evidence of reliability, criterion validity, and grade-level differences of curriculum-based measures of writing (CBM-W) with 612 students in grades 1-3. Four scoring procedures (words written, words spelled correctly, correct word sequences, and correct minus incorrect word sequences) were used with…

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

In low-stakes assessments, some students may not reach the end of the test and leave some items unanswered due to various reasons (e.g., lack of test-taking motivation, poor time management, and test speededness). Not-reached items are often treated as incorrect or not-administered in the scoring process. However, when the proportion of…

Purpose: Despite the unprecedented growth of Spanish-English dual language learners (DLLs) in new destination states--where DLLs have not been historically served--empirical understanding of their language and literacy skills is scant. Drawing on scientific understandings of bilingual language acquisition, we compare monolingually scored and…