Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

Early identification of students needing additional support is a foundational component of Multi-Tiered Systems of Support (MTSS). Due to the resource-intensive nature of implementing MTSS, it is critical that universal screening procedures are maximally accurate and efficient. The purpose of this study was to compare the classification accuracy…

Accurate and efficient universal screening is a foundational component of multi-tiered systems of support for reading. By the time students reach middle school, educators often have extant data available to inform screening decisions. Therefore, the decision to collect additional data to inform screening should be considered carefully. The…

A growing body of research suggests that growth in early literacy skills, including letter sound fluency, is predictive of later reading outcomes. In turn, educators and school psychologists use measures of letter sound fluency to monitor student response to early reading instruction. Limited research has evaluated whether decision-making…

Recent research suggests using multiple screening measures to identify students at risk for academic difficulties may decrease the number of students incorrectly identified as such. Gated frameworks in which students that score below a cut-score on an initial measure are assessed with a follow-up measure have been recommended. Researchers have…

A strong foundation in early literacy supports children's academic pursuits and impacts personal, social, and economic outcomes. Therefore, examining the adequacy of early literacy assessments as predictors of future performance on important outcomes is critical for identifying students at risk of reading problems. This study explored the…

This direct replication study compared the use of dichotomized likelihood ratios and interval likelihood ratios, derived using a prior sample of students, for predicting math risk in middle school. Data from the prior year state test and the Measures of Academic Progress were analyzed to evaluate differences in the efficiency and diagnostic…

Researchers and practitioners frequently use curriculum-based measures of reading (CBM-R) within single-case design (SCD) frameworks to evaluate the effects of reading interventions with individual students. Effect sizes (ESs) developed specifically for SCDs are often used as a supplement to visual analysis to gauge treatment effects. The degree…

The current study evaluated whether goal-setting practices that account for seasonal developmental patterns of reading growth decreased the number of weeks data needed to be collected in order to yield accurate response to intervention decisions for a sample of 224 third-grade students. The extent to which more complex decision-making practices…

Despite repeated findings that within-year growth in oral reading rate is nonlinear for many students, existing decision-making frameworks to evaluate response to intervention assume that growth is linear across an entire school year. The purpose of this study was to evaluate the consequences of failing to account for nonlinear growth among…

The current study evaluated the degree to which novice visual analysts could discern trends in simulated time-series data across differing levels of variability and extreme values. Forty-five novice visual analysts were trained in general principles of visual analysis. One group received brief training on how to identify and omit extreme values.…

Recent simulations suggest that trend line decision rules applied to curriculum-based measurement of reading progress monitoring data may lead to inaccurate interpretations unless data are collected for upward of 3 months. The authors of those studies did not manipulate goal line slope or account for a student's level of initial performance when…

Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability…

School psychologists regularly use decision rules to interpret student response to intervention in reading. Recent research suggests that the accuracy of those decision rules depends on the duration of progress monitoring, the number of observations available, and the amount of measurement error present. In this study, we extended existing…

We used existing reading (n = 1,498) and math (n = 2,260) data to evaluate state test scores for screening middle school students. In Phase 1, state test data were used to create a research-derived cut score that was optimal for predicting state test performance the following year. In Phase 2, those cut scores were applied with future cohorts.…