We report findings of this replication study, examining the internalizing subscale (SRSS-I4) of the revised version of the Student Risk Screening Scale for Internalizing and Externalizing behavior (SRSS-IE 9) and the internalizing subscale of the Teacher Report Form (TRF). Using the sample from 13 elementary schools across three U.S. states with…

In many countries, high-stakes tests play an important role in allocating students to prestigious tracks and schools in secondary education or to prestigious programs and colleges in tertiary education. It is not clear what happens if the cutoff points in these tests are systematically lowered. Will this affect subsequent educational careers? This…

U.S. elementary schools administer reading screeners to identify students in need of remedial instruction. However, the administration of additional assessments comes with a cost. It is unclear the extent to which multiple types of reading screeners warrant the increase in resources that could be used for instruction. This study compared…

To estimate the long-term effects of the Reading Recovery® intervention, a regression discontinuity design (RD) was implemented in a randomly selected sample of Reading Recovery schools during each year of the federally-funded i3 Scale-Up external evaluation (2011-2015) and also in one additional cohort during the 2016-2017 school year. Long-term…

Historically, there has been concern about students losing reading ability over extended breaks from school, commonly in the summer, but studies of this phenomenon have produced inconsistent results. We applied exploratory visual analysis of multiple datasets to examine whether students in Grades K-5 appear to lose or improve in various reading…

Background: Early-grade reading proficiency is well documented as in important factor for later academic success. Researchers and educators consider the achievement of reading proficiency by the end of grade three to be crucial to future academic success and financial independence (Hein et al., 2013; La Paro & Pianta, 2000; Singh, 2013). As…

Children's math performance is strongly correlated with later life outcomes, but early gaps in math skills are stubbornly difficult to close. It is therefore important to identify student math needs early. Using Grade 1-3 student records from Kentucky public schools, the study finds that typically recommended cut scores for widely used early grade…

This report describes a calibration, scoring, and reporting method applicable to an assessment requiring aggregation at multiple levels. We demonstrate the method using an example of an assessment that targets a small and diverse population, an English language proficiency assessment for English learners with the most significant cognitive…

We report the results of a convergent validity study examining the externalizing subscale (SRSS-E5, five items) of the adapted Student Risk Screening Scale for Internalizing and Externalizing (SRSS-IE 9) with the externalizing subscale of the Teacher Report Form (TRF) with two samples of K-12 students. Results of logistic regression and receiver…

Multiple popular math curriculum-based measures have recently been revised in ways that may improve their utility for universal screening. However, the applied use of these tools has yet to be evaluated independently. We conducted a retrospective analysis of the diagnostic accuracy of prior year statewide test results and aimswebPlus math…

The study reported on here contributes to the growing body of knowledge on the use of standard setting methods for improving the reporting and utility value of assessment results in South Africa as well as for addressing the conceptual shortcomings of the Curriculum and Assessment Policy Statement (CAPS) reporting framework. Using data from the…

This study aims to demonstrate the optimal way to determine the cut-off score to be used to interpret the total scores obtained from an achievement test or scale using the Artificial Neural Networks method. To this end, the multiple-choice item responses in the Booklet-11 Mathematics subtest at the 8th grade level in the TIMSS 2015 Turkey sample…

To estimate the long-term effects of the Reading Recovery® intervention, a regression discontinuity design (RD) was implemented in a randomly selected sample of Reading Recovery schools during each year of the federally-funded i3 Scale-Up external evaluation (2011-2015) and also in one additional cohort during the 2016-17 school year. Long-term…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

In 2006-2007, California revised its English language proficiency (ELP) assessment, the California English Language Development Test (CELDT), which resulted in more stringent criteria and higher cut scores for meeting proficiency. Using regression discontinuity designs and a difference-in-differences approach, this study examines the effects of…