ERIC Number: ED661550
Record Type: Non-Journal
Publication Date: 2024-Oct
Pages: 88
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
What Impacts Should We Expect from Tutoring at Scale? Exploring Meta-Analytic Generalizability. EdWorkingPaper No. 24-1031
Matthew A. Kraft; Beth E. Schueler; Grace Falken
Annenberg Institute for School Reform at Brown University
U.S. public schools are engaged in an unprecedented effort to expand tutoring in the wake of the COVID-19 pandemic. Broad-based support for scaling tutoring emerged, in part, because of the large effects on student achievement found in prior meta-analyses. We conduct an expanded meta-analysis of 265 randomized controlled trials and explore how estimates change when we better align our sample with a policy-relevant target of inference: large-scale tutoring programs in the U.S. aiming to improve standardized test performance. Pooled effect sizes from studies with stronger target-equivalence remain meaningful but are only a third to a half as large as those from our full sample. This result is driven by stark declines in pooled effect sizes as program scale increases. We explore four hypotheses for this pattern and document how a bundled package of recommended design features serves to partially inoculate programs from these attenuated effects at scale.
Descriptors: Standardized Tests, Tutoring, COVID-19, Pandemics, Instructional Effectiveness, Program Implementation, Program Effectiveness, Mathematics Tests, Reading Tests, Elementary School Students, Secondary School Students, Measurement Objectives
Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: AISR_Info@brown.edu; Web site: http://www.annenberginstitute.org
Publication Type: Information Analyses; Reports - Research
Education Level: Elementary Education; Secondary Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF); William T. Grant Foundation
Authoring Institution: Annenberg Institute for School Reform at Brown University
Grant or Contract Numbers: N/A
Author Affiliations: N/A