Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

This appendix augments a report that updates 2013 guidance to school district leaders and their partners across the country who are interested in launching summer learning programs or improving established ones. In that report, the authors present recommendations based on evaluations, conducted between 2011 and 2016, of summer programs in five…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

Background/Context: Teacher preparation programs (TPPs) face increasing pressure from the federal government, states, and accreditation agencies to improve the quality of their practices and graduates, yet they often do not possess enough data to make evidence-based reforms. Purpose/Objective: This manuscript has four objectives: (a) to present…

In this study, our aim was to understand how environmental education has been implemented in Israeli elementary schools. We selected ten schools that had implemented Education for Sustainability programs and analyzed their mission statements and curriculum documents. We observed each school's activities and interviewed teachers. Our analysis shows…

This study evaluated the effectiveness of a family-centered feeding intervention, Easing Anxiety Together with Understanding and Perseverance (EAT-UP™), for promoting food acceptance of children with autism spectrum disorder at home. A concurrent multiple-baseline design was used with systematic replication across three families. Baseline was…

Museums often evaluate various aspects of their audiences' experiences, be it what they learn from a program or how they react to an exhibition. Each museum program or exhibition has its own set of goals, which can drive what an evaluator studies and how an evaluation evolves. When designing an evaluation, data collection methods are purposefully…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

Growing evidence shows that participation in out-of-school time (OST) activities positively supports youth development in general. However, simply participating in a self-identified STEM program is not sufficient. Youth will benefit more if they participate in "quality" afterschool programs. Therefore, a common understanding of quality…

Out-of-school time (OST) youth programs are inherently difficult to assess. They are often very dynamic: Many youth interact with one another and with staff members in various physical environments. Despite the challenge, measuring quality is critical to help program directors and policy makers identify where to improve and how to support those…

This master data collection protocol describes the data that Mathematica collected for the Race to the Top-Early Learning Challenge Study of Tiered Quality Rating and Improvement Systems. This study was conducted for the Department of Education's Institute of Education Sciences. The data were collected from reviews of applications, documents, and…

Journey to College and Career (JTCC) is a PreK-12 program implemented at the research site to help students graduate from high school and plan for their future. JTCC had not been evaluated for its effectiveness at the research site regarding high school retention by determining (a) whether the goals and objectives of JTCC were being met and (b)…

The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…

Educational paradigm shifts call for 21st century learners to possess the knowledge, skills, abilities, values, and experiences associated with multiple forms of literacy in a participatory learning culture. Contemporary educational systems are slow to adapt. Outside of school, people have to be self-motivated and have access to resources in order…

Background: This article reports on an evaluation study of a project seeking to develop the use of position-linked datalogging with primary pupils in environmental science contexts. Purpose: The study sought to find out the extent to which the project had developed: (1) participant teachers' confidence in using datalogging as an everyday part of…