Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

U.S. public schools are engaged in an unprecedented effort to expand tutoring in the wake of the COVID-19 pandemic. Broad-based support for scaling tutoring emerged, in part, because of the large effects on student achievement found in prior meta-analyses. We conduct an expanded meta-analysis of 265 randomized controlled trials and explore how…

Higher education has made impressive progress concerning student learning outcomes assessment practices. Yet--despite the assumption that better assessment would lead to better student learning--few examples of demonstrable student learning improvement exist at the academic degree or university levels. In 2014 Fulcher, Good, Coleman, and Smith…

The basic components of apprenticeships are the same today as in 1937, when the National Apprenticeship Act set the foundation for apprenticeships in the United States. Apprentices enter into a structured training program of classroom and paid on-the-job training under the guidance of a mentor. As their skills increase, so do their wages. Upon…

Universities throughout the world are trending toward more performance based methods to capture their strengths, weaknesses and productivity. Hiroshima University has developed an integrated objective measure for quantifying multifaceted faculty activities, namely the "Achievement-Motivated Key Performance Indicator" (A-KPI), in order to…

The Evidence-based Literacy Support-"Literacy Octopus" Trial tested a range of dissemination interventions and resources, all of which aimed to engage schools in using evidence-based materials to improve teaching and learning in Key Stage 2 literacy. Four delivery partners provided interventions. These included light-touch,…

Many leadership development programs are intended to improve individual leaders' skills and abilities to perform. Methods for measuring the effect of such programs range from simple metacognitive self-report surveys to 360-degree feedback, to instrumentation of psychological phenomena. However, the outcomes of some leadership development programs…

This study investigated whether active learning within computer-based training courses can be measured and whether it serves as a predictor of learner-perceived course quality. A major corporation participated in this research, providing access to internal employee training courses, training representatives, and historical course evaluation data.…

In this paper we consider the challenges involved in evaluating teacher preparation programs when controlling for school contextual bias. Including school fixed effects in the achievement models used to estimate preparation program effects controls for school environment by relying on differences among student outcomes within the same schools to…

Teachers tasked with developing moral character in future physicians face an array of pedagogic challenges, among them identifying tools to measure progress in instilling the requisite skill set. One validated instrument for assessing moral judgment is the Defining Issues Test (DIT-2). Based on the work of Lawrence Kohlberg, the test's main…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

This is the final report of the National Evaluation of Student Support Services (SSS). SSS is one of eight federally funded grant programs that are administered as part of the Federal TRIO Programs within the U.S. Department of Education (ED). The SSS program, in particular, focuses on students while they are enrolled in college. In general, SSS…

This study attempts to clarify some of the issues involved in defining the effectiveness of compensatory education programs. It discusses the extent to which conclusions about the effectiveness of compensatory education programs are affected by two major components of an evaluation: the period of time on which the evaluation is based and the…

The estimation of the "size of effect" of educational programs is a difficult problem in program evaluation. It is argued that the intentions of the program and the nature of the measures must be known in order to estimate program effects. (JKS)

The "Scope and Standards of Professional School Nursing Practice" states that school nurses should evaluate the quality and effectiveness of their practice. School nurses have not yet identified and adopted outcomes by which this effectiveness can be measured. This study used focus groups during a national meeting of school nurse leaders to…