Evaluators report effects of education initiatives as standardized effect sizes, a scale that has merits but obscures interpretation of the effects' practical importance. Consequently, educators and policymakers seek more readily interpretable translations of evaluation results. One popular metric is the number of years of learning necessary to…

This publication provides a quality framework to provide a structure for external review of Modern Apprenticeship off-the-job training.? The indicators in this framework are arranged under three key principles, addressing five questions which Education Scotland is adopting for evaluation purposes. These are underpinned by a wider principle on the…

A sample of educational evaluators was asked to design an outcomes-focused evaluation of a school program that aims to improve the academic achievement and self-esteem of students. Evaluators provided detailed descriptions of their evaluation design and methodology in their responses. These descriptions were coded and analyzed to determine the…

Multilevel modeling techniques facilitated examination of relationships between fidelity indicators and outcomes associated with a summer literacy intervention. Three-level growth models were specified to capture the extent to which students experienced instruction and to demonstrate the ways in which dosage-response relationships manifest in…

The purpose of this Guide is to provide education officials, program providers, and others seeking to sponsor a rigorous program evaluation with practical advice on finding a capable evaluator. More specifically, this Guide offers practical advice on finding an evaluator to conduct a rigorous evaluation to measure the effect of an educational…

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

The purpose of this guide is to provide clear, practical advice on reporting the results of an evaluation of an educational program or practice ("intervention"). Specifically, this is a guide for researchers, and those who sponsor and use research, to reporting the results of "impact" studies--that is, studies that evaluate the…

Evaluation techniques and practices do not belong to a particular theory of justice. Systems analysis evaluation consists of defining quantitative outcome measures of program success and the establishment of causal links between this measure and the program by experimental design. (JN)

Argues that the design of current alcohol and drug education programs precludes their having a substantial impact on adolescent alcohol or drug use. Suggests that evaluators consider only limited aspects of these programs which leads to narrow definition of success and restricts input into program development and modification. (LLL)

A workshop designed to assist local staff developers with the evaluation of their staff development programs is described. The intent of the workshop is to provide specific technical assistance for implementing a planned and consistent evaluation process. The workshop's goal is to allow a nonspecialist in evaluation to gather data necessary for…

Effects of training teacher evaluators and outcomes and quality of teacher evaluation were studied in Iowa for 619 elementary school and secondary school teachers. Findings relating to training effects are encouraging, and findings relating to teacher and evaluator attributes and the evaluation process provide direction for improving teacher…

The purpose of this Guide is to provide Mathematics and Science Partnership (MSP) project officials and evaluators with clear, practical advice on how to conduct rigorous evaluations of MSP projects at low cost. Specifically, this is a how-to Guide designed to enable MSP grantees and evaluators of MSP projects to answer questions about the…