This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

Third in a series, the monograph summarizes the key evaluation issues, design approaches, and statistical techniques used in conducting the 1980-1983 impact evaluation of Indian Education Act Title IV Part A programs. The monograph describes the major problems in evaluating the program to determine the degree of its positive contribution to…

This paper examines how controlling statistically for baseline covariates (especially pretests) improves the precision of studies that randomize schools to measure the impacts of educational interventions on student achievement. Part I of the paper introduces the concepts, issues, and options involved. Parts II and III present empirical findings…

Utilizing the regression-discontinuity research design, this article explores the effectiveness of a developmental English program in a large, multicampus community college. Routinely collected data were extracted from existing records of a cohort of first-time college students followed for approximately 6 years (N = 1,473). Results are consistent…

At the request of a Senate subcommittee, this report describes the value of conducting impact evaluations, describes their current use in evaluating selected early childhood education and care programs, and discusses the value of other types of early childhood education and care studies currently promoted and sponsored by the Departments of Health…

This book explores the challenges of implementing and assessing educational interventions in varied classroom contexts. Included are reflections on the challenges of designing studies for improving the instructional core of schools, guidelines for establishing evidence of interventions' impacts across a wide range of settings, and an assessment of…

Chapter 2 of the Education Consolidation and Improvement Act places responsibility for the design and implementation of programs using Chapter 2 funds in the hands of local education agencies, and it assigns responsibility for administering the regulations to state education agencies. No formal mechanism exists, however, for coordinating the…

Information is presented on an evaluation design for a federal program, the Podiatric Medicine Training Grant Program. The program supports the clinical training of third- and fourth-year podiatric medical students in underserved areas. Background information is provided on: the supply and distribution of health professionals and podiatrists in…

This handbook has been prepared to address one specific problem: How can the techniques of program evaluation be effectively applied to produce useful information about the operations and impact of moral education programs in secondary schools? The handbook is divided into five chapters. The introductory chapter describes the background and…

Along with the rapid expansion over the past decade of Head Start, a program providing comprehensive early childhood development services to low-income children, their families, and their communities, has come the demand for rigorous research to demonstrate program effectiveness. This report describes the proposed design of a national study of the…

This paper describes the national, state, and local contexts in which California (CA) is implementing School-to-Career (STC). Section I presents an historical view of School-to-Work (STW), describing national goals of the STW Opportunities Act 1994 (STWOA), and also discusses CA's STC efforts. Section II provides contextual information about STW…