A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

The set of appendices in this volume is a companion to the report "Federal Efforts Towards Investing in Innovation in Education Through the i3 Fund: A Summary of Grantmaking and Evidence-Building." The goal of the U.S. Department of Education's Investing in Innovation Fund (i3) was to build high-quality evidence about effective…

Head Start is a national program that helps young children from families with low incomes prepare to succeed in school. It does this by working to promote children's early learning and health and their families' well-being. In 2021, the Office of Planning, Research, and Evaluation in the Administration for Children and Families, U.S. Department of…

In experimental evaluations of health and social programs, the role of dosage is rarely explored because researchers cannot usually randomize individuals to experience varying dosage levels. Instead, such evaluations reveal the average effects of exposure to an intervention, although program exposure may vary widely. This article compares three…

Funded grant projects all involve some form of evaluation, and Advanced Technological Education (ATE) grants are no exception. Program evaluation serves as a critical component not only for evaluating if a project has met its intended and desired outcomes, but the evaluation process is also a central feature of the grant application itself.…

Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…

The Head Start Act mandates that each Head Start recipient receive a monitoring review at least once every 3 years; each newly designated recipient be reviewed after the completion of its first year (and then at least once every 3 years thereafter); and all recipients that "fail to meet the standards" receive Follow-up reviews. Reviewers…

The Head Start Act mandates that each Head Start grantee receive a monitoring review at least once every 3 years; each newly designated grantee be reviewed after the completion of its first year (and then at least once every 3 years thereafter); and all grantees that "fail to meet the standards" receive Follow-up reviews. Reviewers…

The Head Start Act mandates that each Head Start grantee receive a monitoring review at least once every 3 years; each newly designated grantee be reviewed after the completion of its first year (and then at least once every 3 years thereafter); and all grantees that "fail to meet the standards" receive Follow-up reviews. Reviewers…

This report presents a summary of the findings of fiscal year (FY) 2018 Head Start monitoring reviews, fulfilling the reporting requirement in Section 641A(f) of the Head Start Act. It highlights the enhancements made to the FY 2018 monitoring review system, summarizes grantee review outcomes, and describes the types of findings most commonly…

For over a decade, the National Science Foundation's Innovative Technology Experiences for Students and Teachers (ITEST) program has funded researchers and educators to build an understanding of best practices, contexts, and processes contributing to K-12 students' motivation and participation in Science, Technology, Engineering, and Mathematics…

Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

In 1998, President Clinton signed the federal Workforce Investment Act (WIA). Implemented in 2000, WIA replaced the Job Partnership Training Act (JTPA) as the primary federal job training program. Congress viewed WIA as a way to end "business as usual" in the workforce investment system. WIA aimed to transform the employment and training…

The Race to the Top Assessment program was authorized as part of the American Recovery and Reinvestment Act of 2009 (ARRA). In September 2010, the U.S. Department of Education (Department) awarded competitive, four-year grants to two consortia of states, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…