A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…

Upward Bound (UB) was one of the original federal "Great Society" programs of the 1960s and remains, fifty years later, the single largest college access program in the country. Recently, Congress has reduced funding and considered eliminating the program because of federal budget pressures and because the first analysis of the only…

Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

Researchers have become increasingly interested in programs' main and interaction effects of two variables (A and B, e.g., two treatment variables or one treatment variable and one moderator) on outcomes. A challenge for estimating main and interaction effects is to eliminate selection bias across A-by-B groups. I introduce Rubin's causal model to…

The Race to the Top Assessment program was authorized as part of the American Recovery and Reinvestment Act of 2009 (ARRA). In September 2010, the U.S. Department of Education (Department) awarded competitive, four-year grants to two consortia of states, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…

The last major review of the achievement outcomes of comprehensive school reform (CSR) models was conducted in 2003. Despite the growing evidence base supporting CSR, the program was discontinued by the federal government in 2007. Now, six years after the 2003 meta-analysis, the study's lead author, Geoffrey Borman, revisits the results and…

This article reports on the results of a study undertaken by the U.S. Department of Education on the impact of the Reading First program, which offer little insight into which parts of the program are worth saving and which need revamping. The study found that the $6 billion spent on the program has helped students with basic decoding but not with…

Transformation of education into an evidence-based field is a task that will require involvement of federal and state policymakers, local education leaders, administrators, teachers, and parents. Over the past 6 years, a new direction has been set for education research. This report presents the National Board for Education Sciences' evaluation of…

Shows how evaluation design and federal involvement in Youth Employment Demonstration Projects unintentionally cause a negative appraisal. Indicates the problem stems from interaction of the contract research corporation, the educational research establishment, and the federal bureaucracy, rather than a specific methodology or bureaucratic…

THE PURPOSE OF THIS STUDY WAS TO DEVELOP A SERIES OF HYPOTHESES REGARDING THE LEADERSHIP AND SCHOOL CLIMATE CHARACTERISTICS THAT RELATE TO SUCCESSFUL IMPLEMENTATION OF PROJECTS FUNDED UNDER TITLE I OF THE ELEMENTARY AND SECONDARY EDUCATION ACT OF 1965. UTILIZING AN INFORMAL FIELD SURVEY TECHNIQUE, INVESTIGATORS STUDIED A TOTAL OF 78 TITLE I…

Notes that even with the problems identified in this paper, consistent, positive results are appearing in preliminary reports. Equally important, the data seem to support a number of reasonable notions about the impact of distinctive curricula on students. (Author/AM)

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…

Critiquing the stakeholder idea, the author states: if government chooses to take account of competing views in social program evaluation, it can get a better result if it encourages the competing views to find a voice of their own, not to speak through the government's chosen instrument. (Author/PN)