The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random…

Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…

Federal social programs are rarely evaluated to determine whether they are actually accomplishing their intended purposes. As part of its obligation to spend taxpayers' dollars wisely, Congress should mandate that experimental evaluations of every federal social program be conducted. The evaluations should be large-scale, multisite studies to…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

The Race to the Top Assessment program was authorized as part of the American Recovery and Reinvestment Act of 2009 (ARRA). In September 2010, the U.S. Department of Education (Department) awarded competitive, four-year grants to two consortia of states, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter…

This article examines the power analyses for the first wave of group-randomized trials funded by the Institute of Education Sciences. Specifically, it assesses the precision and technical accuracy of the studies. The authors identified the appropriate experimental design and estimated the minimum detectable standardized effect size (MDES) for each…

Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

Transformation of education into an evidence-based field is a task that will require involvement of federal and state policymakers, local education leaders, administrators, teachers, and parents. Over the past 6 years, a new direction has been set for education research. This report presents the National Board for Education Sciences' evaluation of…

Three different approaches to metaevaluation are described and shown to have been applied to the study of Project Follow Through. These approaches include evaluation of primary evaluations, integrative meta-analysis in which results from several primary evaluations are combined, and secondary analysis involving the independent reanalysis of the…

To inform reauthorizations of Title I, the federal government's largest program for elementary and secondary education, the Congress has required the Department of Education to conduct national assessments of Title I. Two of these studies have gathered Title I data over several years: the Prospects study, completed in 1997; and the ongoing…

This paper reviews the following studies on the cost-effectiveness of the Chapter 1 compensatory education program: (1) Sustaining Effects Study; (2) Tallmadge Study; (3) the Kiesling Study for Rand; (4) Instructional Dimensions Study; (5) Response to Educational Needs Project Cost-Effectiveness Study; (6) Educational Testing Service/Ragosta…

This hearing, which is the first of a series of hearings on the 1990 decennial census, focuses on automation activities, pretest preparations, and proposed residency rules. Gene L. Dodaro, associate director of the General Accounting Office, calls on the committee to use special purpose tests to adequately evaluate the following: (1) potential of…

This report describes the technical assistance rendered to the NIE-sponsored R&D Utilization Program (R&DU) by the contractor working with the NIE staff, the Center for the Study of Evaluation, and the seven R&DU projects, to develop cross-project instrumentation, develop mutually acceptable plans for data collection and analysis, and…

The Academic Libraries Survey (ALS) was established in 1966 to collect concise information on library resources, services, and expenditures for the entire population of academic libraries in the United States. The ALS is conducted every 2 years as a cooperative venture of the U.S. Department of Education and the Department of Commerce, Bureau of…

The five essays that compose this report criticize, from federal, state, and local perspectives, current methods of evaluating government-sponsored education programs. A major recurring theme is that experimental design methods, most commonly used by the Department of Education, do not provide adequate information for policy-makers' needs. The…