Suppose an education researcher wants to test the impact of a high school drop-out prevention intervention in which at-risk students attend classes to receive intensive summer school instruction. The district will allow the researcher to randomly assign students to the treatment classes or to the control group. Half of the students (the treatment…

Programs that address the needs of low-income parents and children at the same time may hold promise for reducing the transmission of poverty across generations. Contemporary programs of this type address some key weaknesses that may have limited the effectiveness of earlier such approaches, including too little attention paid to the quality,…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

Selection bias is problematic when evaluating the effects of postsecondary interventions on college students, and can lead to biased estimates of program effects. While instrumental variables can be used to account for endogeneity due to self-selection, current practice requires that all five assumptions of instrumental variables be met in order…

Purpose: Despite years of advice from researchers that trainee reactions provide training evaluation information that is of very limited use, trainee reactions remain the most commonly used measure of training effectiveness. Because the technology that supports online training facilitates the collection of trainee reaction information during and…

Supplemental Educational Services (SES), a component of the No Child Left Behind (NCLB) Act, provides free tutoring to economically disadvantaged children who are attending Title I schools in their 2nd or more years of school improvement. This research evaluated SES in Tennessee to determine the: (a) impacts on student achievement, and (b)…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

Brief case studies of three projects are presented to illustrate the steps which open "Wonderful Programs" to evaluation research. The evaluator is provided with the perspective needed to believe the evaluation is worth doing. The project staff is then redirected to the need for a new type of evidence. An ongoing review of the commitment…

The dissemination of successful educational innovations has long been a strongly supported policy in educational settings. Recent research developments have led to a debate as to the appropriateness of a centralized versus decentralized dissemination policy. The current research provided a test of the modified Research, Development and Diffusion…

This paper examines a prolonged speech treatment model for stuttering, the Camperdown Program. Sixteen participants showed minimal or no stuttering in everyday speaking situations for up to 12 months after entering the program's maintenance phase, with speech rates in the normal range. Results were achieved in a mean of 20 hours of clinic…

An attempt was made to test the assumption that a wide variety of institutions and agencies have the fiscal and managerial capability to house a programmatic research and development effort for education. To this end, interviews were conducted with the staff director or principal investigator of four Follow Through programs affiliated with member…

This report is an attempt to conceptualize a comprehensive framework for evaluating vocational education quality. It is intended to inform policymakers of the breadth of the elements of quality and to suggest an integrated framework for assessing quality to vocational education evaluation theoreticians. Chapter 1 offers preliminary considerations.…

This paper delineates the purposes of a symposium that was based on a major study of the California School Improvement Program (SIP). The problem of increasing the capacity of schools to implement reform efforts is conceptualized. To explore this issue, a conceptual framework was developed, based on the case study and survey data from the first…

Written for local, State, and Federal vocational educators, this publication discusses the feasibility of implementing recommendations from some recent evaluations of educational excellence. Criteria for estimating the appropriateness of evaluation findings are given, and recommendations are offered for creating an infrastructure among local,…