Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

Seven empirical studies from this special issue and an overview chapter are reviewed to illustrate several points about studying the possible effects of treatment intensity manipulations on generalized skill or knowledge acquisition in students with disabilities. First, we make a case in favor of studying intensity as separate from complexity and…

Interventions based on the results of functional behavioral assessment (FBA) have been the topic of extensive research and, in certain cases, mandated for students with disabilities under the Individuals With Disabilities Education Act. There exist a wide variety of methods for conducting such assessments, with little consensus in the field. The…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

The research synthesis presented here reviewed the currently available evidence on the effectiveness of sibling-implemented interventions for their siblings with disabilities. The search for appropriate research literature spanned from 1975 to 2008 and resulted in a total of eight studies that met the inclusion criteria. All eight studies in this…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

This article provides practical guidance for researchers who are designing studies that randomize groups to measure the impacts of educational interventions. The article (a) provides new empirical information about the values of parameters that influence the precision of impact estimates (intraclass correlations and R[superscript 2] values) and…

Evaluative statements from alumni have legitimacy with both internal and external stakeholders. Thus, alumni studies can provide valuable evidence of institutional effectiveness and lend themselves to both locally designed and commercial survey instruments for data collection. Under ideal conditions, the results of alumni studies equip faculty and…

Strength and integrity issues are central to planning and interpreting evaluation studies. In the absence of actual data from previous studies, estimates of strength and integrity can often be derived in other ways. These issues of strength and integrity are described in the context of resource allocation in evaluation research. (Author/BS)

The desirability of combining tests of theory with evaluations of treatment modalities is argued in an investigation of the effectiveness of a juvenile diversion program. Using a true experimental design (with randomization), recidivism analyses dependent on court record data failed to demonstrate the relative superiority of any of three treatment…

Problems when developing and operating a successful student assessment program are described. Potential problems and solutions in three major areas are examined: the purposes and definitions of assessment, program implementation, and assessment designs and methods. (Author/MLW)

This study describes a method for providing easily understood information on the comparative instructional program effects of using multiple instructional products. The method was derived in the context of a national evaluation of three instructional product systems each of which was used to teach readiness and initial reading skills to…

The Plattsburgh French Language Immersion Program (FLIP) is designed to enrich the education of majority-group children. In discussing evaluation methodology for FLIP, the general problems of evaluating a program are discussed, as well as reactions to details of the design developed by the research group for FLIP. Evaluation is distinguished from…

Along with the rapid expansion over the past decade of Head Start, a program providing comprehensive early childhood development services to low-income children, their families, and their communities, has come the demand for rigorous research to demonstrate program effectiveness. This report describes the proposed design of a national study of the…

This paper concerns a national evaluation study of the Upward Bound (UB) Program conducted for the U.S. Office of Education by the Research Triangle Institute. It describes the practical constraints imposed on the study design and the features of the design that were shaped by these constraints. The design features include the quasi-experimental…