This paper develops a novel approach called Outcome Trajectory Evaluation (OTE) in response to the long-causal-chain problem confronting the evaluation of research for development (R4D) projects. OTE strives to tackle four issues resulting from the common practice of evaluating R4D projects based on theory of change developed at the start. The…

Evaluating teachers' professional development initiatives (PDI) is one of the main challenges for the teacher professionalisation field. Although different studies have focused on the effectiveness of PDI, the obtained effects and evaluative methods have been found to be widely divergent. By means of a narrative review, this study provides an…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). This SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Proposes a method for synthesizing findings within mixed-method program evaluations. The proposed method uses a set of criteria and analytic techniques to assess the worth of each data source or type and to establish what each says about program effect. Once data are on a common scale, simple mathematics allows synthesis across data sources or…

Used findings from the evaluations of California's Greater Avenues for Independence program and the National Evaluation of Welfare-to-Work Strategies to illustrate why it is important to question the legitimacy of such syntheses. Results show how tempting generalizations are not justified. (SLD)

This objection to M. Scriven's claim that the basic logic of evaluation is criterial and standards-based notes that valuing is an integral part of perception. Disciplining the synthesis process through critiques of interpretations and values and by using competing conceptual organizers is discussed. (SLD)

The viewpoints of contributors to the forum are reviewed. Many of the disagreements represent fundamental differences in what constitutes evaluation. All four authors agree that the formative/summative distinction is useful and will continue to be an important concept in program evaluation, although the distinction needs greater clarification.…

Case examples in the articles in this volume are analyzed in the mixed-method conceptual frameworks presented in the early chapters. The richer understanding derived from these approaches support the call to advance mixed-method inquiry beyond models and toward inquiry attributes that can be combined. (Author/SLD)

Background/Context: Although the importance of facilitating transfer from community colleges to 4-year institutions is almost universally accepted, there is little consensus on how to measure transfer success or evaluate policies aimed at assisting students in making this educational transition. Despite the increasing attention on transfer in…

Provides a synthesis of the literature pertaining to the principles and practices of performance measurement, auditing, evaluation, and reporting. Discusses how bringing these elements together in a performance management system can be achieved through refinement of strategic direction, reporting on key measures, and periodic, systematic…

There are numerous micro-level methods decisions associated with planning an impact evaluation. Quantitative synthesis methods can be used to construct an actuarial data base for establishing the likelihood of achieving desired sample sizes, statistical power, and measurement characteristics. (Author/BS)

This paper gives a brief overview of how qualitative and quantitative interviews can be combined to get a fuller picture of a program and its outcomes. This concept is illustrated through a discussion of evaluations of the Employment Intervention Demonstration Program, a multi-site research demonstration project funded by the Substance Abuse…

A holistic approach to evaluating an adult education and training program or service was proposed that is based on consideration of the following: ethics, objectives, stakeholders, coverage, effects, and costs. According to the proposed approach, the following are among the design features of multimedia instruction to be considered before an…