In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…

More evaluators have anchored their work in equity-focused, culturally responsive, and social justice ideals. Although we have a sense of approaches that guide evaluators as to how they should attend to culture, diversity, equity, and inclusion (DEI), we have not yet established an empirical understanding of how evaluators measure DEI. In this…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

There is a growing recognition of the value of measuring fidelity of implementation (FOI) as a necessary part of evaluating interventions. However, evaluators do not have a shared conceptual understanding of what FOI is and how to measure it. Thus, the creation of FOI measures is typically a secondary focus and based on specific contexts and…

Methodological rigor consists of a series of elements that, in combination, determine the confidence with which conclusions can be drawn from the evaluation results. These elements include evaluation design, conceptualization of constructs, measurement strategies, time frames, program integrity, and others. The authors examine the factors that…

In this article, the authors examine evaluation process use in a large multilevel, multisite core evaluation. This case highlights the nature of the evaluation processes of the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation in terms of four categories: (1) social processing; (2) engagement; (3) involvement; and (4)…

This California Evaluation Improvement Project (EIP) Program Evaluation workbook has two purposes. It can be used as a learning and instructional aid while one masters the procedures, techniques, and methods of program evaluation. Used this way, it helps the practitioner summarize and put into practice the subject matter presented in the EIP…

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…

Program theory and implementation process theory contribute, respectively, to specifying the what and the why of program delivery. This article discusses the relationship between these two theories and the types of data collection methods that can be derived from each in order to contribute to more comprehensive evaluation designs. (JAZ)

In reacting to five recent books on program evaluation, eight evaluation perils are discussed: poor preparation of evaluations, programs with unrealistic goals, the mix-up of models, interpersonal conflicts, the morass of measurement, answering evaluation questions, the secondary evaluator as sniper, and hostility from program staff. (CM)

The experiences of a group of evaluators evaluating a multisite integrated human service delivery system illustrate many design and measurement considerations in the preimplementation and implementation phases of evaluation. The reemergence of human service integration approaches will make such evaluation issues increasingly common. (SLD)

A conceptual framework and practical approach are presented focusing on the possibility of making an evaluation of tertiary educational institutions by means of different levels, categories, and criteria of analysis. The paper is a preliminary reference design of evaluation whose theoretical approach is summarized with a more extensive…

The Research on Evaluation Program's National Advisory Panel recommended that a means of matching evaluation methods with evaluation purposes be developed and that it include a guide to major Program publications. Practitioners in the field have also requested support on how to approach the evaluation design process to permit the incorporation of…

The Regional Seminar on Educational Evaluation held in Dar es Salaam, Tanzania, from 7 April to 2 May 1975, was organized as a follow-up activity to a study carried out by the International Institute for Educational Planning (IIEP, Paris) in 1973-1974. The International Bank for Reconstruction and Development had in 1973 requested the IIEP to…

This document, product of a review of eighty-one final performance and evaluation reports of elementary and secondary career education projects to identify needed improvements in career education program evaluation, has four parts. Part I, a critique of common evaluation practices, covers overall evaluation designs, reporting, questionnaires and…