Summarizes and analyzes the four case studies of this theme issue. The analyses consider the three structural elements of evaluation capacity building (ECB): overall ECB process; actual ECB practices; and ECB occupational orientation and practitioner role. Provides a practical checklist for assessing ECB at an organization and a framework for…

Discusses postmodernism as a complicated concept. The postmodern challenge to social science, particularly to program evaluation, and its contribution to evaluation are the subjects of vignettes from practice and a limited exploration, one that borrows from a playfully absurdist postmodern style. (Author/SLD)

Reviews a collection of 10 case descriptions of ethical problems in evaluation and 10 commentaries on them that appeared in the "American Journal of Evaluation" from 1998 to 2001. Explores the meaning of "ethical problems" and the relationship of ethics to best practices. (SLD)

A mentoring evaluation method that is both a learning tool and a measurement tool involves (1) assessing performance in the roles of communicator, counselor, coach, advisor, broker, referral agent, and advocate; and (2) evaluating on a continuum the impact of mentoring discussions. (JOW)

After a brief review of previous studies of justifying claims in evaluation practice, an analysis is provided using the jurisprudence metaphor of S. Toulmin (1958) in the assessment of evaluative arguments. Applications and implications for evaluation practice are discussed. (SLD)

Describes the tasks undertaken in the cycle of evaluation of housing programs by the Canada Mortgage and Housing Corporation prior to 1997 and analyzes the major evaluation projects in terms of the similarity of constituent tasks. Introduces combinatorial methods and new research applications. (SLD)

Examined six published papers using a theory-based evaluation (TBE) approach. Found that authors of the papers did not always make explicit the relation of their data to the theory of the program. Identified some ways in which TBE contributed to the merit of the evaluation. Outlines lessons for the future of TBE. (SLD)

Provides strategies for constructing theories of theory-based evaluation and provides examples in the field of public health. Techniques are designed to systematize and bring objectivity to the process of theory construction. Also introduces a framework of program theory. (SLD)

Considers what a responsible test developer would do to gain information to support the consequential basis of validity for a test early in the development. How the consequential basis of validity of the program would be monitored and reported during the life of the program is examined. The validity of the ACT Assessment is considered as if it…

Describes efforts to build a worldwide evaluation community, noting events that resulted in an almost 200% growth in the number of regional and national evaluation organizations in slightly more than 1 year. Profiles some national and regional evaluation organizations that participated in a recent evaluation meeting and suggests some alternative…

Provides a basic formula for calculating the return-on-investment of training: (1) collect evaluation data; (2) isolate effects of training from other factors; (3) convert results to monetary benefits; (4) total costs of training; and (5) compare the benefits with the cost. (JOW)

Explores the relative strengths and weaknesses of program theory as a tool for inferring causality and outlines a five-stage approach that makes increased use of inductively built program theories as it takes more deliberate account of the varying levels of certainty that are required for evaluative conclusions. (Author/SLD)

Even simple program theory evaluations could be used in meta-analysis to provide benefits. Explores several ways to combine program theory evaluation and meta-analysis, using a hypothetical model and an actual example from a federal funding program. Outlines four potential benefits to incorporating program theory evaluation into meta-analysis.…

Describe the role of an expert panel in setting priorities for evaluative work. An expert panel with high credibility inside and outside the organization that is at arms length to both the organization and external stakeholders can bypass many communications filters and provide a distilled and clear reading of stakeholder concerns. (SLD)

Presents a conceptual framework for putting program theory into operation. The framework incorporates variables that reflect theoretical concepts and implementation issues addressed in program evaluation. It organizes variables into input, process, and output categories. Discusses implications for program evaluation. (SLD)