Based on experiences in conducting program evaluations for the Canadian Federal Government, an evaluator addresses reconciliation of the information needs of managers and accountability. External and internal accountability are covered. Using the perspectives of both line managers and senior managers, means of resolving pertinent issues are…

The evaluation of second language programs is an educational task with profound potential for improving pedagogical practice. Evaluators who educate perform more than just a "service" function by helping people to learn, develop themselves, and refine their abilities to work more effectively. (CB)

Based on a review of research on evaluation use, the implications for future research and for improving the practice of evaluation are discussed. Six principles of evaluation use are outlined, and internalization of evaluation functions by decision makers is addressed. (TJH)

This theme issue discusses the misuse of evaluation. The eight articles all discuss instances in which the evaluation process or evaluation findings were misused. Misuse is usually not the result of methodological issues but rather is an issue of human relations and sometimes of political pressure. (SLD)

This article explores the effect of raters' background on assessments made in an occupation-specific oral language test, the Japanese Language Test for Tour Guides. Assessments of 51 test candidates made by 33 assessors were compared in order to determine what effect background has on assessments made on both linguistic and "real-world"…

A participatory model in evaluation is presented as an extension of the stakeholder-based model focusing on the increased participation of primary users. Twenty-six empirical studies that support an organizational learning justification of the model are reviewed and classified. Requirements for participatory evaluation are discussed. (SLD)

A theoretical model is proposed for confidence in knowledge based on the assumption that people are good judges of the reliability of their knowledge, provided that the knowledge is representatively sampled from a specified reference class as defined by E. Brunswik (1943). Experiments with 177 college students support the theory. (SLD)

The reliability of visual inspection in single-case research was investigated by determining agreement among 5 judges visually inspecting 44 graphs depicting behavior from baseline to intervention. Agreement between visual inspection and statistical procedures was determined. Implications for single-case research are discussed. (SLD)

Explores the role of theory in strengthening causal interpretations in nonexperimental research. Evaluators must conduct theory-driven research, concentrating on "small theory," in that the focus is on the explanation of processes specific to the program being evaluated. Theory-guided treatment research must be programmatic and…

Describes two evaluation studies that faced ethical problems because of an atmosphere of promotion and advocacy. One was the evaluation of a teachers' professional-development program, and the other was an evaluation of a federally funded youth sports program. The realization and resolution of ethical conduct must come from within the evaluator.…

Discusses the challenges faced by evaluators in moving from results-focused evaluation to learning-oriented evaluative theory in the context of school-university partnerships with professional learning agendas. Also discussed are the influences of the transition on individual practitioners and their organizations. (Author/SLD)

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

Discusses the importance of understanding the presenting problem of a stepfamily seeking counseling. Notes that proper assessment includes an understanding of family structure and context, parent- and stepparent-child relationships, and nonresidential parent-child relationships. Includes case study and the use of genograms to depict complex…

Schools are currently receiving increased funds for multimedia software for classrooms. There is a need for good software in the schools, and there is a need to know how to evaluate software and not naively rely on advertisements. Evaluators of multimedia software for education must have the skills to critically evaluate and make decisions not…

This paper provides the results of a literature review on the use of practical, hands-on training experiences in evaluation course work and training programs. The review spans the years 1965-2003. I identified 18 articles that encompass four basic approaches for practical evaluation training: simulation, role-play, single course projects, and…