Methodological paradigms in evaluation research are discussed. This article is a response to the attacks on paradigmatic perspectives made by Reichardt and Cook in the opening chapter of their edited book, "Qualitative and Quantitative Methods in Evaluation Research." (Author/GK)

Program evaluation must be practiced by all members of all trades, disciplines, professions, or any other group of people whose efforts are aimed at making a difference. There is a role for "content free" evaluation methodology resources, but not for a professional "content free" evaluator. (RL)

Written in response to George Fairweather's position concerning the use of experimental studies in evaluation, this paper highlights considerations in deciding when experimental procedures are feasible. The current debate on the use of experimental methods in evaluation is reviewed. (Author/GK)

It is argued that outcome evaluation should include efforts to identify and measure unintended outcomes. A systems perspective is presented which treats governmental actions as disequilibrating intrusions into reacting systems. Both intended and unintended outcomes of such intrusions can be valued monetarily, in terms of human rights, or both.…

This paper points out issues to consider when applying the "Standards for Evaluation of Educational Programs, Projects and Materials in a different social context." Differences in the American and Israeli educational systems and perceptions of evaluation illustrate some limitations. Principles that do have general applicability are…

The ERS Standards, together with those of the Joint Committee, symbolize a commitment to the professionalization of evaluation. The two sets of standards differ on five points: (1) perceived linearity of evaluation activities; (2) preferred and permitted approaches; (3) purposes of evaluation; (4) obligations to clients and stakeholders; and (5)…

This article responds to the "Standards for Evaluation of Educational Programs, Projects and Materials" by addressing three issues in qualitative research: (1) data quality; (2) data verification; and (3) collusion between evaluators and their sponsors. To be of maximum international value, the standards report needs more emphasis on…

The lack of overriding rationale and theoretical anchors in "Standards for the Evaluation of Educational Programs, Projects and Materials" creates difficulties when adapting the standards to local situations. The limitations of the book's treatment of ethical considerations, evaluation, utilization, and research management procedures for…

This critique examines Tellado's account (TM 510 179) of his evaluation of a problem-solving program. The program was apparently successful but did not survive. By examining the program as an organizational change intervention, several problems are uncovered regarding its design, implementation, evaluation, and institutionalization. (Author/BW)

How some of the past literature creates the impression of an inevitable method-paradigm linkage and of a forced choice between qualitative and quantitative paradigms is shown. Difficulties of making method choices are considered. It is suggested that purposefully developed strengths of different methods should not be ignored. (Author/GK)

While technically accurate, the "Standards for Evaluation of Educational Programs, Projects and Materials" embodies unrealistic and untenable assumptions about policy, its implementation, its development, and the evaluator's role. Three educational evaluation studies in the United Kingdom and Pakistan are used to illustrate the author's…

The "Standards for Evaluation of Educational Programs, Projects and Materials" focuses on contextual influences at the individual research project level. Macro-level political and organizational factors can be preconditions for applying the standards at project level. A study of Dutch educational evaluation research is used to illustrate…

By demystifying traditional rational accounting perspectives, the work of Ginsberg (TM 508 964) offers a basis to develop notions of accountability in relation to meaningful work processes. (BW)

The role of documentation in the planning and control functions of project management is reviewed. The importance of documentation in the assessment of research quality with respect to objectivity, validity, and replicability is discussed. An outline of documentation required in different phases of research projects is provided. (Author/DWH)

Two main themes are found in the previous critiques (TM 510 180, TM 510 181, and TM 510 182) of the Tellado evaluation (TM 510 179): that Tellado lacked a clear audience for his evaluation and that he lacked an appropriate change orientation. A major problem with utilization-focused and stakeholder-based approaches to evaluation is revealed.…