What are the four different types of questions of concern in an evaluation study and how can concept questions be recognized and answered? These issues are addressed in this paper, in the framework of a compensatory education program evaluation. The discussion includes (1) the identification of concept questions and how they are different from…

Evaluation research is conceived as a question answering process. Four strategies are suggested which emerged from four approaches to the study of questions. Evaluation questions must be identified and classified before research can effectively begin. This paper discusses the four approaches to studying evaluation research questions and their…

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

This commentary on EC 603 695 argues that significance testing is a necessary but insufficient condition for positivistic research, that judgment-based assessment and single-subject research are not substitutes for significance testing, and that sampling fluctuation should be considered as one of numerous epistemological concerns in any…

Evaluation as a field has moved beyond debating whether certain designs are good while others are bad to begin to appreciate that each of a group of designs may have its uses. The importance of good designs that reflect real-world complexities is increasingly being recognized. (SLD)

This paper argues that judgment-based assessment of data from multiply replicated single-subject or small-N studies should replace normative-based (p=less than 0.05) assessment of large-N research in the clinical sciences, and asserts that inferential statistics should be abandoned as a method of evaluating clinical research data. (Author/JDD)

Institutional research, as an established profession, has not developed a professional code of ethics. Reasons for the lack of such a code are discussed, and an outline is presented of the three major areas of institutional research ethics: treatment of research participants, research practices, and socio-political dimensions. A simple procedure…

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

It is now a matter of routine that schools in England are able to demonstrate the value of their work in terms of "impact" and "outcomes." In the province of imaginative education this is problematic. While Government has sought to create a new relationship between inspection and school self-evaluation, this in effect has…

The author's optimistic view of evaluation in the future includes increased utilization, especially in the private sector; more professionalization, with potential for conflict; more academic program development; more use in policy; increase in the use of complex methods; and more involvement in program development. (SLD)

Conjectures about the future use of controlled randomized experiments for planning and evaluating social programs suggest that they will frequently involve institutions and organizations rather than individuals and that their applications and the publicity surrounding them will increase as they are used in new and controversial ways. (SLD)

In spite of many inherent problems, impact evaluation should remain an integral part of program evaluation, both because impact evaluation brings its budget justification with it, and because its focus on causal hypotheses is an essential part of evaluation. Methodology based on the author's body of work is reviewed. (SLD)

This provides the basic format to be followed for conducting a research project. The method of analyzing the procedure for making a successful research project is broken down into six components: (1) State the problem briefly and explain its importance and significance; (2) State the hypotheses to be tested and explain specific questions to be…

In 2001, the Bunche Academy was chosen by its district to join in partnership with the Da Vinci Learning Corporation to embark on an ambitious whole-school reform initiative, especially designed by the corporation for low-performing schools. In this chapter, the author describes how, as illustrated in the Bunche-Da Vinci Learning Academy context,…

This paper summarized contributors' ideas about evaluation as a field and where it is going. Topics discussed were qualitative versus quantitative debate; evaluation's purpose; professionalization; program failure; program development; evaluators as advocates; evaluation knowledge; evaluation expansion; and methodology and design. (SLD)