Arguments supporting the use of the exploratory case method in evaluating reviews of multivocal literature are repeated, and points of general agreement with M. Q. Patton and R. F. Elmore are reviewed. Disagreement is expressed with R. K. Yin about the value of grounded theory in analyzing multivocal literature. (SLD)

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

Empowerment evaluation entered the evaluation lexicon in 1993. Since that time, it has attracted many adherents, as well as vocal detractors. A prominent issue in the debates on empowerment evaluation concerns the extent to which empowerment evaluation can be readily distinguished from other approaches to evaluation that share with it an emphasis…

Evaluators must use a flexible, open-minded approach oriented toward a holistic view of the implementation and operation of the program they are analyzing. The use of more than one methodology expands the potential findings and avoids the limitations of a unidimensional approach. (SLD)

Results of evaluation research studies, even those that are meticulously designed and carefully executed, often are not implemented. This article examines some of the critical factors that mediate between the carrying out of evaluation research and the utilization of findings. To illustrate these factors, two case studies are analyzed. (Author/EGS)

In program evaluation and policy analyses, utility supplants rigor as the first and most important criterion in judging literature reviews. Although R. T. Ogawa and B. Malen emphasize rigor, a utilization-focused evaluation emphasizes purpose and audience, both of which affect the conduct of a multivocal literature review. (SLD)

Reviews of multivocal literature are assessments of what can be learned from a given body of literature and assessments of the claims on which that knowledge is based. Methodological rigor is less likely to be a problem in such reviews than is lack of independent judgment. (SLD)

This article presents a framework for developing internally sustainable evaluation systems for environmental education organizations, although the framework can be applied to other types of organizations. The authors developed a sustainable evaluation framework (SEF) with the intent of creating an evaluation system that could be self-administered…

The focus of this article is on the ways in which an analysis of professional discourse within a school can contribute to a school's self-evaluation. The project included an opportunity sample of nine schools and involved members of the research team, senior management and teachers in each school working in collaborative partnership. A research…

Both pragmatic and experimental approaches to studying adolescent suicide are applied in this study of a suicide prevention curriculum for eleventh graders. Pragmatic and experimental paradigms were both of value in addressing needs of these students and in making general knowledge available. (SLD)

In 1989 the Department of Education contracted with Development Associates, Inc., to conduct a review of the evaluation and improvement practices of projects funded under Title VII of the Elementary and Secondary Education Act, often known as the Bilingual Education Act. The study focused on local transitional bilingual education and special…

This paper discusses the experiences and insight derived from the 1985-1986 Statewide Evaluation of the Early Education Program of Handicapped Children in Louisiana, the multimethod evaluation of preschool intervention projects for handicapped and at-risk children. The program served almost 5,000 handicapped preschoolers and their parents,…

Describes a project in which summative evaluation was successfully applied in guiding the content of a rural media campaign to increase rice production in Sierra Leone, and in judging the campaign's impact upon completion. The pretest phase of the evaluation, project material development, and evaluation results are described. (MBR)

Data from nine Michigan elementary, middle, and high schools highlight the challenges and common strategies found in the use of student assessment data to meet public demands for accountability. The information gathered from assessment tools varies by frequency and type. Educators have, historically, underutilized data to guide practice because…