The question of generalizability or the usefulness of qualitative research results beyond the confines of the primary site, sample, and study has been hotly debated by qualitative researchers for decades. When examining this question of generalization the first surprising finding is there appears to be no general consensus about the definition,…

In a 2012 paper for the Center for American Progress, "The State of Evaluation Reform," Patrick McGuinn (Drew University) identified the opportunities and challenges facing education agencies in Race to the Top (RTTT) grant-winning states as they prepared for the implementation of new teacher evaluation systems. The 2012 study undertook…

LOCO-Analyst is a learning analytics tool we developed to provide educators with feedback on students learning activities and performance. Evaluation of the first version of the tool led to the enhancement of the tool's data visualization, user interface, and supported feedback types. The second evaluation of the improved tool allowed us to see…

Field experiences with external (qualitative) evaluation audits based on the work of E. G. Guba and Y. S. Lincoln (1981, 1985) are detailed, including evaluation contexts and purposes, procedures, and findings. Such audits represent a viable meta-evaluative tool for assessing the quality of naturalistic evaluation results. (SLD)

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

The use of qualitative evaluation methods is explored as a means of overcoming constraints and complexities of evaluation of development programs. A case study demonstrating the application of qualitative analysis to monitoring and evaluation of the Basic Minimum Needs program in Thailand is presented. (SLD)

Continuing the interchange of ideas about evaluation methodology, the authors argue the advisability of using the entire array of methods to produce useful and persuasive findings. There is, ultimately, a truth to be sought, but no one approach has a monopoly on finding it. (SLD)

Empowerment evaluation is an innovative approach that uses evaluation concepts and techniques to foster improvement and self-determination. Empowerment evaluation employs qualitative and quantitative methodologies. Although it can be applied to individuals and organizations, the usual focus is on programs. The value orientation of empowerment…

Reviews of multivocal literature are assessments of what can be learned from a given body of literature and assessments of the claims on which that knowledge is based. Methodological rigor is less likely to be a problem in such reviews than is lack of independent judgment. (SLD)

Qualitative evaluation and quantitative evaluation are discussed, examining how the perspective of each can and should create a critical debate that encourages inquiry instead of hostility. To achieve the major goal of linking evaluation information to the organization's culture, the evaluator needs to use multiple methods in a responsive,…

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

The evaluation of a science education project for teachers in Durban (South Africa) illustrates some problems inherent in the application of the fourth-generation evaluation approach of Guba and Lincoln. One of the strongest concerns is that full participation by stakeholders may be an unrealistic assumption. (SLD)

Five authors representing diverse perspectives comment on the revised "Program Evaluation Standards" approved by the American National Standards Institute (ANSI). Standards are considered in light of their development; measurement issues; program evaluation; evaluation in the local education agency; and the context of evaluation…

Five papers and an introduction discuss internal evaluation (IE), concentrating on the various sources of authority for IE and ways of enhancing IE authority. The roles of internal evaluators, conflicts in the evaluation process, and evaluation in a state education agency are reviewed. (SLD)

The chapters in this book address four major concerns in the field of curriculum evaluation. The first chapter focuses on the formative evaluation of educational programs, concentrating on the link between program development and formative evaluation. The second chapter--"Evaluating Curriculum Implementation"--presents a classification scheme for…