This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Experimental research involves comparing two or more conditions. One of those conditions in single subject research is often the baseline. Adequate description of the baseline conditions is necessary for evaluating the effects of independent variables, drawing generalizations from studies, and providing information for subsequent replication…

Describes how Geographic Information Systems (GIS) can be used to help evaluators convey complex information simply through a spatial representation. Demonstrates how GIS can be used to plot change over time, including impact and outcome data gathered by primary data collection. (SLD)

The definition, structures, utilities, stimulus-response differences, and portrayals of responsive evaluation are presented. An educational evaluation is said to be a "responsive evaluation" if it orients more directly to program activities than to program intents, if it responds to audience requirements for information, and if the different…

This report of the Joint Committee on Educational Goals and Evaluation to the California Legislature discusses the need for educational goals and evaluation, the committee investigation, and the collection of information. As a result of the investigation, it was concluded that: (1) it is essential that the goal-setting process include the…

The presentation of case study research in this book is based on a disciplined, qualitative inquiry into a single case, rather than quantitative methodologies or case studies for instructional purposes. Practical suggestions are given for gathering and organizing data and for data interpretation and reporting. (SLD)

Program portrayal is one way of addressing the need for increased descriptive capability in evaluation research. Portrayal supplements traditional reporting by utilizing subjective, anecdotal, or impressionistic information, in an appropriately communicable form, to enrich the description of program transactions, settings, and outcomes. It is…

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, fifth in the kit, discusses the role and importance of implementation evaluation and presents methods for designing, using, and reporting the results using assessment instruments to describe accurately how a program…

This book is an effort to document ideas, processes, and outcomes based on input from many people involved in accountability of interagency collaborative services programs. The goals, processes, instruments, and reporting systems presented have been developed through a team process over a 10-year period of involvement with Iowa's School-Based…

Practicality is the hallmark of this physical education research manual. It focuses on applications with which investigators in this field typically are concerned; numerous examples clarify these points. All phases of research are covered, beginning with writing mechanics and style and a blueprint of the chapters that comprise the creditable…

Research review is conceptualized as a scientific inquiry involving five stages that parallel those of primary research. The functions, sources of variance, and potential threats to validity associated with each stage are described. (Author/PN)

Triangulation strategy results in evidence characterized by the following: (1) convergence; (2) inconsistency; and (3) contradiction. In order to render the data sensible, the researcher or evaluator must report data collection procedures, as well as the three levels of information from which explanations of social phenomena are constructed. (BJV)

Procedures for evaluating day care centers are described, formulated specifically with regard to the information available through, and planning requirements of, the Syracuse Model City Agency. The first chapter discusses some problems involved in providing adequate day care services on the national level, the city level, and within the Syracuse…

This book outlines a process for showing how well a school or district meets its goal of sustained student learning. The first section provides a knowledge base for collecting and reporting educational data. The next section reflects the components of educational change and answers "how to" questions about data gathering, analysis, and reporting…