Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional…

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate…

The quality of mixed methods systematic reviews relies on the quality of primary-level studies. The synthesis of qualitative evidence and the recent development of synthesizing mixed methods studies hold promise, but also pose challenges to evidence synthesis.

Historically, the synthesis of single subject design has employed visual inspection to yield significance of results. However, current research is supporting different techniques that will facilitate the interpretation of these intervention outcomes. These methods can provide more reliable data than employing visual inspection in isolation. This…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Perspective Text Analysis is a way to measure competence by measuring the strategy of synthesizing, which intelligence tests or questionnaires cannot measure. This paper proposes the use of Perspective Text Analysis in the study of instructional materials. Perspective Text Analysis has been applied in various learning environments, and the results…

Case examples in the articles in this volume are analyzed in the mixed-method conceptual frameworks presented in the early chapters. The richer understanding derived from these approaches support the call to advance mixed-method inquiry beyond models and toward inquiry attributes that can be combined. (Author/SLD)

There are numerous micro-level methods decisions associated with planning an impact evaluation. Quantitative synthesis methods can be used to construct an actuarial data base for establishing the likelihood of achieving desired sample sizes, statistical power, and measurement characteristics. (Author/BS)

The manner in which results and methods are reported influences the ability of the synthesis of prior studies for planning new evaluations. Confidence ratings, coding conventions, and supplemental evidence can partially overcome the difficulties. Planners must acknowledge the influence of their own judgement in using prior research. (Author)

Starting from the premise that administrators, program personnel, and social scientists are equally responsible for the conduct of evaluation, this paper addresses the legitimate role of evaluation research via discussion of: (1) the environment in which evaluation takes place; (2) types of evaluation designs; and (3) selection of an evaluation…