Research design is a critical topic that is central to research studies in science, social science, and many other disciplines. After identifying the research topic and formulating questions, selecting the appropriate design is perhaps the most important decision a researcher makes. Currently, there is a plethora of literature presenting multiple…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

The current literature is replete with instances of imprecise and conflicting usage of "qualitative" and "quantitative" evaluation. This paper presents a framework for making distinctions among several related concepts to eliminate this potential source of confusion. In the process, the terms "qualitative" and…

The terms "rigor" and "relevance" most often surface in discussions of methodological adequacy. Assessing epistemological relevance is equivalent to answering the question, "Is this particular research question worth asking at all?" Epistemological rigor refers to the properties of a "researchable" problem.…

Discusses the history of evaluation research, focusing on current emphasis on "evidence-based policy." Highlights five issues emerging as relevant: evaluation can be done in many ways, serious doubts exist about the usefulness of the term "evaluation," evaluation is held back by paradigm wars, views of evaluation are…

This article reviews use of the term "best practice" in special education and suggests that the term is misleading unless measurable criteria have been systematically applied. A proposed definition focuses on the theoretical basis for a procedure, integrity of the research design and extent of replication, consensus with literature, process and…

Matching, randomization, random sampling, and other methods of controlling extraneous variation are discussed. The purpose was to specify the benefits of randomization in estimating causal effects of treatments. It is concluded that randomization should be employed whenever possible, but the use of carefully controlled nonrandomized data to…

One of a series of sixteen knowledge transformation papers, this paper examines the advantages and disadvantages of longitudinal studies as a method for evaluating vocational programs. First, longitudinal methods are defined for the differences between them and cross-sectional studies are established. The results of a literature search conducted…

Provides definitions of various types of studies used to measure the impact of interventions with children having speech, language, and hearing disorders. Describes studies initiated by the American Speech Language Hearing Association to evaluate various interventions. (DB)

A model for research and evaluation in outdoor education is presented in this paper which includes a bibliography of representative research in outdoor, experiential education. The model stresses close interaction between program designers and evaluators and rests on the premise that the strength of outdoor education--interaction between people,…

This document presents the key principles underpinning effective evaluations as applied to policy initiatives in the field of lifelong learning (LL) and the various methods available to implement them. The following are among the topics discussed in Chapters 1-6: (1) the distinction between monitoring, modeling, and evaluation and considerations…

A study was conducted to obtain pilot evidence that could serve as a basis for developing convincing methods for individual Australian companies to use in determining their returns from investment in training. The study attempted to replicate survey results from significant overseas surveys by using information collected on more than 90 Australian…