This article evaluates how a plurality of research methods has served a research program that has functioned in a much-needed area of research: the role of housing and recovery residences in addiction recovery. The review focuses on one mutually supportive recovery residence model, called Oxford House, which represents more than 1,700 democratic,…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This guide is addressed to policy officials, program providers, and researchers who are seeking to: (1) identify and implement social programs backed by valid evidence of effectiveness; or (2) sponsor or conduct an evaluation to determine whether a program is effective. The guide provides a brief overview of which studies can produce valid…

In this paper the authors present a new method for sample selection for scale-up experiments. This method uses propensity score matching methods to create a sample that is similar in composition to a well-defined generalization population. The method they present is flexible and practical in the sense that it identifies units to be targeted for…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

This report is a product of an European Association for Quality Assurance in Higher Education (ENQA) Workshop "Assessing educational quality: Knowledge production and the role of experts" hosted by the Norwegian Agency for Quality Assurance in Education (NOKUT) in Oslo in February, 2008. The workshop gathered representatives from higher…

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

The naturalistic research perspective assumes that reality is multiplistic, phenomenological, and context-dependent. This perspective legitimizes the subjective insights of the investigator by acknowledging the interdependence of facts and values as well as of the investigator and the object of investigation. Although discrepancies between…

The paper maintains that impact evaluation studies of programs serving handicapped infants and preschoolers should be restricted to scientifically defendable investigations. Specific types of impact studies and an evaluation process are suggested. It is suggested that program leaders should focus evaluation activities on the status of project…

Content analysis of critical events methodology is demonstrated in an evaluation of the Educational Telecommunications for Alaska (ETA) Project. This methodology was used to collect and interpret the data derived from the ETA staff personnel representing five components of the project. The data were analyzed using content analysis procedures. The…

In this discussion of the Alternating Treatment Design (ATD) in early childhood special education programs, two studies illustrate the use of ATD for comparing a treatment with no treatment and for comparing two or more treatments. An eight-step procedure is outlined to facilitate classroom application. (Author)

A rationale for using better research designs in evaluating gifted programs is considered. Some definitions of research designs are presented along with evaluation results of a summer program at Northwestern University. The role of research design in evaluating course products, and attitudes is examined via a case study. (Author/CL)

Describes differences between research and practice of experiential education evaluation, noting that differences arise when evaluation is undertaken by and for persons outside the field. Notes five types of research strategies necessary to build a stronger research base in experiential education. (SB)

Principles of program evaluation research are outlined so that bilingual education program coordinators can conduct methodologically acceptable program evaluations. The three basic principles of evaluation research are: identification of the program participants, definition of the program intervention, and assessment of program effectiveness.…