This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

When conducting research on sensitive topics, it is challenging to use new methods of data collection given the apprehensions of Institutional Review Boards (IRBs). This is especially worrying because sensitive topics of research often require novel approaches. In this article a brief personal history of navigating the IRB process for conducting…

Horner et al. (2005) present a review substantiating how single-subject research methodology can be utilized to determine whether interventions are evidence-based practices (EBPs). The current study utilized the Horner et al. research piece to: (a) systematically identify a set of quality standards for the evaluation of single-case research…

Given the increasing influence of technology and the explosion in data collection demands, the acceptance and assimilation of new paradigms and technologies require today's educators, researchers, and evaluators to consider alternative tools, and apply them effectively. One of these alternatives, handheld computers, also known as personal digital…

Two methods for dividing an interrupted time-series study between baseline and experimental phases when study resources are limited are compared. In fixed designs, the baseline duration is predetermined. In flexible designs the baseline duration is contingent on remaining resources and the match of results to prior expectations of the evaluator.…

Focuses on ethical issues that can arise in the collection and analysis of data in evaluations. Addresses four issues: (1) the application of cost-benefit thinking to judgments about research ethics, (2) the quality of research design, (3) the need to explore the data, and (4) the censoring of data. (Author/SLD)

More and more researchers, evaluators, and policy makers are recognizing that in order to best understand the factors precipitating, supporting, and prohibiting intimate violence against women, we must often gather information directly from battered women themselves. Such data collection, however, is not without its risks to the women involved in…

The validity of vignettes used to elicit subject responses in social science research is examined in a study of the validity of a group of patient assault vignettes seen by 12 persons with experience in patient care. A model for establishing the validity of vignettes is proposed. (SLD)

The problems, procedures, and benefits of case-study program evaluation are investigated. An evaluation plan that included several data collection methods (document review, interview, content analysis, attitude questionnaire survey, sociogram analysis) and emphasized the role of the evaluator as participant-observer, collector and synthesizer of…

As part of an ongoing investigation of the relationship between teacher behavior and pupil affective and cognitive outcomes, coders practiced recording their observations of existing classroom videotapes in order to determine the amount of interobserver agreement. The videotapes were coded, using seven existing low- to medium-inference classroom…

Questions are raised about the future of research and development evaluation. Without a set of overarching policy questions or theoretical questions, evaluation data are simply not cumulative and cannot be organized into any data base. Education has never been a data-based enterprise. The meaning of evaluation should be broadened to include the…

The seven articles of this special issue focus on theory and research related to survey methods and whether evaluators need information that is absent from the larger survey literature. These articles reflect the view that the considerations relating to good survey research apply also to using surveys in evaluation. (SLD)

The effects of using recommended data collection procedures on median recommended test standards, variability of recommended test standards, and reliability of recommended standards for 7 subtests of the National Teacher Examinations Communications Skills and General Knowledge Tests were explored, using 236 evaluators (75 public school teachers…

This paper describes the practical steps employed in controlling interview data generated from a research project investigating teachers' perspectives on the worth of a sex equity educational demonstration project. These perspectives were then considered as value frameworks that might be used to formulate and interpret a naturalistic-responsive…