This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

These protocols represent a working guide for planning and implementing national sample assessments in connection with the national Key Performance Measures (KPMs). The protocols are intended for agencies involved in planning or conducting national sample assessments and personnel responsible for administering associated tenders or contracts,…

The popularity of sample surveys in evaluation and research makes it necessary for consumers to tell a good survey from a poor one. Several sources were identified that gave advice on how to evaluate a sample design used in a survey study. The sources are either too limited or too extensive to be useful practically. The purpose of this paper is to…

This paper helps researchers develop criteria for conducting surveys. Cost considerations frame the paper's suggestions. Specifically, the text advises that researchers consider the human and material resources needed, type of survey instrument, medium for conducting the survey (mail, telephone, personal interview, etc.), data analysis…

The main features of a multiple site, structured case study design are presented. The nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis are discussed. (Author/BW)

This handbook is intended to help educational evaluators use still photography in designing, conducting, and reporting evaluations of educational programs. It describes techniques for using a visual documentary approach to program evaluation that features data collected with a camera. The emphasis is on the aspects of educational evaluation…

Limiting data collection to a sample group is one way to increase effectiveness in dealing with data. The paper describes how to draw a sample group (random sampling, stratified random sampling, purposeful sampling, and convenient or opportunity sampling) and discusses how to determine the size of the sample group. (SM)

Situations in which mailed questionnaires are most appropriate are identified. Population variables, characteristics of questionnaires, and social desirability variables are examined in depth. (Author)

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

As part of a high-risk youth grant from the Center for Substance Abuse Prevention, the Southwest Regional Laboratory developed and implemented a survey of alcohol sales establishments. The purpose was to assess the availability of alcohol in the community and changes in availability over time that may have an impact on findings related to project…

Reviews alternative ways to establish goals for early intervention for children with disabilities, based on ecological theory. The ecological foundations of early intervention are discussed and an overview of sampling tactics and dimensions is presented. Recommendations are made for using planned activities for intervention design. (CR)

Discusses a technique for estimating sample size that does not require an a priori definition of desired precision. Presents five modifications that make the method easier to use and reduce the probability of estimating a larger sample size than necessary. The technique can guide the design of environmental sampling programs. (Contains 31…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

Describes a process for evaluating career education activities. Discusses the selection of the evaluation sample, selection and development of instruments, data reduction and analysis, comparison standards, and preparation of an evaluation handbook. (JOW)

Procedures are discussed for collecting the conversational samples needed to conduct a topic assessment in the communication of adults with mild to moderate mental retardation. A framework for analyzing topic initiations, topic maintenance, and topic changes or disruptions is explained via transcripts illustrating various types of topic…