This note suggests a solution to the problem of achieving randomization in experimental settings where units deemed eligible for treatment "trickle in," that is, appear at any time. The solution permits replication of the experiment in order to test for time-dependent effects. (Author/CTM)

This paper is one of a group that describes the research methodology for an evaluation of individually guided education (IGE) in American elementary schools. Described here are the procedures used to select the sample of schools being studied in the first phase of the evaluation. This phase was a large sample study that used structural equations…

This article presents a synopsis of each of seven presentations given at a conference on design and analysis in community trial studies. Papers identify problems with community trials and discuss strengths and weaknesses associated with design and analysis strategies. Areas of consensus are summarized. (SLD)

The effects of using different data analysis methods on estimates of treatment effects of educational programs were investigated. Various regression models, such as those recommended for Title I program evaluations, were studied. The first effect studied was the amount of bias that might be expected to occur in the various settings. Results…

Third in a series, the monograph summarizes the key evaluation issues, design approaches, and statistical techniques used in conducting the 1980-1983 impact evaluation of Indian Education Act Title IV Part A programs. The monograph describes the major problems in evaluating the program to determine the degree of its positive contribution to…

Details the procedures followed in obtaining a frequency-of-use list of the most-to-least-used instructional materials in mathematics (K-12), reading (K-6), and science and social studies (each 7-12). (Author/MLF)

Electricity conservation programs were implemented in matched pairs of office-classroom-laboratory buildings and dormitories. The methodological problems of predicting consumption levels, interpreting why changes in consumption occurred, and estimating initial waste levels are discussed along with their implications for the conduct of behavioral…

Because research synthesis enables one to determine either the overall effectiveness of a particular treatment or the relative effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

After a brief introduction indicating the value of the first Follow Through evaluation, this document offers ideas about how a new wave of Follow Through approaches should be evaluated. The discussion is based on the premise that the form of an evaluation must be derived from the questions for which answers are sought, the audience(s) to whom the…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

The implementation of research design in studies on substance abuse education is discussed in this meta-analysis. Findings indicate that the quality of research design is constrained by negative feedback from evaluation stakeholders. This finding is applied to an evaluation of the Here's Looking at You, 2000 drug education program currently…

A beverage-server intervention project at two West Coast Navy bases that attempted to reduce levels of alcoholic intoxication via policy changes and server training is described. Data obtained via interviews and structured observations of 1,511 club customers indicate methodological bias and self-selection effects. Bias adjustments were performed…

Issues that arose in attempting to survey people with Acquired Immune Deficiency Syndrome (AIDS) are described. Questions of confidentiality, nonimplementation, and slow accrual of information are considered for an initial sample of 2,731 cases. Comparison with a database concerning 1,313 clinic clients indicates overrepresentation of compliant…

A general interest in attrition, or loss of units from a study, stems in part from the observation that the infrequency of attention to attrition exacerbates problems of data interpretation. As a substudy of the national evaluation of Project Follow Through, the potential biasing effects of attrition of subjects from the sites were investigated.…