It is argued that time generalizability exists independent of population and situation generalizability, although the three may interact. Problems associated with sampling and randomization efficacy over time are discussed. (Author/GK)

Written in response to George Fairweather's position concerning the use of experimental studies in evaluation, this paper highlights considerations in deciding when experimental procedures are feasible. The current debate on the use of experimental methods in evaluation is reviewed. (Author/GK)

Studies designed to assess the efficacy of interventions with organically impaired infants in terms of how well the experimental designs used controlled for threats to interval validity were analyzed. The use of methodologically more rigorous designs in evaluation studies is recommended to prevent or ameliorate the adverse effects of…

It is argued that outcome evaluation should include efforts to identify and measure unintended outcomes. A systems perspective is presented which treats governmental actions as disequilibrating intrusions into reacting systems. Both intended and unintended outcomes of such intrusions can be valued monetarily, in terms of human rights, or both.…

The main features of a multiple site, structured case study design are presented. The nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis are discussed. (Author/BW)

Professional evaluators are often called upon to analyze data produced by a catastrophically inadequate evaluation design. A remedial strategy involving diagnosis of error, application of a corrective procedure and sensitization of program personnel of the need for a more sophisticated stance, is proposed and illustrated with a case study.…

The role of documentation in the planning and control functions of project management is reviewed. The importance of documentation in the assessment of research quality with respect to objectivity, validity, and replicability is discussed. An outline of documentation required in different phases of research projects is provided. (Author/DWH)

Studies examining the effectiveness of early intervention for infants and children with organic impairment and and developmental delay were reviewed using recently developed quantitative methods. Results suggest an accurate interpretation of the early intervention research literature cannot be made without consideration of specific design…

In reexamining the implementation results from a true experiment in criminal justice, this analysis brackets true treatment effects by partitioning experimental and control groups into treated and untreated subgroups and by combining two independent data sources. A positive association was found between magnitude of experimental treatment…

The authors respond to criticism and analyses by Eva Rezmovic (TM 507 851) of their experimental design, particularly the suggested use of information on the amount of program service received by the control group comparable to the treatment group in their study of the relationship between program implementation levels and program outcomes. (CM)

A three-dimensional framework presents faculty, student, and curriculum variables critical to the implementation and outcomes of multicultural programs. The framework emerged from the formative evaluation of a new interdisciplinary social science curriculum and guided the design of the national field test of that curriculum in community college…

This study of evaluation utilization identified organizational, political, and practical arrangements facilitating the wide use of "The Interim Report Evaluation" in policymaking for California's Early Childhood Education Program. In a program fraught by tensions, where evaluations had been political tools, this evaluation was special.…

The effects of the changing nature of intelligence test items during the follow-up period for compensatory education program evaluations on the judgments about program effectiveness are examined. Data from the Stanford-Binet and from three compensatory education evaluations, are examined. Methods for dealing with differential validity are…