Flexibility in evaluative research design does not necessitate the abandonment of randomly constructed comparison groups. Three designs are reviewed which provide at least the option of randomization while maintaining great flexibility. The strengths and weaknesses of the designs are discussed. (Author)

The terms evaluation, assessment, and appraisal are often used interchangeably in research on schools and pupils. Guidelines for their use and some of the similarities and differences in their meanings are explicated. The concept of evaluation is narrowed to refer to use of information on pupil behavior. Four separate components of…

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

Practical methods for implementing true experimental designs in evaluation settings in which such designs are rarely used are presented. Particular attention is paid to educational settings. (Author/JKS)

The degree to which the chosen units of analysis are likely to produce spurious findings in staged combinations of multiple linear regression procedures are examined. The effects of grouping variables (e.g., classroom, school, and school district) on Procedures such as Coleman's semipartial regression and Mayeske's commonalities, in light of…

Six models for evaluating change are examined via a Monte Carlo study. All six models show a lack of power. A modified analysis of variance procedure is suggested as an alternative. (JKS)

This paper provides an understanding of the conceptual and operational relationships between evaluation, content analysis, and microcomputers so that evaluation practitioners can better address applied content analysis problems used in their work. The first section presents a general model for conducting an evaluation effort that focuses on…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

An author of the 1966 USOE report titled "Equality of Educational Opportunity" discusses some of the criticisms leveled against the study. The most serious charge is that the study attempted to do too much. By analyzing resource inputs and levels of achievement and by trying to analyze the effects of various inputs on achievement, the…

Review of a research study designed to determine the relationship between participation in supervisory training and managerial performance focuses on the importance of adequate evaluation. Dependent and independent variables used are described, statistical analyses are explained, and implications for future research design are presented. (LRW)

Three common methodological problems in the analysis of observational data include: (1) failure to base degrees of freedom for the analysis on the appropriate sampling unit; (2) the validity of the design and data are inconsistent with the generalizations reached; (3) the statistic used to calculate coder reliability is often inappropriate and…

A review of the literature suggests that choice of control group may have affected the policy implications of the major evaluations of governmental training programs. It is argued that the usual evaluation designs underadjust for preprogram differences between trainees and the control group and thus yield biased estimates of program impact.…

High intercommunity variation in adolescent smoking precluded detection of effects of mass media campaigns on initiation of cigarette smoking in a study with a final sample of 1,637 adolescent subjects. Implications for studies using the individual as unit of analysis and the community as unit of randomization are discussed. (SLD)

Research is a useful tool for educators because of its ability to uncover causal relationships between variables that are often obscured in field investigations. This textbook presents basic methodological information that has been designed for and proven to assist the educator who seeks to move himself from the laboratory to the field. The book…