In an effort to maintain internal validity while maximizing the generalizability of evaluation results, the theory-testing methodology that links program activities to outcomes (program theory) is proposed. To evaluate a program by explicating and testing the program theory is to perform evaluation as theory testing. (PN)

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

In the form of a play, a brief discussion is presented of program evaluation problems at the elementary/secondary education level. (PN)

The design and conduct of a national evaluation study is discussed, demonstrating that a control group may not provide the no-cause baseline information expected. Resolution of this problem requires reexamination of paradigms, research practices, and policies, as well as the underlying real world constraints and views that generate them. (PN)

A study of school district uses of evaluation and test data is used to illustrate the variety of ambiguities that can appear in qualitative data. Rules of evidence to distinguish valid and potentially nonvalid testimony are proposed. Uses of testimony in evaluation are discussed. (BS)

Problems that face evaluators, including field based evaluations, are discussed. The author states that open communication, access to data, and an ability to be accepted are paramount; knowledge of randomness, robustness and homoscedasticity may be secondary. (Author/PN)

This exploratory paper analyzes the federal policy for an impact study of research and development projects in vocational education. Positive effects were found on student outcomes, project personnel, and on occupational education practices. (Author)

A model is described which illustrates two general uses of multiple analyses to evaluate quasi-experiments: obtaining estimates of the treatment effect, and checking the validity of the experiment. (MH)

Conclusion about site-specific determinants of educational outcomes of the controversial longitudinal evaluation of the Follow Through programs (1976) are challenged again by reexamining the Direct Instruction model data. Reanalysis confirms earlier critiques and supports more recent research funding on the relationship between types of…

The evaluation of the reading programs in the Eugene, Oregon, public schools is described. Emphasis is placed on the eclectic approach to reading in the district prior to the evaluation and on the effect of using staff members as evaluators in their own district. (CTM)

Title I Evaluation models using uniform procedures and data collection for state and national comparisons are interpreted as federal endorsement of basic, common competencies in reading and mathematics. Basic competencies, content homogeneity, conversion methodology, and validity of the evaluation are discussed. (MH)