Quality control in the auditing profession has developed useful practices that are applied to the research and evaluation process. By identifying and controlling sources of bias and noise in the system of inquiry, the quality of evaluative evidence can be enhanced for both present and future use. (Author/BS)

Information that describes a program's implementation and client audience can help the evaluator tailor the study to the constraints of particular settings and increase the likelihood that the evaluation can be implemented as planned. (Author/BS)

The federally mandated evaluation system resulted from past failures to provide Congress with accurate information on how well Title I was working. The new system which is designed to aggregate locally developed evaluations into a national summary is described. (Author/RL)

There are numerous micro-level methods decisions associated with planning an impact evaluation. Quantitative synthesis methods can be used to construct an actuarial data base for establishing the likelihood of achieving desired sample sizes, statistical power, and measurement characteristics. (Author/BS)

Strength and integrity issues are central to planning and interpreting evaluation studies. In the absence of actual data from previous studies, estimates of strength and integrity can often be derived in other ways. These issues of strength and integrity are described in the context of resource allocation in evaluation research. (Author/BS)

A representative sample of studies drawn from the published program evaluation literature is examined. It is concluded that weak designs, low statistical power, ad hoc measurement, and neglect of treatment implementation and program theory characterize the state of the art in program evaluation. (Author/BS)

Functional-level testing is fundamental to the evaluation models of the Elementary Secondary Education Act Title I Evaluation and Reporting System, although criteria for determining what is a functional-level test are unclear. Reliability and validity of test scores in the range of chance is at issue. (Author/RL)

The unique conceptual framework and language of generalizability theory are presented. While this chapter is relevant to any area in which generalizability theory is applicable, it emphasizes evaluation research, and most examples come from that area. (Author/PN)

This case study shows how testing in Mississippi is used as an effective part of a statewide accountability and instructional improvement program. By using criterion-referenced testing as one aspect of a program evaluation requirement, Mississippi is basing instructional improvement on student performance. (Author)

In the absence of tests, society would be faced with restricted and subjective bases for evaluating students and educational programs. Among the benefits lost would be diagnosis of learning needs, sorting of individuals by skills, feedback to students to cope with school stresses, and transmitting of intellectual values. (Author/CM)

The utilization of state educational assessment information at local, state, and national levels for program evaluation, resource allocation, and research purposes is examined. The author creates a structure for researching, studying, and describing the outcomes of state assessment programs and illustrates each function with examples drawn from…

This conference was organized around four policy concerns: (1) the needs of handicapped, gifted, and bilingual students; (2) the use of test results to allocate federal compensatory education funds; (3) the validity of minimum competency testing; and (4) the demand for increasingly sophisticated evaluations. Garry L. McDaniels discussed the…