Four aspects of the relationship between auditing and evaluation in their approaches to program assessment are examined: (1) their different origins; (2) the definitions and purposes of both, and the questions they seek to answer; (3) contrasting viewpoints and emphases of auditors and evaluators; and (4) commonalities of interest and potential…

Three different approaches to metaevaluation are described and shown to have been applied to the study of Project Follow Through. These approaches include evaluation of primary evaluations, integrative meta-analysis in which results from several primary evaluations are combined, and secondary analysis involving the independent reanalysis of the…

The site variability issue for Direct Instruction Follow Through sites is examined from a variety of perspectives--meta-analysis of the Abt Associates' data, norm-referenced comparisons, and a longitudinal look at stability of effects. Much of the seemingly unexplained variability found in both the Abt report and the reports by M. Kennedy and E.…

This final volume in a series of seven describes the methodologies used in a study of four federal programs in 57 school districts across the country. In order to accomplish the study's objectives, two types of substudies were implemented--a federal programs survey and the individual site studies. The federal programs survey data were collected…

This research plan is a direct response to the education Amendments of 1974 which instructs the National Institute of Education to design and conduct a compensatory education study. The research design, as outlined in this report, intends to examine programs and look for identifiable factors in funding, organization, and instructional methods…

This chapter gives an overview of the design and statistical and psychometric analysis methods of the National Assessment of Educational Progress (NAEP). The evolution of the NAEP continues to provide challenges to statisticians and psychometricians, as demonstrated in the expansion of the NAEP to the assessment of individual states. (SLD)

The Evaluation of the Emergency School Assistance Program (ESAP) for the 1971-72 school year is the first application of full-blown experimental design with randomized experimental and control cases in a federal evaluation of a large scale program. It is also one of the very few evaluations which has shown that federal programs can raise tested…

This report contains procedural guidelines to assist local Comprehensive Employment and Training Act (CETA) prime sponsor staff members in developing a labor market analysis of the local economy. The guidelines are designed to be used in conjunction with other materials that have been developed by the United States Department of Labor. The focus…

The first in a 10-volume report, this volume provides an overview of the NETWORK school improvement study as a whole, placing it within the context of federal dissemination-related school improvement policies and programs. Existing research on these programs is examined and synthesized, and the evolution of the federal role in dissemination is…

The research design and analytic approaches used in the national evaluation of the Elementary Secondary Education Act (ESEA) Title VII Spanish/English Bilingual Education Program are described. This study evaluated the entire program, as opposed to individual projects, and had four goals: to (1) determine the cognitive and affective impact of…

A historical antagonism between the advocates of quantitative evaluation methods and the proponents of qualitative evaluation methods has stymied the recognition of the value to be gained by utilizing both methodologies in the same study. The integration of quantitative and qualitative methods within a single evaluation has synergistic effects in…

Guidance is provided for state Chapter 2 coordinators and evaluators in designing and implementing the congressionally mandated evaluation of the effectiveness of the Chapter 2 program. The first part of this paper reviews the congressional mandate and discusses the appropriate audience for evaluation reports. A schedule is outlined for conducting…

The movement toward integration of qualitative and quantitative research methods within the same study has been most evident in social policy research. Four major approaches to integrating can be identified in recent studies. The sequential, the parallel, and the fused models have been rather widely used. The interactive model, developed during…

Details of the design and data analysis associated with the 1988 National Assessment of Educational Progress (NAEP) are presented. The 1988 NAEP surveyed American students' knowledge of reading, writing, civics, U.S. history, and geography. Small-scale studies were conducted for mathematics and science. Populations included public school students…