Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

In this commentary for the special issue on the social and character development (SACD) research program, the author identifies some of the dilemmas facing practitioners attempting to do evaluation research in SACD in schools and discusses some of the related concerns raised in this issue's papers. His familiarity with the SACD program derives…

Describes changes to be made in the National Institutes of Health (NIH) system of peer review approving grants for research proposals. (SL)

Research reports were of two forms--subjective reports by observers of the various activities, and objective measures of changes in knowledge and/or attitude. The difficulties encountered in evaluation are discussed but the results of the evaluation are not included. Samples of the four questionnaires are presented. (AG)

This exploratory paper analyzes the federal policy for an impact study of research and development projects in vocational education. Positive effects were found on student outcomes, project personnel, and on occupational education practices. (Author)

Assessing results of grants programs is illustrated with evaluation activities of the National Science Foundation and other federal agencies. Methods considered are ex-ante peer review of proposed work, ex-post peer review of completed work, publications-based methods, and "look-back" methods tracing contributions of past work and…

This paper examines the challenges and problems involved in studying the Illinois school finance system, based on the experience of the Center for the Study of Educational Finance in studying the 1973 Illinois school finance reform. The first major section of the paper outlines the major variables in the 1973 Illinois reform and discusses problems…

Authors of the Wilms study on the effectiveness of public and proprietary vocational training respond to critical analysis of their report and call for new research studies to build on their research and corroborate or refute their findings. (Editor/JT)

Provides a descriptive overview of the design, revision, and execution of a research project undertaken at the Department of Library and Information Studies at the Manchester Polytechnic to evaluate the attitudes of library science students toward computers before and after the completion of a course in library automation. (JL)

The possible influence of cognitive dissonance in psychotherapy was examined by conceptualizing therapy as an effort justification process. It was predicted that freely choosing to undergo a highly effortful procedure would aid in positive therapeutic change. Subjects (N=52) participated in a weight-reduction experiment in which the degree of…

Trends in European practice that relate to qualitative assessment in the evaluation of the impact of research and innovation are discussed and analyzed. To date, European evaluations have been mainly concerned with quality and direct impact with few assessments of medium- or long-term impact. (SLD)

Strengths and weaknesses of three types of semiquantitative methods used by the federal government in research impact assessment are presented, and examples of their use are reviewed. These include the classic retrospective method, another retrospective approach, and accomplishments books used by selected research-sponsoring organizations. (SLD)

This article reviews the principal methods economists and cost benefit analysts use in evaluating research. Two common approaches are surplus measures (combinations of consumer and producer surpluses) and productivity measures. Technical difficulties and political and organizational constraints are discussed for these measures. (SLD)

Even after a number of innovative programs and proposals have met selective criteria, the Educational Research Commission will have a difficult task in assigning priorities and spreading resources. This paper offers many suggestions for handling the problems in research and evaluation related to innovative mathematics projects, especially K-3. For…

Articles in this special issue deal with the assessment of the impact of research and are divided into segments concerning semiquantitative approaches; qualitative approaches; and quantitative and fiscal approaches. These articles illustrate the importance of the role of motivation and associated incentives. (SLD)