There is growing pressure to make efficacy experiments more useful. This requires attending to the twin goals of generalizing experimental results to those schools that will use the results and testing the intervention's theory of action. We show how electronic records, created naturally during the daily operation of technology-based…

As the procedures of evaluation research have developed during recent years, it has become clear that the results of evaluation studies have failed to provide policy decision makers with useful information. An approach towards designing and implementing more useful evaluations--the stakeholder survey--is discussed. Stakeholders are individuals, or…

An evaluator-manager interaction model is developed for predicting the impact of evaluation and research findings. Instruments are developed for measuring the variables of interpersonal involvement, impact of evaluation, and managerial style in the relationship between evaluator and manager. The hypothesis advanced suggests that evaluators can…

Review of literature concerning the use of program review in higher education lists sources discussing the review process, focusing on the links between program review and other institutional processes, and addressing application of program review principles and practices to different higher education settings. Critical factors for successful use…

Claims made for case studies are analyzed, and some of the obstacles to using this kind of evaluation information are discussed. The analysis is based on evaluation of a federally funded project which combined the evaluation with attempts to use that information to help other schools. (Author/CTM)

This document presents the research proposal and supporting documents for a study to evaluate the process of developing a comprehensive dissemination capacity in State Education Agencies (SEAs) and to assess the impact of the capacity building activities in the states, addressing two questions: Is dissemination capacity being built and, if so,…

Using the 1995 National Research Council ratings of doctoral programs in 41 fields, a statistical methodology is offered for assessing how measures of program size, faculty seniority, faculty research productivity, and faculty productivity in producing doctoral degrees influenced raters' decisions. Then using data for one field, economics,…

Reviewing five large-scale investigations of educational dissemination and change, this report synthesizes and consolidates their findings and implications around an issue of common interest to policymakers, program administrators, and researchers: what can be learned from these studies about processes and procedures that facilitate knowledge…

Methods of identifying effective special education practices are analyzed to help practitioners identify and adopt such practices. The contents of this guide include a flowchart for effective practice identification (EPI), an analysis of decision-making steps in this process, and two examples of identification procedures. The decision-making steps…

One of a series of manuals developed by the Home and Community-Based Career Education Project, the publication presents the activities of the project's research and evaluation component, which continually informs the staff about project development and describes client characteristics, needs, decisions, and plans. Generic issues which must be…

Evaluation roles used in the Department of Research and Development in the Cincinnati Public Schools are identified and described. These include: project evaluator, local-school evaluator, independent program evaluator, external evaluator and external auditors. The merits of each evaluation role will be discussed as to its relationship with…

A statistical definition of information utilization for policy making decisions and an evaluation impact test to determine its occurrence are proposed. A univariate time series analysis is used to identify the internal trend for a given policy output variable and to control its effect. Two problems are identified in implementing an evaluation…

The Public Health Service's Office of Research Integrity, charged with investigating allegations of research misconduct, is addressing charges of inefficiency by speeding up inquiries and reducing the backlog of cases. However, concern persists about the quality of investigations and the agency's power. Some feel the agency relies too heavily on…

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with the application of outcome…

In response to legislative mandates calling on educational institutions to become more accountable for monies spent, a number of community colleges in California have implemented research and data collection models to help them answer state and local questions about institutional effectiveness. However, there is a significant difference between…