Suggests that successful evaluation projects for training programs focus on management decisions. Provides a checklist of concerns that deal with the effectiveness, efficiency, and relevance of the program. Discusses the selection of the data level and decision-making criteria. (CSS)

This paper examines (1) the problems of program design and implementation in relation to evaluation design, the confusion between research and evaluation design, and the overemphasis on quantitative data; (2) clarifies misconceptions about these problems and the evaluation process; and (3) suggests ways of avoiding these problems in the future.…

Ethical issues relating to naturalistic evaluation are addressed, focusing on the role of the evaluator, problems of privacy and data gathering techniques, and issues relating to the use/abuse of findings. Benefits and costs of the naturalistic approach to program evaluation are also identified. (EGS)

Drawing on current models for increasing the use of information from external evaluations, the authors offer a user-centered approach for increasing the use of results from internal evaluations of graduate medical education. The overriding emphasis of the user-centered approach is the utility of the resultant data. (Author/BW)

The unique characteristics of the organizational context are reviewed, and it is shown how internal evaluation fits within them. The major factors that define the organizational context are delineated, including the emergence of the evaluation resource management function. (PN)

About a third of students entering high school do not graduate and face limited job prospects. The No Child Left Behind Act requires states to use graduation rates to measure how well students are educated. To assess the accuracy of states' rates and to review programs that may increase rates, GAO was asked to examine (1) the graduation rate…

This paper presents findings of a study that examined the extent to which children's mental health agencies can meet the information needs they consider to be most important and also comply with recommended standards of the Mental Health Statistics Improvement Projects (MHSIP). Three children's data sets representing three different agency…

To get a valid picture of program impact via comprehensive data collection, combined with a focus on standards, an evaluation of a professional development program for elementary and secondary level teachers of science was carried out at the University of Hawaii at Manoa. This paper presents selected examples from the program evaluation, designed…

This volume, one in a series of three monographs, is a guidebook to evaluating campus diversity initiatives. Chapter 1 introduces campus diversity initiatives. Chapter 2, "Evaluation and Diversity," explores the need for assessment of such initiatives. Chapter 3, "Designing a Campus Diversity Evaluation," presents general concepts and guidelines…

This brief paper reports on an evaluation of 10 community rehabilitation providers, six that successfully closed a facility-based program between 1989 and 1994, and four who are currently involved in a change process. Data collection consisted of participant observation, in-depth interviews, and document analysis. Findings indicated: (1)…

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

Describes a study of vocational agriculture programs in the southern United States to determine the impact these programs have on students. Data were analyzed to determine if categories of responses could be identified and if a significant relationship existed between these categories and the demographic variables. (CT)

Reviews the information-gathering and record-keeping methods used at Milwaukee Area Technical College and explains the usefulness of such data in maintaining accountability, improving instructional quality, and planning for the future. (SK)

Various aspects of the institutional evaluation process are discussed including: pitfalls to avoid, choice of indicators, audience, accountability, futures research, technological change, program termination, data sources, longitudinal data, political aspects, advertising, marketing, and internal v external evaluators. (Author/SF)

This paper defines the student case study approach to evaluation, discusses its strengths and weaknesses as a component in a program evaluation design, and lists the specific steps needed to accomplish it. Its use in the evaluation of Experience-Based Career Education is described. (SJL)