Draws lessons in contracting for evaluations from the 1995 evaluation of a U.S. Marine Corps personnel evaluation system and a 1991 evaluation of the procedures for setting cutting scores of the National Assessment Governing Board of the National Assessment of Educational Progress. These national, politically sensitive evaluations provide lessons…

Reviews lessons learned from early experiments with academic audits in the United Kingdom, Sweden, New Zealand, and Hong Kong in areas such as: focus of audits, selection and training of audit teams, nature of audit self-studies, conduct of audit visits, audit reports, and audit follow-up and enhancement activities. Suggests guidelines for design…

Guidelines for developing an evaluation plan for a gifted education program include recognizing the reluctance to spend money on evaluation, identifying what should be evaluated, deciding when programs should be reevaluated, determining overall evaluation principles, creating the evaluation design, and designing the evaluation plan to fit a…

Provides an approach to ensure that courses are implemented as designed. Highlights include training the trainers and peer teaching, the need for cooperation between the course development and delivery teams, the use of technology, using subject matter experts, and evaluation through telephone interviews that supports this approach. (LRW)

Constructs a recursion programming learning system based on Socratic dialog which presents questions to students and encourages them to reflect on their own thinking. Highlights include implementation using database techniques; evaluation by empirical methods; and results of pretests and posttests that show a positive impact on recursion…

Developed and field tested the Performance Accountability Quality Scale (PAQS) on 191 program performance measurement systems developed by nonprofit agencies in central Florida. Preliminary findings indicate that the PAQS provides a structure for obtaining expert opinions based on a theory-driven model about the quality of proposed measurement…

The six chapters of this issue consider how language shapes the meaning of social policies and programs that are evaluated. Offers interdisciplinary perspectives on these language issues and highlights the practical issues involved in language function in evaluation. (SLD)

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

Outlines a few items of "unfinished business" in the profession of evaluation, focusing on outcome evaluation, also called impact evaluation. No issue related to the future of evaluation seems more important than that of finding routine methods to assess the impact of everyday practical programs on the social conditions they address.…

Sets forth a vision for evaluation in the future that is disciplined in the sense of being planned, systematic, and funded in ways that adhere to professional standards, principles, and codes, resulting in the improvement of services, products, performances, and quality of life. In the ideal future, disciplined evaluation will become a pervasive…

Makes 15 predictions about the future of evaluation and outlines 4 challenges that will determine the future of the field: (1) negotiating permanent truces in paradigm wars; (2) using science intelligently rather than joining in politically correct attacks on it; (3) keeping evaluation independent enough of societal trends to be able to evaluate…

Reviews the conclusions drawn in articles in this special issue and comments on some of the major themes, including paradigm debates, context issues, the role of evaluators and evaluation, the performance measurement movement, and the impact of new technologies on evaluation. (SLD)

Discusses preservation education programs and describes a workshop follow-up program by SOLINET (Southeastern Library Network) designed to measure the effects of training, provide ongoing support, and develop a long-term mechanism for evaluating workshop effectiveness. Presents results obtained after collecting qualitative and quantitative data…

Presents conversion factors to be used to translate the quality of the respective contraception methods distributed to a single measure of protection for calculating couple-years of protection in family planning studies. Discusses the implications for the evaluation of family planning programs. (SLD)

Describes an evaluator's experiences constructing a World Wide Web site to collect evaluation data and discusses the technical and design challenges presented by data collection via the Web. Discusses eight lessons of Web-based data collection and outlines the advantages of the approach. (SLD)