Decision makers in nonformal education programs can maximize the utility of their evaluation investment and improve program effectiveness by being more mindful of the potential uses of evaluation information. Evaluation use is a multifaceted construct that may include, but is not limited to, the implementation of evaluation recommendations or…

To provide another perspective on evaluation within nonformal settings, "New Directions for Evaluation" recently interviewed David Smith, the coordinator of the Professional Learning to Close the Achievement Gap program for the Kansas City, Kansas, Public Schools, who has extensive background in education and educational research. He formerly held…

Thomas Jefferson recognized the value of reason and scientific experimentation in the eighteenth century. This chapter extends the idea in contemporary ways to standards that may be used to judge the ethical propriety of randomized trials and the dependability of evidence on effects of social interventions.

This article uses a program-level evaluation to assess the characteristics of smaller-scale project evaluations and their use for project improvement and accountability purposes. The authors used available information from the annual Advanced Technological Education (ATE) program evaluation surveys to describe the characteristics of evaluation…

The authors present the argument that evaluation as currently practiced is failing the needs of the social sector, if the goal is to help organizations achieve their mission. Three case studies are presented in which evaluation played a key role in the development of a learning culture within the organization. Each case highlights the positive…

Provides a historical accounting of the work of early African American educational evaluators to show the critical place of race and culture in both historical and contemporary visions of responsive evaluation. Discusses reasons their work has so largely been ignored. (SLD)

Offers consideration of the relationship between a responsive approach to the evaluation of educational programs and a personalized approach to the assessment of student achievement. Explores responsiveness as a motif for inquiry about program quality and student accomplishment, emphasizing the relationship between the two. (SLD)

Examines arguments for and against evaluation advocacy in terms of the American Evaluation Association's "Guiding Principles for Evaluators" and other statements on advocacy and neutrality. Suggests revision of the "Guiding Principles." (Author/SLD)

Explores the use of technology to evaluate technology, with an emphasis on recording user interactions with systems and gathering user feedback within the context of a multimedia environment. Focuses on analyzing electronic and networked environments, but offers strategies relevant to other evaluation efforts. (SLD)

Describes verbal protocols as a useful tool for evaluating computer hardware and software, especially if informed by activity theory. Such protocols cannot, however, stand alone in a thorough evaluation design. (Author/SLD)

Presents the perspectives on commissioning and using evaluations of community-based agency leaders through interviews with four such leaders. Discusses respondents' needs and experiences in commissioning and using evaluations and their ideas about ideal evaluation products. (Author/SLD)

Discusses ways in which a community-based program evaluation can be enhanced by using a screening tool to delineate the program's evaluative needs, resources, and commitments. Describes use of the Evaluation Pre-Screening Tool and reports on some examples of successful use. (SLD)

Describes the efforts of one community to define, begin, and finally, embrace community evaluation in the evaluation of a Smart Start program in Cumberland, North Carolina. Lists lessons learned in "selling" the evaluation to the community. (SLD)

Proposes a framework for the evaluation of health and human services programs in community settings. Applies this framework to the discussions in this special issue to see how well the chapters advance community-based program evaluation. Concludes that the chapters are valuable for those interested in improving the evaluation of community-based…

The editors give each of the theorists a chance to respond to questions posed about the context of the situation in relation to their own experience in the field, exploring how the exercise had an impact on their evaluation designs.