With the vast array of contextual factors, pedagogical approaches, models of implementation, and purposes of education and training related to online learning, educators, learners, and the general public alike are seeking answers regarding utility and effectiveness of online learning. This article identifies and responds to many of the challenges…

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

A critical theory lens is used to explore the role of evaluation in youth development, a field aimed at recognizing youth as assets. A theory of change in the field is questioned for its emphasis on individual youth outcomes as programmatic outcome measures. A review of 209 evaluations of 131 programs in the Harvard Family Research Project's…

A district evaluator in a large Texas district examines new challenges arising since implementation of No Child Left Behind, relating to (1) navigating competing requirements in state and federal accountability systems; (2) evaluating effectiveness of sanctions districts are required to address; (3) using scientifically based research (SBR) to…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

"Theory as Method: Small Theories of Treatments," by Mark W. Lipsey, is one of the most influential and highly cited articles to appear in "New Directions for Evaluation." It articulated an approach in which methods for studying causation depend, in large part, on what is known about the theory underlying the program. Lipsey discussed the benefits…

This chapter presents the findings from a review of the practice of evaluation in federal agencies as an attempt to inform policies on method choice. The author explores whether federal agencies differ in their approaches to evaluation design and the factors that influence these differences. The nature of the programs, agency culture, evaluator…

Extension and evaluation share some similar challenges, including working with diverse stakeholders, parallel processes for focusing priorities, meeting common standards of excellence, and adapting to globalization, new technologies, and changing times. Evaluations of extension programs have helped clarify how change occurs, especially the…

In 1996, United Way of America (UWA) developed and began disseminating the most widely used approach to program outcome measurement in the nonprofit sector. Today an estimated 450 local United Ways encourage approximately 19,000 local agencies they fund to measure outcomes. The authors first describe and then assess the strengths and limitations…

Decision makers in nonformal education programs can maximize the utility of their evaluation investment and improve program effectiveness by being more mindful of the potential uses of evaluation information. Evaluation use is a multifaceted construct that may include, but is not limited to, the implementation of evaluation recommendations or…

This article uses a program-level evaluation to assess the characteristics of smaller-scale project evaluations and their use for project improvement and accountability purposes. The authors used available information from the annual Advanced Technological Education (ATE) program evaluation surveys to describe the characteristics of evaluation…

Typically, program evaluation agencies in the legislative branch of state government examine programs that have already been implemented. These evaluations often consider whether a program achieved the legislature's original goals or complied with statutory requirements. Program evaluations frequently determine whether executive branch agencies…

Implications of the Government Performance and Results Act of 1993 are discussed for evaluation involvement. Studies testing the theory underlying the act, that planning and performance measurement will improve program management and effectiveness, are described. Experiences of several federal agencies suggest that this underlying theory may be…

This eight chapters of this special issue introduce the use of a template to specify program components as a new tool for program evaluation. The template articulates the components needed for program delivery and provides a systematic method for assessing program implementation. (SLD)

It is argued that, although thousands of evaluations have been conducted of social interventions, little has been done to cumulate those results to guide intervention architects. Building social intervention theory and meta analyses are suggested as ways to unify this knowledge and make it useful. (SLD)