The objective of this audit was to determine whether the U.S. Department of Education's (Department) overall information technology (IT) security programs and practices were effective as they relate to Federal information security requirements. To answer this objective, the Department's performance was rated in accordance with Fiscal Year (FY)…

Learning and performance professionals are increasingly pressed to measure the results of their learning program design efforts, and ultimately prove their worth. However, evaluation efforts are often limited to measuring participant reaction. This study sought to quantify evaluation practices in organizations and investigate how the use of…

A wide array of federal funding opportunities exists to help states build a secure infrastructure to support data use and ensure that students are prepared for college and careers. Because the reporting requirements for these programs are frequently developed without input from other programs and agencies, grantees are required to report data that…

Innovation inducement prizes have been used for centuries. In the United States, a recent federal policy change--the America COMPETES Reauthorization Act of 2010--clarified and simplified a path by which all federal agencies can offer innovation inducement prizes, thus intensifying interest in how government agencies can most effectively design…

Critical consideration of the role of environmental education in meeting conservation outcomes is increasingly necessary for environmental agencies and organizations. Evaluation can help move organizations to alignment between educational goals and organizational mission. Moving theory-driven evaluation into mission-based program theory, this…

From 2004-2008, capacity to conduct program evaluation was built among the "Network for a Healthy California's" 48 largest local partners. Capacity building was done within a framework of Empowerment Evaluation and Utility-Focused evaluation. Tools included: a Scope of Work template, a handbook, a compendium of surveys, an evaluation…

In February 2009, the Higher Education Funding Council for England (HEFCE) commissioned RAND Europe to review approaches to evaluating the impact of research as part of their wider work programme to develop new arrangements for the assessment and funding of research--referred to as the Research Excellence Framework (REF). The objectives were 1) to…

The purposes of this study were to evaluate a federal and state-funded Family Caregiver Support Program (FCSP) and explore what types of caregiver support service are associated with what caregiver outcomes. Information was obtained on a sample of 164 caregivers' use of eleven different types of support service. Descriptive and comparative…

Traffic crashes are a significant source of loss of life, personal injury and financial expense in the United States. In 2008 there were 37,261 people killed and an estimated 2,346,000 people injured nationwide in motor vehicle traffic crashes. State and federal agencies are beginning to focus traffic safety improvement effort on local agency…

This chapter presents the findings from a review of the practice of evaluation in federal agencies as an attempt to inform policies on method choice. The author explores whether federal agencies differ in their approaches to evaluation design and the factors that influence these differences. The nature of the programs, agency culture, evaluator…

Since the first child care Quality Rating System (QRS) was implemented in Oklahoma 11 years ago (in 1998), 16 additional statewide systems have been launched and numerous states are piloting or developing a QRS (Zaslow, Tout, & Martinez-Beck, forthcoming). As QRS stakeholders across the nation look ahead to the next decade, it is important to take…

Needs assessment plays an important role in training and human performance improvement efforts, but the literature contains little research on this topic. This study extended previous research on the Performance Analysis for Training (PAT) model of needs assessment by examining its implementation to determine environmental and occupational health…

Implications of the Government Performance and Results Act of 1993 are discussed for evaluation involvement. Studies testing the theory underlying the act, that planning and performance measurement will improve program management and effectiveness, are described. Experiences of several federal agencies suggest that this underlying theory may be…

In 2006, the Bill & Melinda Gates Foundation launched the Early Learning Initiative (ELI) to improve the school readiness of Washington State's children through three main strategies: (1) development of high-quality, community-wide early learning initiatives in two communities; (2) enhancement of statewide systems that support early…

The Office of Management and Budget has recommended the termination of numerous federal programs, citing a lack of program results as the primary reason for this decision. In response to this recommendation, several federal agencies have turned to logic modeling to demonstrate that programs are on the path to results accountability. However,…