Nonprofit organizations are under great pressure to use evaluations to show that their programs "work" and that they are "effective." However, empirical evidence indicates that nonprofits struggle to perform useful evaluations, especially when conducted under accountability pressures. An increasing body of evidence highlights…

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

This study addressed the impact of VAM, concerns with VAM data, uses and interventions educational leaders provided teachers, and components perceived as necessary for VAM effectiveness as an evaluation tool. The demographics used for this study were position, school size, and experience. Due to the documented need for educational accountability…

Systems of accountability are "second order" ways of using evidence of the standard to which "first order" tasks are carried out for a great variety of purposes. However, more accountability is not always better, and processes of holding to account can impose high costs without securing substantial benefits. At their worst,…

Using data strategically to guide decisions and actions can have a positive effect on education practices and processes. This facilitation guide shows education data teams how to move beyond simply reporting data to applying data to direct strategic action. Using guiding questions, suggested activities, and activity forms, this guide provides…

Surveys and benchmarks continue to grow in importance for community colleges in response to several factors. One is the press for accountability, that is, for colleges to report the outcomes of their programs and services to demonstrate their quality and prudent use of resources, primarily to external constituents and governing boards at the state…

Assuring e-learning quality is of interest worldwide. This paper introduces the methods of e-learning courseware quality assurance (a quality certification system) adopted by the eLQSC (e-Learning Quality Service Centre) in Taiwan. A sequential/explanatory design with a mixed methodology was used to gather research data and conduct data analyses.…

Assessing general education is not that different from assessing any other type of academic program, but there are some distinctions that make it even more challenging than other types of assessment. This article addresses methods for working with nondepartmentally based and interdisciplinary areas within general education, providing some examples…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

Ohio's Butler Tech has been able to improve its student performance results from near the worst in Ohio to among the best in six years. At Butler Tech, performance measures are collected and analyzed on a regular basis at all levels of the institution to serve as constant feedback on how well the school is educating its students. In this article,…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

Empowerment evaluation entered the evaluation lexicon in 1993. Since that time, it has attracted many adherents, as well as vocal detractors. A prominent issue in the debates on empowerment evaluation concerns the extent to which empowerment evaluation can be readily distinguished from other approaches to evaluation that share with it an emphasis…

The Canadian Evaluation Society explored the benefits that can be attributed to program evaluation, the outputs necessary to achieve those benefits, and the knowledge and skills needed to produce outputs. Findings, which articulate benefits, outputs, and skills, can be used by evaluation organizations to support advocacy and professional…

Several issues have arisen from evaluations of inservice education programs in British Columbia: why evaluate and whom to survey; how can much emerge from evaluations that do not meet even the simplest cannons for effective evaluation; and how will evaluation results be used. Evaluators now need to improve their craft. (DC)

This guide is intended for professionals, laypersons, funding agents and others involved in planning and delivering local prevention services. Chapter 1 defines prevention, and differentiates between prevention strategies and programs targeted toward individuals or to general populations. Program evaluation and evaluation research are defined and…