A method called multi-attribute utility analysis (MAUA) provides a decision-making framework that facilitates comparative analysis of multiple real-world decision alternatives with unique complex attributes. Utility analysis as a measure of effectiveness has been minimally used by educational researchers to date, despite clear relevance in complex…

Program evaluation is important for assessing the implementation and outcomes of local, state, and federal programs. The Program Evaluation Toolkit provides tools and resources to support individuals responsible for evaluating and monitoring local, state, or federal programs. The toolkit comprises eight modules that cover critical steps in program…

Extension professionals must demonstrate organizational value to garner public awareness and support. Measuring and communicating outcomes that have public value can be challenging. In this study, Ripple Effects Mapping incorporating the Community Capitals Framework was used to evaluate a childhood obesity prevention study, iCook 4-H, of…

In this paper we discuss how the products of student work during long-term, interdisciplinary curricular units at King Middle School, a grades 6-8 public school in Portland, Maine, through their aesthetic qualities, transformed people's understanding of what children were capable of. We argue that, to effectively understand student work of this…

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

Charlotte-Mecklenburg Schools' (CMS) Parent University is an innovative, collaborative initiative designed to engage parents in their children's education. Working with community partners, Parent University offers unique courses and workshops such as Parenting Awareness, Helping Your Child Learn in the 21st Century, Health and Wellness, and…

In times of diminishing resources to support community programs, it is critical that Extension make every effort to show impact as collectively as possible for the variety of programs being delivered in individual counties and communities. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810), focused on outcomes in…

A passion to ensure the educational and life success of all children, particularly young African American men, has propelled my work for all of my professional life. Although following one's passion can make for a fulfilling life, passion is not enough to create a successful and sustainable nonprofit organization. Like many leaders in the…

Program evaluation is recognized as an essential skill set for practitioners in service-related fields, such as education, nonprofit management, social work, and public health. Recently, the need for a public workforce trained in evaluation has increased and is driven primarily by our nation's emphasis on accountability during a time when…

Increasingly across the United States, institutions of higher education (IHE) are offering a wide array of postsecondary educational (PSE) opportunities for students with intellectual disabilities (ID). As more students with ID aspire to college, it is incumbent upon IHEs to engage in rigorous program evaluation to assess student outcomes and…

This article introduces a waka tino whakarawea model for evaluating programmes and services for Maori learners. It is based on a set of underlying principles identified in the author's PhD study (Bevan-Brown, 2002). Explanations are provided for eight principles: kaupapa Maori; importance, relevance and beneficence; participation; empowerment,…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

In 1996, United Way of America (UWA) developed and began disseminating the most widely used approach to program outcome measurement in the nonprofit sector. Today an estimated 450 local United Ways encourage approximately 19,000 local agencies they fund to measure outcomes. The authors first describe and then assess the strengths and limitations…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

Two program goals were: (1) providing a community-based alternative for arrested juveniles who otherwise would have been referred to the juvenile justice system; and (2) reducing juvenile delinquency. Results from various measures indicated the program had little success in decreasing referrals but produced positive delinquency reduction effects.…