Introduction: Rating the quality of a body of evidence is an increasingly common component of research syntheses on intervention effectiveness. This study sought to identify and examine existing systems for rating the quality of a body of evidence on the effectiveness of health and social interventions. Methods: We used a multicomponent search…

The National Reporting System (NRS) is the accountability system for the federally funded, State-administered adult education program. It addresses the accountability requirements of the Adult Education and Family Literacy Act, Title II of the Workforce Investment Act (WIA-P.L.105-220). This document presents (1) the NRS measures that allow…

Programme evaluation is essential for quality assurance in education. In this paper, we describe our evaluation strategy for the first year of a new medical programme. Although we used multiple methods in the evaluation, the use of the focus group method was core. This paper reports our experiences of focus groups for this purpose. We describe the…

Key stakeholders who implement Supported Education may find themselves asking two questions: (1) Has Supported Education been implemented as planned?; and (2) Has Supported Education resulted in the expected outcomes? Asking these two questions and using the answers to help improve Supported Education are critical for ensuring the success of one's…

While research on program effectiveness offers ample evidence that afterschool programs can benefit young people in a variety of ways, this same body of research demonstrates that not all programs are equally effective (Granger, 2008). Some programs show positive results in many or all major outcome categories. Other programs are associated with…

The evaluation of educational or social programmes is paramount for establishing success or impact in higher education. Evaluation questions about programme goals (e.g. better performance of first-year students) or about the quality of programme strategies (design and implementation) and effectiveness of delivery (coordinator inputs and…

In an increasingly competitive economy, the capacity for self-motivation, problem-solving skills and an ability to think critically are core graduate attributes. However, the capacity to create an educational environment that develops and harnesses such skills is a distinct challenge as resources become increasingly restricted. Geographical Skills…

This report is a product of an European Association for Quality Assurance in Higher Education (ENQA) Workshop "Assessing educational quality: Knowledge production and the role of experts" hosted by the Norwegian Agency for Quality Assurance in Education (NOKUT) in Oslo in February, 2008. The workshop gathered representatives from higher…

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Program reviews became widely used as quality assurance activities in the United States beginning in the 1970s. Since then, they have evolved as an essential component in demonstrating institutional effectiveness to accrediting bodies. The paper discusses various approaches to reviews with a focus on a recently reengineered institutional program…

The dilemma inherent in formal standards results from the tension between maintaining quality control and constraining creativity. This dilemma is nowhere more apparent than in matters of method: measurement, sampling, research design, and statistical analysis. The author offers suggestions for revision of the standards to allow for specific…

Review of methodology for assessing the employment "success" of higher education graduates finds that graduate and employer surveys generally to do not serve this purpose well. It finds, however, that despite substantial methodological problems, institutions can implement expert guidance to obtain targeted feedback related to…

Recent evaluations and research syntheses of afterschool programs rated as high quality show they are associated with increases in student achievement and other positive socio-behavioral outcomes (Lauer et al., 2006; Vandell, Reisner, & Pierce, 2007). Those examinations provide a springboard for the next much-needed area of…

This article presents the methodology used by the Finnish Education Evaluation Council in the national evaluation of social and communication skills in vocational education and training. The evaluation concentrates on key competences such as learning-to-learn skills, communication skills, social skills and entrepreneurship (Implementation of…

This issue of "The Evaluation Exchange" focuses on out-of-school time (OST). Several authors provide insights into how they, and others, are tackling measurement issues, from using technology and data systems to collect information and track progress, to applying lessons learned from developing early childhood quality measures. Other authors…