In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

Preschool classrooms generate a host of data that can be used to inform program improvement. This article suggests ways to document child-level data and mentoring protocols in a way that makes the information usable to teachers and can positively influence child outcomes.

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Higher education experts tout learning outcomes assessment as a vehicle for program improvement. To this end the authors share a rubric designed explicitly to evaluate the quality of assessment and how it leads to program improvement. The rubric contains six general assessment areas, which are further broken down into 14 elements. Embedded within…

This commentary highlights the work of the Collaborative for Building After-School Systems (CBASS), a collaborative of mature, city and county-wide nonprofit OST intermediaries, to develop and adopt common youth-, program- and system-level measures that are easy and cost-effective for local systems to implement. By agreeing to adopt and publicly…

With a focus on the use of technology when evaluating programs for Aboriginal people, this article explores the possibility of using visual and oral computer technology to enhance the incorporation of Aboriginal worldviews in program evaluation. The author situates Aboriginal worldviews, including methods of communication and transmission of…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

A successful data collection system used to gather evaluative information about agricultural technician programs involves five components: an enrollee's report, second year student report, survey of early leavers, employer's report of graduates, and a graduate survey. A schematic diagram of the data collection process is included. (KP)

Strengths and weaknesses of prevailing evaluation models are analyzed, with attention to the role of feedback in each paradigm. A framework is then presented for analyzing issues faced by evaluators of interactive instructional technologies. The current practice of evaluation relies heavily on 3 models developed over 20 years ago: (1) the…

A collaborative publication between Harvard Family Research Project and The Finance Project, this brief offers guidance in documenting progress and demonstrating results in local out-of-school-time programs. Following introductory remarks providing a rationale for program evaluation, discussing principles of program evaluation, and clarifying key…

Discusses associations between levels of service point use, population information and library inputs, based on data from two London boroughs in respect of individual static service points. Outlines methods of deriving catchment area data using membership information or postcode data from a user survey. Describes a method for librarians seeking to…

Ethical issues relating to naturalistic evaluation are addressed, focusing on the role of the evaluator, problems of privacy and data gathering techniques, and issues relating to the use/abuse of findings. Benefits and costs of the naturalistic approach to program evaluation are also identified. (EGS)

This handbook presents a secondary program evaluation system to improve the quality of Oregon state-approved, secondary vocational education programs. Section 1 describes this evaluation system. It discusses the three levels of evaluation. The design includes provisions for review of Oregon minimum standards, federal and state vocational education…

This guide provides an outline of the components necessary in a written evaluation plan for vocational education programs. The four components that a plan for evaluation should include are described. The first component, the specific goals of the evaluation process, is divided into these two sections determined by the type of evaluation conducted:…

This evaluation plan outlines the essential features of Home Start Evaluation activities scheduled for the twelve months beginning Fall 1973. Data will be collected in an effort to answer the following four questions: (1) Are Home Start program guidelines being followed in the kinds of families and staff involved?, (2) Do families in Home Start…