This study develops an SDG-aligned social impact assessment (SIA) system for five Chulalongkorn University research projects, in Thailand. Employing mixed methods in an exploratory sequential design, the first phase involves qualitative data collection, including focus groups and field studies, to establish the SIA system. The second phase employs…

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for…

The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…

Harvard Family Research Project's series of Out-of-School Time Evaluation Snapshots distills the wealth of information compiled in our Out-of-School Time Program Evaluation Database into a single report. Each Snapshot examines a specific aspect of out-of-school time (OST) evaluation. This Snapshot describes the common data collection methods used…

Analysis of teachers' questions, part of the ORACLE (Observation Research and Classroom Learning Evaluation) project research, is examined in detail. Scarth and Hammersley argue that the rules ORACLE uses for identifying different types of questions involve levels of ambiguity and inference that threaten reliability and validity of the study's…

Guidelines for conducting departmental reviews are presented to help review panels, departments being reviewed, and administrators. In planning a review, the following considerations are important: the purpose of the review and the terms of reference, the organization of the review and who will conduct it, and the information that will be…

Trends in European practice that relate to qualitative assessment in the evaluation of the impact of research and innovation are discussed and analyzed. To date, European evaluations have been mainly concerned with quality and direct impact with few assessments of medium- or long-term impact. (SLD)

The 1966-67 Towson Undergraduate Research Training Program consisted of: (1) three 4-credit hour courses in the basic concepts of measurement, experimental design, and data analysis; (2) a 4-credit hour course in the research literature of education; (3) a 6-credit hour research practicum in the summer session; and (4) a colloquium series,…

This report presents findings from the first phase of a study by the Research Center of the Child Welfare League of children receiving service in their homes, the nature of the service and its outcome. This initial phase related to factors associated with the choice of own home service or placement for children on whose behalf service was sought…

The extreme variability of the 50 projects under the NIE Program to Increase the Participation of Minorities and Women in Educational Research and Development necessitates an evaluation design that is flexible enough to accomodate significant differences in project characteristics, yet comprehensive enough to allow meaningful aggregation of…

This essay focuses on a key change that the author has experienced in the practice of program evaluation research over the past 20 years: the accommodation of the logic of science and the psychology of politics. This change has substantially altered the role of the evaluator, the evaluator's relationship with clients, the design of an evaluation…

The technical report documents the methodology of a study reviewing the vocational research and exemplary projects in Oregon, so that successful projects or products may be accessible for transportability to other environments. The three stages of research were: (1) Data collection of information on practices, (2) selection of promising practices,…

Four major component areas of the Hazard (Kentucky) Educational Region were sampled using questionnaires, tests, and interviews in an effort to assess the effects of a regional career education program. The community component, randomly selected to achieve a five percent representative sample, was examined for major variables associated with the…

In this working paper and executive summary, focus is on procedures to be used in cost-effectiveness studies of the University of Mid-America/State University of Nebraska (UMA/SUN) delivery system of open learning. Two major questions are addressed: Should cost-effectiveness studies be undertaken, and if so, what kind of studies? The planning…

The objectives of the state-of-the-art paper, second in a series on farming systems research (FSR) in the Third World, are to: (1) review the literature on farming systems; (2) evaluate farming systems research in international institutes and in national agricultural research systems in the Third World; and (3) recommend what can be done to…