This article presents the analysis of evaluation methods used in a well-designed and comprehensive evaluation effort of a significant Extension program. The evaluation data collection methods were analyzed by questionnaire mode and timing of follow-up surveys. Response rates from the short- and long-term follow-ups and different questionnaire…

"FRIENDS for Life" is a cognitive behavioural therapy (CBT) programme which aims to reduce anxiety and promote resilience among children. This study evaluated the "FRIENDS for Life" (FRIENDS) programme used as an intervention for seven children between the ages of 10 and 11 presenting with high functioning autism spectrum…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

In the context of intensifying accountability for academic work internationally, there are increasing pressures on individual supervisors, departments and universities to evaluate the quality of doctoral supervision. Existing evaluation tools are focused at departmental rather than individual level and are mostly quantitative. Evaluation for…

This is the first of two reports that summarize the findings from an impact evaluation of a violence prevention intervention for middle schools. This report discusses findings after 1 year of implementation. A forthcoming report will discuss the findings after 2 years and 3 years of implementation. In 2004, the U.S. Department of Education (ED)…

The 307 schools funded by the Ohio Venture Capital program were the focus of a study on teacher empowerment. This paper focuses on the method used to maximize survey responses, rather than on the study findings. Data were sought from the building principals and 10,544 classroom teachers to create a "total picture" of the individual…

This report summarizes the findings of the pilot administration of the Colorado Survey of first- and third-year teachers and their administrators. These surveys reflect the opinions of the teachers and administrators regarding the effectiveness of Colorado teacher preparation institutions in preparing teachers to meet performance-based standards.…

The seven articles of this special issue focus on theory and research related to survey methods and whether evaluators need information that is absent from the larger survey literature. These articles reflect the view that the considerations relating to good survey research apply also to using surveys in evaluation. (SLD)

This article reviews issues in questionnaire design beyond the creation of standardized questions and basic data collection rules. The use of magnitude scales, the application of decision theory, and the use of a questionnaire framework that replicates how choices are made by respondents are among the new design approaches discussed. (SLD)

This manual is designed to aid the user in measuring consumer satisfaction with vocational rehabilitation services. The manual contains materials which were used by the West Virginia Research and Training Center in a followup study. Step-by-step guidelines are provided for assessing the effectiveness of vocational rehabilitation services by…

The concept of "preevaluative research" is examined in the context of a museum exhibition evaluation. It is viewed as distinct from an evaluability assessment. The exhibit preevaluative study indicates that instrumentation and implementation issues are likely to benefit from such activities, but that design and analysis may suffer.…

Parents and guardians of children in the Indianapolis Public Schools' Montessori Option Program for kindergartners through sixth graders were surveyed. Parents and guardians were surveyed on: (1) the pupil progress report, which was used on a pilot basis during the 1988-89 school year; (2) the Montessori method; (3) strengths and weaknesses of the…

This replication handbook describes procedures and provides instruments which educators can use to assess sex equity in their own settings. It has two major parts: (1) appendixes that provide copies of data collection materials developed during the Vocational Education Equity Study (interview forms for state directors, state agency personnel,…