Rapidly declining response rates and the associated threat of nonresponse bias call into question the validity of data obtained through telephone surveys, a tool often used in evaluation. This article explores changes in nonresponse bias over time by examining three data points (1991, 1996, and 2002) from an annual household telephone survey…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

This response to TM 505 708 briefly reviews the five major points of that article, and adds seven points that evaluators should consider when preparing reports. Illustrations are taken from Project Follow Through. (BW)

Design, analysis, and reporting considerations for the application of analysis of covariance (ANCOVA) techniques in educational settings are described. Numerous examples are drawn from the national follow through evaluation, and suggestions for improving reports using ANCOVA-type techniques are presented. (Author/BW)

A Friedman Foundation report attempts to find empirical support for the contention that competition from private schools, through voucher programs, improves the effectiveness of public schools. In the first year of Ohio's new EdChoice voucher program, the report claims to have found substantial academic gains at public schools exposed to the…

This paper reviews both the content and the methodological issues involved in the small but growing number of empirical studies on the use of Direct Instruction programs and teaching procedures with special populations. The research reviewed includes experimental and quasi-experimental work, summative evaluations of entire programs, and…

The difficulties in evaluating bilingual education appear to have prevented success in all but a few evaluation attempts, but better and more meaningful evaluation is neccessary in order to identify the strengths and weaknesses of bilingual programs. Many bilingual programs are undergoing constant modification, adequate assessment instruments have…

In evaluation research studies, it often occurs that several program participants (experimentals) drop out of the program prior to completion. Since noncompleters generally differ substantially from completers in many respects, a control group which originally was representative of the participant group will most likely not be representative of…

Studied efficiency differences in Finnish senior secondary schools by Data Envelopment Analysis, using four variant models. Average efficiencies in the most extensive models were 82% to 84%. Considering parents' educational level increased average efficiency to 91%. Tobit analysis showed school size did not affect efficiency. Input and output…

Program evaluation research, including reputational studies and studies based on objective indicators, and research on the quantitative correlates of program quality are reviewed. Reputational studies, which have dominated research on program quality in higher education, emphasize peer evaluation. Some major reputational studies of graduate…

There is a continuing need in evaluation research for the establishment of a relationship between evaluation findings and decision making. A method is proposed for a particular situation: annual funding decisions for projects in a large grant program in vocational education. Outcome and predictive impact variables were ranked by three groups of…

Research in social psychology will be more useful to society if researchers incorporate evaluation research into their inquiries. Evaluation research is interpreted to include overall assessment of a program or project as well as methodological procedures used to assess implementation and outcome of social and cultural action programs.…

The original version of this report dealt with the feasibility of a longitudinal design for studying the effects of preceptorships on medical students' career choices. The present document supplements the original report, focuses on various non-longitudinal designs, and assesses their suitability for providing the type of information required for…