Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its…

The main purpose of this study is to fill a substantial knowledge gap regarding reaching a uniform group decision in English curriculum design and planning. A comprehensive content-based course criterion model extracted from existing literature and expert opinions was developed. Analytical hierarchy process (AHP) was used to identify the relative…

Character education is supposed to meet early adolescents' need (i.e., eighth and ninth graders) for strengthening social competence. Moreover, adolescents' engagement in character education is integral to their learning from the education. The engagement and deficit in social competence are therefore plausible conditions for the effectiveness of…

There exist an increasing number of studies that demonstrate the necessity to evaluate the processes which characterize a program and guarantee its implementation and evaluation. This paper deals with the implementation of a program designed to improve the acculturation of immigrant families in Spain (EU). Implementation followed a process that…

In 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students' knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the…

The distinction between experimental evaluation (which employs generalizable analyses of discrete causes and effects) and contextual evaluation (which examines particular program operations holistically) is articulated. Program characteristics are examined and linked to experimental and contextual models of program evaluation. (Author/MH)

Reviews two books that are representative of the substantive books aimed at those who wish to design effective distance learning. Together these books provide a reasonably complete perspective on how to design effective distance learning. They have many strengths, and few weaknesses. (SLD)

Evaluating school-based mental health services for children and youth with emotional disturbance (ED) has been a challenge for researchers. One particular challenge is the study design of using the student as the statistical unit of analysis, which in certain cases may lead to a violation of the "independence of error" assumption.…

The Combined Modified Design is presented to overcome problems of internal and external validity in the conduct of true experiments in longitudinal studies. It combines a modified version of the Randomized Invitation Design with the lottery longitudinal experimental field trial situation. (SLD)

Reports on the use of the tailored design method (TDM) to achieve high survey response in two separate studies of the dissemination of Treatment Improvement Protocols (TIPs). Findings from these two studies identify six factors may have influenced nonresponse, and show that use of TDM does not, in itself, guarantee a high response rate. (SLD)

Little is known about effective eHealth recruitment methods. This paper presents recruitment challenges associated with enrolling African-American girls aged 8-10 years in an eHealth obesity prevention program, their effect on the recruitment plan, and potential implications for eHealth research. Although the initial recruitment strategy was…

Provides the conceptual framework for the Treatment Improvement Protocols (TIPs) evaluation project, using the diffusion of innovations theory as the theoretical foundation to understand and assess the development of TIPs. Summarizes principles of diffusion theory, and discusses how the model was used to structure the TIPs studies. (SLD)

Microcomputer-based imaging technology reestablishes the direct link between evaluation and environmental design by allowing evaluators and urban designers to visually explore and evaluate alternative simulations of design proposals. Microcomputer hardware and software requirements and the use of imaging technology at the university level are…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

Several recent studies are identified that used expert ratings of the job performance of certified professionals as a validation criterion. These studies showed a strong relationship between expert ratings and certification, but were susceptible to alternative interpretations due to design constraints. Inclusion of control constructs is presented…