The purpose of this article is to describe a 40+ year journey during which researchers have endeavored to design and evaluate an integrated, empirically based reading intervention for secondary students and to chronicle the lessons learned as well as suggest future directions for this type of work. Initial development of the intervention began in…

The effectiveness of a peer-mentoring program was examined at a university in California. Previous studies suggest university peer mentoring might increase students' feelings of engagement, which can contribute to their retention. Pretest and posttest data were collected from 304 freshmen (mentored and nonmentored) during the fall of 2012 in a…

The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in…

Purpose: Chinese people generally lack knowledge of mental illness. Such phenomenon may lead to a delay in seeking psychiatric treatments. This study evaluated the effectiveness of Mental Health First Aid (MHFA) program in improving mental health knowledge of the general public in Hong Kong. Methods: A quasi-experimental design was adopted whereby…

Randomized experiments are often seen as the "gold standard" for causal research. Despite the fact that experiments use random assignment to treatment conditions, units are seldom selected into the experiment using probability sampling. Very little research on experimental design has focused on how to make generalizations to well-defined…

Background: Afterschool programs (ASPs) in the United States have been implemented in low income neighborhoods to enable at-risk youth to access educational support services to increase academic skills. However, mixed findings about the ASPs positively affecting academic performance suggests a need for additional evaluative studies. Objective: The…

The impact of Cognitive Coaching? included as part of the Leader2Leader (L2L) Leadership Pilot Program for beginning principals in Alberta, Canada, was evaluated in the present study. Fifteen qualified principals (coaches) and 23 new principals completed the L2L Pilot Program that took place over 18 months. Questionnaires for coaches and new…

Objective: Suicide remains a pressing issue for college communities. Consequently, gatekeeper trainings are often provided for staff. This study examines the effect of one such program, Applied Suicide Intervention Skills Training (ASIST). Participants: 51 college employees received ASIST in August of 2014 and were compared to 30 wait-list control…

To answer "what works?" questions about policy interventions based on an experimental design, Peck (2003) proposes to use baseline characteristics to symmetrically divide treatment and control group members into subgroups defined by endogenously determined postrandom assignment events. Symmetric prediction of these subgroups in both…

The article evaluates a Czech environmental education program focused on developing competence in issue investigation. In the evaluation, a simple quasi-experimental design with experimental (N = 200) and control groups was used. The results suggest that the program had a greater impact on girls than on boys, and that it increased their internal…

In response to strikingly low completion rates in public 2-year colleges, including for students who are well-prepared academically, most community colleges across the country offer student success courses as one approach to improving outcomes for students. Some colleges have begun to revise these courses in response to research indicating that…

Much is known about short-term--but very little about the long-term--effects of reading interventions. To rectify this, a detailed analysis of follow-up effects as a function of intervention, sample, and methodological variables was conducted. A total of 71 intervention-control groups were selected (N = 8,161 at posttest) from studies reporting…

Colleges and universities commonly implement first-year seminars to support new students during the challenging and formative first semester. These programs are widely regarded as highly effective in promoting student persistence through the first year and beyond. However, attention on the indirect outcome of persistence as the primary measure of…

Online instructional videos are becoming increasingly common within education. This study adopts a quasi-experimental 2 × 2 crossover design (control and experimental groups) to evaluate the efficacy of instructional videos to teach practical rehabilitation skills. The students performed practical sessions in class and were formatively assessed by…