The purpose of this article is to describe a 40+ year journey during which researchers have endeavored to design and evaluate an integrated, empirically based reading intervention for secondary students and to chronicle the lessons learned as well as suggest future directions for this type of work. Initial development of the intervention began in…

In this paper we describe a "Train the Tutor" programme (TtT) for developing the metacognitive skills, facilitator skills, and tutor skills of students in a problem based learning (PBL) context. The purpose of the programme was to train 2nd and 3rd year undergraduate students in psychology to become effective PBL tutors for…

The effectiveness of a peer-mentoring program was examined at a university in California. Previous studies suggest university peer mentoring might increase students' feelings of engagement, which can contribute to their retention. Pretest and posttest data were collected from 304 freshmen (mentored and nonmentored) during the fall of 2012 in a…

The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in…

Purpose: Chinese people generally lack knowledge of mental illness. Such phenomenon may lead to a delay in seeking psychiatric treatments. This study evaluated the effectiveness of Mental Health First Aid (MHFA) program in improving mental health knowledge of the general public in Hong Kong. Methods: A quasi-experimental design was adopted whereby…

Randomized experiments are often seen as the "gold standard" for causal research. Despite the fact that experiments use random assignment to treatment conditions, units are seldom selected into the experiment using probability sampling. Very little research on experimental design has focused on how to make generalizations to well-defined…

The impact of Cognitive Coaching? included as part of the Leader2Leader (L2L) Leadership Pilot Program for beginning principals in Alberta, Canada, was evaluated in the present study. Fifteen qualified principals (coaches) and 23 new principals completed the L2L Pilot Program that took place over 18 months. Questionnaires for coaches and new…

Background: Afterschool programs (ASPs) in the United States have been implemented in low income neighborhoods to enable at-risk youth to access educational support services to increase academic skills. However, mixed findings about the ASPs positively affecting academic performance suggests a need for additional evaluative studies. Objective: The…

Objective: Suicide remains a pressing issue for college communities. Consequently, gatekeeper trainings are often provided for staff. This study examines the effect of one such program, Applied Suicide Intervention Skills Training (ASIST). Participants: 51 college employees received ASIST in August of 2014 and were compared to 30 wait-list control…

To answer "what works?" questions about policy interventions based on an experimental design, Peck (2003) proposes to use baseline characteristics to symmetrically divide treatment and control group members into subgroups defined by endogenously determined postrandom assignment events. Symmetric prediction of these subgroups in both…

The article evaluates a Czech environmental education program focused on developing competence in issue investigation. In the evaluation, a simple quasi-experimental design with experimental (N = 200) and control groups was used. The results suggest that the program had a greater impact on girls than on boys, and that it increased their internal…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

In response to strikingly low completion rates in public 2-year colleges, including for students who are well-prepared academically, most community colleges across the country offer student success courses as one approach to improving outcomes for students. Some colleges have begun to revise these courses in response to research indicating that…

We report on an effectiveness evaluation of the Youth Empowerment Solutions (YES) program. YES applies empowerment theory to an after-school program for middle school students. YES is an active learning curriculum designed to help youth gain confidence in themselves, think critically about their community, and work with adults to create positive…