This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

To demonstrate the sequential nature of the college application process, in this paper I analyze the evolution of applications among high-achieving low-income students through data on the exact timing of SAT score sends. I describe at what point students send scores to colleges and which score sends ultimately become applications, resulting in…

Bayesian Knowledge Tracing (BKT) is a commonly used approach for student modeling, and Long Short Term Memory (LSTM) is a versatile model that can be applied to a wide range of tasks, such as language translation. In this work, we directly compared three models: BKT, its variant Intervention-BKT (IBKT), and LSTM, on two types of student modeling…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

Purpose: The purpose of the study was to investigate the individuals' dynamics of perceived control and hedonic tone over time, with respect to the 4 performance states as conceptualized within the multiaction plan (MAP) model. We expected to find idiosyncratic and differentiated trends over time in the scores of perceived control and hedonic…

Recently, researchers have begun to employ rigorous statistical methods and developmentally-informed theories to evaluate outcomes for students retained in non-kindergarten early elementary school. However, the majority of this research focuses on academic outcomes. Gaps remain regarding retention's effects on psychosocial outcomes important to…

The study examined the reasoning skills of first year high school students after learning general science concepts through analogies. Two intact heterogeneous sections were randomly assigned to Analogy-Enhanced Instruction (AEI) group and Non Analogy-Enhanced (NAEI) group. Various analogies were incorporated in the lessons of the AEI group for…

Recently, the authors have been exploring the use of propensity score methods for developing evidence of program impact. Specifically, they have been developing evidence (after one year of implementation) of the effects of the Math Science Partnership in New York City ("MSPinNYC2") on high school students' achievement--both in terms of…

This dissertation examines the college experience of traditional-age community college students. The objectives of this dissertation are threefold. To explain early exits from higher education, the first manuscript integrates Tinto's interactionalist theory and Coleman's theory of social capital to describe the mechanisms through which…

This study examined the impact on student academic performance of referrals for disciplinary intervention in West Virginia. The study also examined differences in these impacts among various student subgroups. Using discipline referral data entered into the West Virginia Education Information System for the 2012-2013 school year and employing…

A recent NBER [National Bureau of Economic Research] working paper examines Florida's policy to retain many low-scoring third graders. The report concludes that third-grade retention has immediate positive effects on the following year's test results, but these effects fade over the next six years, with no effect on graduation. The regression…

Community colleges are a crucial channel for achieving postsecondary education success, especially for minority and nontraditionally aged students. Nonetheless, community colleges are inadequate to meeting national goals for postsecondary educational attainment. Most notably, the lack of a strong guidance of academic interventions stifles a…

This study presents evidence pertinent to current debates about the lasting impacts of early childhood educational interventions and, specifically, Head Start. A group of students who were first studied to examine the immediate impacts of the Tulsa, Oklahoma, Community Action Project (CAP) Head Start program were followed-up in middle school,…

Mediation analysis uses measures of hypothesized mediating variables to test theory for how a treatment achieves effects on outcomes and to improve subsequent treatments by identifying the most efficient treatment components. Most current mediation analysis methods rely on untested distributional and functional form assumptions for valid…

Plagiarism appears to be a common problem among college students, yet there is little evidence on the effectiveness of interventions designed to minimize plagiarism. This study presents the results of a field experiment that evaluated the effects of a web-based educational tutorial in reducing plagiarism. We found that assignment to the treatment…