We examine the effect of an integrity pilot campaign on undergraduates' behavior. As with many costly small-scale experiments and pilot programs, our statistical inference has to rely on small sample size. To tackle this issue, we perform a Bayesian retrospective power analysis. In our setup, a lecturer intentionally makes mistakes that favors…

Multisite trials, which are being used with increasing frequency in education and evaluation research, provide an exciting opportunity for learning about how the effects of interventions or programs are distributed across sites. In particular, these studies can produce rigorous estimates of a cross-site mean effect of program assignment…

Using a case study of London Zoo's BUGS (Biodiversity Underpinning Global Survival) exhibit, this article assesses the role of experiential learning in raising biodiversity knowledge, concern and potential pro-conservation actions. Using Personal Meaning Mindmapping, a novel method in visitor research, the study examines how adult visitors relate…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

A large number of approaches have been proposed for estimating and testing the significance of indirect effects in mediation models. In this study, four sets of Monte Carlo simulations involving full latent variable structural equation models were run in order to contrast the effectiveness of the currently popular bias-corrected bootstrapping…

This ex-post-facto quasi-experimental research design was conducted by selecting a convenient sample of approximately 2,000 3rd grade ELLs who took the regular reading and math English STAAR test during the 2014-15 school year in an urban southern Texas school district. This study was conducted using a quantitative research method of data…

Early childhood education programs play an important role in child family-to-school transition. In 1998, California voters passed Proposition 10, the California Children and Families Act, which levied a 50-cent tax on each pack of cigarettes and other tobacco products to finance programs for children ages 0-5. In less than two decades, First 5…

We study a popular dual enrollment program in Washington State, "Running Start" using a new administrative database that links high school and postsecondary data. Conditional on prior high school performance, we find that students participating in Running Start are more likely to attend any college but less likely to attend four-year…

We study a popular dual enrollment program in Washington State, "Running Start" using a new administrative database that links high school and postsecondary data. Conditional on prior high school performance, we find that students participating in Running Start are more likely to attend any college but less likely to attend four-year…

This report summarizes the research activities and findings from the Teaching and Learning Research Initiative (TLRI)-funded project conducted in Year 13, introductory university and workplace classes, entitled "'Bootstrapping' Statistical Inferential Reasoning". The project was a 2-year collaboration among three statisticians, two…

This paper explores the impact on teachers' self-efficacy to teach statistics from a graduate course aimed to develop teachers' knowledge of inferential statistics through engaging in data analysis using technology. This study uses qualitative and quantitative data from the Self-Efficacy to Teach Statistics Survey (Harrell-Williams et al., 2013)…

This paper summarizes results from a math intervention implemented in a high-poverty urban community. Over 7,300 students from kindergarten to 4th grade in 1 low-socioeconomic-status school district participated in the study. Students from 13 different schools (36 different classroom) participated in the treatment. Comparisons were made to…

This article reports the results of a quantitative matching study investigating the impact on first-year students of a two-semester learning community. Results indicate a statistically significant association between LEAP participation and academic performance measured by retention, GPA, and time to graduation. Participation was associated with…

This report examines the differences in impact estimates and standard errors that arise when these are derived using state achievement tests only (as pre-tests and post-tests), study-administered tests only, or some combination of state- and study-administered tests. State tests may yield different evaluation results relative to a test that is…

A dramatic shift in research priorities has recently produced a large number of ambitious randomized trials in K-12 education. In most cases, the aim is to improve student academic learning by improving classroom instruction. Embedded in these studies are theories about how the quality of classroom must improve if these interventions are to…