This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

Randomized controlled trials are not always feasible in educational research, so researchers must use alternative methods to study treatment effects. Propensity score matching is one such method for observational studies that has shown considerable growth in popularity since it was first introduced in the early 1980s. This paper outlines the…

Low motivation to perform well on a test is a potentially problematic source of construct-irrelevant variance (Messick, 1980), especially when there are low or no stakes attached to performance. That is, interpretations of test scores as indicators of students' knowledge and skills may be compromised if those students do not put forth the effort…

In this paper, I assess labor market returns of a substantial skill upgrade: college enrollment of the vocationally trained, non-traditional students who do not have the formal entry requirement. Using propensity-score-adjusted regressions and the National Educational Panel Study, I find that these enrollees face high opportunity costs as they…

Purpose: This paper aims to introduce matching in propensity score analysis (PSA) as an alternative statistical approach for researchers looking to make causal inferences using intact groups. Design/methodology/approach: An illustrative example demonstrated the varying results of analysis of variance, analysis of covariance and PSA on a heuristic…

The climate in college admissions is more competitive than ever, making understanding the college choice factors that contribute to a student's enrollment decision increasingly important. Using admitted student data from a liberal arts institution in the northeast for fall 2008 to fall 2011, and after controlling for student preparedness,…

In the UK, students who want to progress to higher education have a number of possible pathways at age 16. The most common of these is traditional, academic focussed, 'A' levels, but increasingly students are taking alternative qualifications (e.g. BTECs, IB, Pre-U). The focus of this research is to infer which (if any) of these qualifications are…

When randomized experiments are infeasible, quasi-experimental designs can be exploited to evaluate causal treatment effects. The strongest quasi-experimental designs for causal inference are regression discontinuity designs, instrumental variable designs, matching and propensity score designs, and comparative interrupted time series designs. This…

When is the right moment to transition an English learner student from part-time participation in English language development classes into full-time participation in mainstream English-only classes? English learner students should be moved into full-time mainstream English-only classes when they are sufficiently fluent in English to be able to…

Most formative assessments rely on the performance status of a student at a particular time point. However, such a method does not provide any information on the "propensity" of the student to achieve a predetermined target score or whether the student is performing as per the expectations from identical students with the same history of…

This study employed a Multi-Attribute Utility (MAU) model to examine the Pap test decision-making process among Pacific Islanders (PI) residing in Southern California. A total of 585 PI women were recruited through social networks from Samoan and Tongan churches, and Chamorro family clans. A questionnaire assessed Pap test knowledge, beliefs and…

Middle school math placement and progression are topics that are part of an active policy and practice discussion in California and elsewhere. Beginning in the 2008/09 school year, California's State Board of Education recommended that students complete algebra I by the end of grade 8. Between 2003 and 2009 the proportion of grade 8 students…

Over several years, Clark Pleasant Community School Corporation (CPCSC) schools have dedicated significant professional development hours and time to develop Essential Learnings (ELs) along with proficiency scales that could guide the content of classroom assessments used to determine student mastery. This report presents findings from statistical…

With an increase in the number of online tests, interruptions during testing due to unexpected technical issues seem unavoidable. For example, interruptions occurred during several recent state tests. When interruptions occur, it is important to determine the extent of their impact on the examinees' scores. There is a lack of research on this…

Magnet schools are one of the largest sectors of choice schools in the United States. In this study, we explored the heterogeneity in magnet-school effects on student achievement by examining 24 magnet schools, funded under the Magnet Schools Assistance Program (MSAP), in 5 school districts across 4 states. The magnet effects were synthesized…