The present simulation study examined the statistical properties (namely, Type I error and statistical power) of various novel randomized single-case multiple-baseline designs and associated randomized-test analyses for comparing the A- to B-phase immediate abrupt outcome changes in two independent intervention conditions. It was found that with…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

This study develops a general method for modeling changes in response to items relating to students perceptions of personal finance and financial products. The new method is illustrated to analyze data from a sample of 1,250 students aged 16-18 who participated in a financial capability education study in the UK. We demonstrate how a quantitative…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

Making causal inferences from a quasi-experiment is difficult. Sensitivity analysis approaches to address hidden selection bias thus have gained popularity. This study serves as an introduction to a simple but practical form of sensitivity analysis using Monte Carlo simulation procedures. We examine estimated treatment effects for a school-based…

A large number of approaches have been proposed for estimating and testing the significance of indirect effects in mediation models. In this study, four sets of Monte Carlo simulations involving full latent variable structural equation models were run in order to contrast the effectiveness of the currently popular bias-corrected bootstrapping…

Family Rewards was an innovative approach to poverty reduction in the United States that was modelled on the conditional cash transfer (CCT) programs common in lower- and middle-income countries. The program offered cash assistance to poor families to reduce immediate hardship, provided they met certain criteria related to family health care,…

Researchers have become increasingly interested in programs' main and interaction effects of two variables (A and B, e.g., two treatment variables or one treatment variable and one moderator) on outcomes. A challenge for estimating main and interaction effects is to eliminate selection bias across A-by-B groups. I introduce Rubin's causal model to…

Interest in variation in program impacts--How big is it? What might explain it?--has inspired recent work on the analysis of data from multi-site experiments. One critical aspect of this problem involves the use of random or fixed effect estimates to visualize the distribution of impact estimates across a sample of sites. Unfortunately, unless the…

This 3-year study evaluated the effectiveness of the Second Step-Student Success Through Prevention (SS-SSTP) social-emotional learning program on increasing prosocial behaviors that could serve as protective factors against peer conflict and bullying among students with disabilities. Participants included 123 students with disabilities across 12…

Regression mixture models, which have only recently begun to be used in applied research, are a new approach for finding differential effects. This approach comes at the cost of the assumption that error terms are normally distributed within classes. This study uses Monte Carlo simulations to explore the effects of relatively minor violations of…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

The persistently low college enrollment and completion rates of youth from poor families are partly attributable to their uncertainty about whether college is affordable. In the current system, concrete information about college costs arrives at the end of high school and is only available to those who complete a complex application. Evidence…

Most physical education intervention studies on the positive effect of sports on self-concept development have attempted to "increase" schoolchildren's self-concept without taking the "veridicality" of the self-concept into account. The present study investigated whether a 10-week intervention in physical education would lead…