This study investigated the power of two-level hierarchical linear modeling (HLM) to explain variability in intervention effectiveness between participants in context of single-case experimental design (SCED) research. HLM is a flexible technique that allows the inclusion of participant characteristics (e.g., age, gender, and disability types) as…

Researchers interested in studying the frequency of events or behaviors among a population must rely on count data provided by sampled individuals. Often, this involves a decision between live event counting, such as a behavioral diary, and recalled aggregate counts. Diaries are generally more accurate, but their greater cost and respondent burden…

This study introduces an innovative meta-analytic approach, two-stage multilevel meta-analysis that considers the hierarchical structure of single-case experimental design (SCED) data. This approach is unique as it is suitable to include moderators at the intervention level, participant level, and study level, and is therefore especially…

Recently, researchers have used multilevel models for estimating intervention effects in single-case experiments that include replications across participants (e.g., multiple baseline designs) or for combining results across multiple single-case studies. Researchers estimating these multilevel models have primarily relied on restricted maximum…

Purpose: Bayesian multilevel models are increasingly used to overcome the limitations of frequentist approaches in the analysis of complex structured data. This tutorial introduces Bayesian multilevel modeling for the specific analysis of speech data, using the brms package developed in R. Method: In this tutorial, we provide a practical…

It is common to include multiple dependent variables (DVs) in single-case experimental design (SCED) meta-analyses. However, statistical issues associated with multiple DVs in the multilevel modeling approach (i.e., possible dependency of error, heterogeneous treatment effects, and heterogeneous error structures) have not been fully investigated.…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…

This article investigates the relationship between state-level marijuana policies and drug and alcohol violations in on-campus housing. A review of trends in drug usage precedes discussion of a conceptual framework that can help explain how interactions between college and university student housing and state policy impacts student behavior.…

Assessment instruments composed of two-tier multiple choice (TTMC) items are widely used in science education as an effective method to evaluate students' sophisticated understanding. In practice, however, there are often concerns regarding the common scoring methods of TTMC items, which include pair scoring and individual scoring schemes. The…

Psychological safety is the shared belief that the team is safe for interpersonal risk-taking. Critical team events such as conflict and faultlines (hypothetical lines that split a team into subgroups) should impact psychological safety. Previous research has shown the benefits of task conflict on team outcomes under certain conditions and the…

Within this application brief, we propose a comprehensive model for mapping the shape and optimizing the effectiveness of leadership education in campus-wide university settings. The four-level model is highlighted by inclusion of a philosophy statement detailing the values and purpose of leadership education on campus, a set of skills and…

Missing data (attrition and non-response) are a feature of most surveys especially longitudinal/panel studies. And many such studies now have multilevel designs and hence multilevel data structures. Recent advances in imputation methodology now offer social researchers opportunities to address issues of missing data in a statistically principled…

This study examines the general question of how classroom characteristics are linked with differences among students in civic competence, which is seen to be an important basis for political inequality. A resource-mobilisation account of youth civic competence is presented, and this is tested using hierarchical linear modelling and International…

Objectives: It has been suggested that students are healthier in schools where more students are committed to school. Previous research has examined this only using a proxy measure of value-added education (a measure of whether school-level attendance and attainment are higher than predicted by students' social profile), finding associations with…

K-12 intervention studies often include fidelity of implementation (FOI) as a mediating variable, though most do not report the validity of fidelity measures. This article discusses the critical need for validated FOI scales. To illustrate our point, we describe the development and validation of the Implementation Validity Checklist (IVC-R), an…