Emergent technologies present platforms for educational researchers to conduct randomized controlled trials (RCTs) and collect rich data on study students' performance, behavior, learning processes, and outcomes in authentic learning environments. As educational research increasingly uses methods and data collection from such platforms, it is…

Emergent technologies present platforms for educational researchers to conduct randomized controlled trials (RCTs) and collect rich data to study students' performance, behavior, learning processes, and outcomes in authentic learning environments. As educational research increasingly uses methods and data collection from such platforms, it is…

In education, multisite trials involve randomization of pupils into intervention and comparison groups within schools. Most analytical models in multisite educational trials ignore that the impact of an intervention may be school dependent. This study investigates the impact of statistical models on the uncertainty associated with an effect size…

Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using…

Applied educational researchers may be interested in exploring random slope effects in multilevel models, such as when examining individual growth trajectories with longitudinal data. Random slopes are effects for which the slope of an individual-level coefficient varies depending on group membership, however these effects can be difficult to…

This study investigated the role of behavioral norms on concurrent links between problem behaviors (externalizing problems, internalizing problems, attention-hyperactivity problems) and social status (acceptance, rejection) in special education classrooms at four time points within and across school years. Two opposing models were considered, the…

Inter-rater reliability (IRR), which is a prerequisite of high-quality ratings and assessments, may be affected by contextual variables, such as the rater's or ratee's gender, major, or experience. Identification of such heterogeneity sources in IRR is important for the implementation of policies with the potential to decrease measurement error…

The use of new technologies is one of the themes at the centre of the educational debate, especially following Distance Education. The Avant-garde Educative Movement gathers schools from all over the country that share experiments based on a model in which the student is at the centre of his or her own educational path, a model capable of…

The purpose of this two-part study is to evaluate methods for multiple group analysis when the comparison group is at the within level with multilevel data, using a multilevel factor mixture model (ML FMM) and a multilevel multiple-indicators multiple-causes (ML MIMIC) model. The performance of these methods was evaluated integrally by a series of…

Developmental researchers commonly utilize multilevel models (MLMs) to describe and predict individual differences in change over time. In such growth model applications, researchers have been widely encouraged to supplement reporting of statistical significance with measures of effect size, such as R-squareds ("R[superscript 2]") that…

Module Overview: In this digital ITEMS module, Dr. Jodi M. Casabianca provides a primer on the "hierarchical rater model" (HRM) framework and the recent expansions to the model for analyzing raters and ratings of constructed responses. In the first part of the module, she establishes an understanding of the nature of constructed…

We discuss possible uses of multilevel mixed methods (M[superscript 3]) research in educational psychology. To begin, we describe M[superscript 3] research and how such research can enable researchers to investigate potential variation at the group level and at the subgroup/individual level. We discuss why M[superscript 3] research designs are…

We conducted a pilot study using intentional teaching strategies with specially designed materials to improve accuracy and production of targeted English morphosyntax structures with six deaf and hard-of-hearing students (kindergarten to first grade). A multiple baseline single-case research design (SCRD) consisting of 20-minute sessions four…

Sometimes a treatment, such as receiving a high school diploma, is assigned to students if their scores on two inputs (e.g., math and English test scores) are above established cutoffs. This forms a multidimensional regression discontinuity design (RDD) to analyze the effect of the educational treatment where there are two running variables…

Academic literacies (AL) research has made significant contributions to understandings of student writing and literacy across higher education and particularly learning development. However, researchers and practitioners both within and external to the AL movement have struggled to clarify the relationship between AL and pedagogy. English for…