Multilevel meta-analysis is an innovative synthesis technique used for the quantitative integration of effect size estimates across participants and across studies. The quantitative summary allows for objective, evidence-based, and informed decisions in research, practice, and policy. Based on previous methodological work, the technique results in…

Current practice for conducting power analyses in hierarchical trials using survey based ICC and effect size estimates may be misestimating power because ICCs are not being adjusted to account for treatment effect heterogeneity. Results presented in Table 1 show that the necessary adjustments can be quite large or quite small. Furthermore, power…

Like studies focused on the detection of a main or total effect, a principal consideration in the design of studies examining mediation is the power with which mediation effects can be detected if they exist (e.g., Raudenbush, 1997). However, unlike studies concerning the detection of main effects, literature has not established power formulas for…

Researchers designing multisite and cluster randomized trials of educational interventions will usually conduct a power analysis in the planning stage of the study. To conduct the power analysis, researchers often use estimates of intracluster correlation coefficients and effect sizes derived from an analysis of survey data. When there is…

This paper investigates the impact of effective schooling in the 1st year of elementary school on later academic outcomes and equal educational opportunity. A large longitudinal dataset from England was used to estimate the importance of the 1st year of elementary school for academic outcomes up to age 16. Multilevel models, controlling for…

Multilevel modeling techniques are becoming more popular in handling data with multilevel structure in educational and behavioral research. Recently, researchers have paid more attention to cross-classified data structure that naturally arises in educational settings. However, unlike traditional single-level research, methodological studies about…

The identification of evidence-based practices continues to provoke issues of disagreement across multiple fields. One area of contention is the role of single-subject design (SSD) research in providing scientific evidence. The debate about SSD's utility centers on three issues: sample size, effect size, and serial dependence. One potential…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

Purpose: This research note explores the potential role of attention in mediating previously reported associations between language outcomes and prematurity. Method: As a follow-up investigation to Mahurin Smith, DeThorne, Logan, Channell, and Petrill (2014), we employed multilevel modeling to analyze longitudinal data on language and attention…

Using data from the 2006 Program for International Student Assessment (PISA), we explored nine aspects of science engagement (science self-efficacy, science self-concept, enjoyment of science, general interest in learning science, instrumental motivation for science, future-oriented science motivation, general value of science, personal value of…

This study focused on the extrinsic and intrinsic motivation levels of eighth grade students and its relationship with their mathematical achievement. The participants of the study included 6,829 students who took TIMSS in 2011 and 239 mathematics teachers. The data obtained from the student and teacher questionnaires that are included in the…

The purpose of this project is to demonstrate the practical methods developed to utilize a dataset consisting of both multivariate and multilevel effect size data. The context for this project is a large-scale meta-analytic review of the predictors of academic achievement. This project is guided by three primary research questions: (1) How do we…

By applying multilevel models with random effects, the authors reviewed and synthesized findings from 30 studies that were published in the last 20 years exploring the relationship between the Educational Testing Service Major Field Test for a Bachelor's Degree in Business (MFTB) and related factors. The results suggest that MFTB scores correlated…

In a recently published meta-analysis, Tran, Sanchez, Arellano, and Swanson (2011) synthesized 13 studies that permitted assessment of characteristics of children who were adequate and inadequate responders to instruction. The authors indicated that "[t]he central question addressed in this review is whether individual differences in…

Background/Context: Most reforms in elementary education rely on teacher learning and improved instruction to increase student learning. This study increases our understanding of which types of professional development effectively change teaching practice in ways that boost student achievement. Purpose/Objective/Research Question/Focus of Study:…