Hierarchical linear modeling (HLM) has become an increasingly popular multilevel method of analyzing data among nested datasets, in particular, the effect of specialized academic programming within schools. The purpose of this methodological study is to demonstrate the use of HLM to determine the effectiveness of STEM programming in an Ohio middle…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

Data from a large-scale math intervention program were used to evaluate the degree to which implementation fidelity (IF) and interventionist content knowledge were associated with student outcomes. Data were available for 33 interventionists serving 658 students in Grades 4-6 across one school year. A series of multilevel models were fit to the…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

This study examines whether the influence of track position on study involvement is gendered and whether gender differences in study involvement according to track position are associated with school misconduct and rather poor future perspectives. Three-level analyses (HLM 6) of data gathered in 2004-2005 from 11,872 third- and fifth-grade…

Reading comprehension growth trajectories from 3rd to 7th grade were estimated for 99,919 students on a state reading comprehension assessment. We examined whether differences between students in general education (GE) and groups of students identified as exceptional learners were best characterized as stable, widening, or narrowing. The groups…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

The trajectory of early adolescents' popularity goal during the transition to middle school was examined in a diverse sample of 401 students. Popularity goal was assessed at five time points from the spring semester of fifth grade through the spring semester of seventh grade with the transition to middle school occurring between the fifth and…

This study investigated whether German learners of English as a foreign language (EFL) acquire additional recoding strategies that they do not need for recoding in the consistent German orthography. Based on the psycholinguistic grain size theory (Ziegler & Goswami, 2005) we expected students with little experience in EFL to use the same…

This study examined the role that everyday academic successes and failures--and the interactions with family members and peers that follow these events--play in predicting day-to-day changes in children's emotional responses to school. Middle school students (N = 101; mean age = 11.62 years) completed daily assessments of their academic…

A cluster-randomized trial (CRT) relies on random assignment of intact clusters to treatment conditions, such as classrooms or schools (Raudenbush & Bryk, 2002). One specific type of CRT, a multi-site CRT (MSCRT), is commonly employed in educational research and evaluation studies (Spybrook & Raudenbush, 2009; Spybrook, 2014; Bloom,…

This study investigated bullying victims' perceptions of their teachers' support and monitoring when controlling for level of mental health problems, peer relationships, gender, and grade level. Given the nested structure of the data, multilevel analyses were employed to examine these associations. The quality of classroom interaction is highly…

This study examined mathematics achievement growth of students without disabilities (SWoD) and students with learning disabilities (LD) and tested whether growth and LD status interacted with student demographic characteristics. Growth was estimated in a statewide sample of 79,554 students over Grades 3 to 7. The LD group was significantly lower…

This study examines the use of cross-classified random effects models (CCrem) and cross-classified multiple membership random effects models (CCMMrem) to model rater bias and estimate teacher effectiveness. Effect estimates are compared using CTT versus item response theory (IRT) scaling methods and three models (i.e., conventional multilevel…