The year 2022 is the 20th anniversary of Joseph Schafer and John Graham's paper titled "Missing data: Our view of the state of the art," currently the most highly cited paper in the history of "Psychological Methods." Much has changed since 2002, as missing data methodologies have continually evolved and improved; the range of…

Lord's Paradox occurs when a continuous covariate is statistically controlled for and the relationship between a continuous outcome and group status indicator changes in both magnitude and direction. This phenomenon poses a challenge to the notion of evidence-based policy, where data are supposed to be self-evident. We examined 50 effect size…

To plan cluster-randomized trials with sufficient statistical power to detect intervention effects on student achievement, researchers need multilevel design parameters, including measures of between-classroom and between-school differences and the amounts of variance explained by covariates at the student, classroom, and school level. Previous…

This study examined the effect of similar vs. dissimilar proficiency distributions on uniform DIF detection on a statewide eighth grade mathematics assessment. Results from the similar- and dissimilar-ability reference groups with an SWD focal group were compared for four models: logistic regression, hierarchical generalized linear model (HGLM),…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

The Early Childhood Environment Rating Scale-Third Edition (ECERS-3) is the latest version of one of the most widely used observational tools for assessing the quality of classrooms serving preschool-aged children. This study was the first assessment of its factor structure and validity, an important step given its widespread use. An ECERS-3…

We examine the intrinsic value students placed on schoolwork (i.e. academic intrinsic value) and social relationships (i.e. social intrinsic value). We then look at how these values predict middle and high school achievement. To do this, we came up with four profiles based on cluster analyses of 6,562 South Korean middle school students. The four…

Compositional effects of scholarly culture classroom/school climate on civic knowledge scores of 9th graders in the United States were examined using the International Association for the Evaluation of Educational Achievement (IEA) 1999 Civic Education Study data. Following Evans et al. (2010, 2014), we conceived that the number of books at home,…

This article presents the results of a study examining the highest implementers of the Schools to Watch (STW): School Transformation Network Project, and the impact the project had on their teaching/learning practices and outcomes. The project was funded by the U.S. Department of Education's Investing in Innovation (i3) grant program and was…

This paper provides the first population-based evidence on how much standardized test scores vary among public school districts within each state and how segregation explains that variation. Using estimates based on roughly 300 million test score records in math and English Language Arts (ELA) for Grades 3 through 8 from every U.S. public school…

We investigated the dimensionality of inference making in samples of 4- to 9-year-olds (Ns = 416-783) to determine if local and global coherence inferences could be distinguished. In addition, we examined the validity of our experimenter-developed inference measure by comparing with three additional measures of listening comprehension. Multitrait,…

The purpose of the present study is to examine whether performance on the "TOEFL iBT"® Reading practice test is affected by 3 different levels of feedback provided to learners upon completion of reading exercises: (a) correctness of learner response (the knowledge of correct results [KCR] feedback), (b) KCR feedback and rationales for…

The present study used hierarchical linear modeling to examine predictors of students' emotional and behavioral difficulties in preschool classrooms. Specifically, the study examined (a) the link between teachers' perceptions of their own emotional intelligence and students' emotional and behavioral difficulties, (b) the link between teachers'…

The stability of educational test results from the Programme for International Student Assessment (PISA) over 15 years was examined, and the influence of demographics and social capital was assessed, as was the impact of educational reforms. The test results were remarkably stable, with correlations up to 0.99 for country-level results over 2…

Our newly proposed integrated academic self-concept model integrates 3 major theories of academic self-concept formation and developmental perspectives into a unified conceptual and methodological framework. Relations among math self-concept (MSC), school grades, test scores, and school-level contextual effects over 6 years, from the end of…