The "School Strike 4 Climate" is a timely opportunity for education and research sectors to support youth stories in climate change policy, and foster impactful relationships between researchers, teachers and students. But much research in this space has inherent selection biases where youth representation in research is limited by place…

Population invariance is a desirable property of test equating which might not hold when significant changes occur in the test population, such as those brought about by the COVID-19 pandemic. This research aims to investigate whether equating functions are reasonably invariant when the test population is impacted by the pandemic. Based on…

Test equating requires collecting data to link the scores from different forms of a test. Problems arise when equating samples are not equivalent and the test forms to be linked share no common items by which to measure or adjust for the group nonequivalence. Using data from five operational test forms, we created five pairs of research forms for…

The authors discuss the use of surveys for collecting data from a population sample and emphasise the importance of being careful with the language of data collection. [For "The Data Files 5: Graphs for Exploring Relationships," see EJ1355504.]

Optimal design of multisite randomized trials leverages sampling costs to optimize sampling ratios and ultimately identify more efficient and powerful designs. Past implementations of the optimal design framework have assumed that costs of sampling units are equal across treatment conditions. In this study, we developed a more flexible optimal…

The purpose of this dissertation is to develop principles and strategies for and identify limitations of multisite cluster randomized trials in the context of partially and fully nested designs. In the first study, I develop principles of estimation, sampling variability, and inference for studies that leverage multisite designs within the context…

Tolerance intervals provide a bracket intended to contain a percentage (e.g., 80%) of a population distribution given sample estimates of the mean and variance. In random-effects meta-analysis, tolerance intervals should contain researcher-specified proportions of underlying population effect sizes. Using Monte Carlo simulation, we investigated…

The American School District Panel (ASDP) is the newest addition to RAND's American Educator Panels (AEP) and was designed to survey district leaders two times each school year. RAND recruits ASDP members using probabilistic sampling methods, which allow researchers to weight survey results to generalize to the national population of school…

This is the latest report in the State of the Superintendent series, an annual report intended to provide a reliable, recurring snapshot of the U.S. public school superintendency. Since the American School District Panel began in fall 2020, researchers have periodically surveyed superintendents about their job, focusing on job-related stressors,…

Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distribution that is usually assumed. Recent work has shown that the difference in sampling model can have profound negative effects on statistics usually used to…

Physics education researchers are interested in using the tools of machine learning and natural language processing to make quantitative claims from natural language and text data, such as open-ended responses to survey questions. The aspiration is that this form of machine coding may be more efficient and consistent than human coding, allowing…

Accelerated longitudinal designs (ALDs) provide an opportunity to capture long developmental periods in a shorter time framework using a relatively small number of assessments. Prior literature has investigated whether univariate developmental processes can be characterized with data obtained from ALDs. However, many important questions in…

In our data-driven society, it is essential for students to become statistically literate. A core domain within Statistical Literacy is Statistical Inference, the ability to draw inferences from sample data. Acquiring and applying inferences is difficult for students and, therefore, usually not included in the pre-10th-grade curriculum. However,…

Network meta-analysis has been an essential methodology of systematic reviews for comparative effectiveness research. The restricted maximum likelihood (REML) method is one of the current standard inference methods for multivariate, contrast-based meta-analysis models, but recent studies have revealed the resultant confidence intervals of average…

Increasingly, the broader public, media and policymakers are looking to qualitative research to provide answers to our most pressing social questions. While an exciting and perhaps overdue moment for qualitative researchers, it is also a time when the method is coming under increasing scrutiny for a lack of reliability and transparency. The…