The American School District Panel (ASDP) is the newest addition to RAND's American Educator Panels (AEP) and was designed to survey district leaders two times each school year. RAND recruits ASDP members using probabilistic sampling methods, which allow researchers to weight survey results to generalize to the national population of school…

This is the latest report in the State of the Superintendent series, an annual report intended to provide a reliable, recurring snapshot of the U.S. public school superintendency. Since the American School District Panel began in fall 2020, researchers have periodically surveyed superintendents about their job, focusing on job-related stressors,…

Trend scoring constructed response items (i.e. rescoring Time A responses at Time B) gives rise to two-way data that follow a product multinomial distribution rather than the multinomial distribution that is usually assumed. Recent work has shown that the difference in sampling model can have profound negative effects on statistics usually used to…

Physics education researchers are interested in using the tools of machine learning and natural language processing to make quantitative claims from natural language and text data, such as open-ended responses to survey questions. The aspiration is that this form of machine coding may be more efficient and consistent than human coding, allowing…

Accelerated longitudinal designs (ALDs) provide an opportunity to capture long developmental periods in a shorter time framework using a relatively small number of assessments. Prior literature has investigated whether univariate developmental processes can be characterized with data obtained from ALDs. However, many important questions in…

In our data-driven society, it is essential for students to become statistically literate. A core domain within Statistical Literacy is Statistical Inference, the ability to draw inferences from sample data. Acquiring and applying inferences is difficult for students and, therefore, usually not included in the pre-10th-grade curriculum. However,…

Network meta-analysis has been an essential methodology of systematic reviews for comparative effectiveness research. The restricted maximum likelihood (REML) method is one of the current standard inference methods for multivariate, contrast-based meta-analysis models, but recent studies have revealed the resultant confidence intervals of average…

Increasingly, the broader public, media and policymakers are looking to qualitative research to provide answers to our most pressing social questions. While an exciting and perhaps overdue moment for qualitative researchers, it is also a time when the method is coming under increasing scrutiny for a lack of reliability and transparency. The…

Bayesian methods seem a natural choice for combining sources of evidence in meta-analyses. However, in practice, their sensitivity to the choice of prior distribution is much less attractive, particularly for parameters describing heterogeneity. A recent non-Bayesian approach to fixed-effects meta-analysis provides novel ways to think about…

Optimal sampling frameworks attempt to identify the most efficient sampling plans to achieve an adequate statistical power. Although such calculations are theoretical in nature, they are critical to the judicious and wise use of funding because they serve as important starting points that guide practical discussions around sampling tradeoffs and…

This paper uses Individual Deprivation Measure data from Indonesia and South Africa to demonstrate the effects of coverage bias associated with mobile phone-based sampling and data collection approaches that restrict sampling frames to those who own or have access to a mobile phone -- a increasingly common method. Analysis of this data…

Data harmonization is an emerging approach to strategically combining data from multiple independent studies, enabling addressing new research questions that are not answerable by a single contributing study. A fundamental psychometric challenge for data harmonization is to create commensurate measures for the constructs of interest across…

Educational robots have unrivaled advantages and value in developing students' computational thinking. Currently, there are fewer studies on the overall effects of educational robots on K12 students' computational thinking, especially at the instructional style and cross-grade level. In order to investigate the overall effect of educational robots…

Pseudocontingencies are inferences of correlations between variables, like two options and two outcomes, drawn on the basis of their skewed base rates covarying across a third variable (e.g., two contexts). Here, we investigated the effect of pseudocontingency inference on choice behavior. When choices between two options are not based on the…

Internationally, standard observational measures of Early Childhood Education and Care (ECEC) are used to assess the quality of provision. They are applied as research tools but, significantly, also guide policy decisions, distribution of resources and public opinion. Considerable faith is placed in such measures, yet their validity, reliability…