Measuring the existence and patterning of white flight (WF) using aggregate data has a long history in the social sciences. In this article, we assess past measurement approaches and identify several technical and conceptual limitations. To address these shortcomings, we propose a new multicomponent approach to detecting WF that requires tracts to…

Single-case experimental designs (SCEDs) are frequently used to evaluate whether a functional relation exists between interventions and student outcomes. A critical factor in decision making is the evaluation of graphical data, typically displayed in time-series graphs. Distortion in the graphical display of data can lead to invalid decisions on…

Qualitative research sample size determination has always been a contentious and confusing issue. Studies are often vague when explaining the processes and justifications that have been used to determine sample size and strategy. Some provide no mention of sampling at all, whilst others rely too heavily on the concept of saturation for determining…

With the prevalence of missing data in social science research, it is necessary to use methods for handling missing data. One framework in which data with missing values can still be used for parameter estimation is the Bayesian framework. In this tutorial, different missing data mechanisms including Missing Completely at Random, Missing at…

Small sample sizes contribute to several problems in research and knowledge advancement. This conceptual replication study confirmed and extended the inflation of type II errors and confidence intervals in correlation analyses of small sample sizes common in kinesiology/exercise science. Current population data (N = 18, 230, & 464) on four…

This article analyses and discusses dilemmas, ambivalences and problematic issues related to research ethics. This is done firstly by making a distinction between procedural research ethics and particularistic research ethics. Such a distinction reflects a theoretical construction and generalization. In practice, there can be a very close…

Thematic analysis is a methodology with wide use in content analysis and field work through interviews, observations, and focus groups. Despite popularity with researchers, there are several questions and problems with the methodology. There was an absence in exploration and explanation of the methods and hidden steps in thematic analysis. Using a…

Purpose: Course evaluations are formative and are used to evaluate learnings of the students for a course. Anomalies in the evaluation process can lead to a faulty educational outcome. Learning analytics and educational data mining provide a set of techniques that can be conveniently applied to extensive data collected as part of the evaluation…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

This colloquium brings information about a second cycle of OECD's International Early Learning and Well-being Study (IELS) to the early childhood community, and offers a further critique of the approach to comparative research that the IELS embodies.

Although parallel analysis has been found to be an accurate method for determining the number of factors in many conditions with complete data, its application under missing data is limited. The existing literature recommends that, after using an appropriate multiple imputation method, researchers either apply parallel analysis to every imputed…

Speculative design, as a diverse set of methods that aim to offer critique, can be challenging to engage productively. In this design case, we share how a prior, stalled design project--an ambitious vision of interdisciplinary design education partnered with business and housing development projects in Santa Fe, New Mexico--provided compelling…

To support and better understand how to scale effectively, in 2020, the Millions Learning project at the Center for Universal Education (CUE) at Brookings joined the Global Partnership for Education's (GPE) Knowledge and Innovation Exchange (KIX), a joint partnership between GPE and the International Development Research Centre (IDRC), to…

When conducting a postal survey, a traditional recommendation is to use paper postage stamps instead of an automated postage system, to make sure that invitations have a more personal and attractive appearance. In this research note, we investigate whether this traditional recommendation is still valid. In the autumn of 2020, a postal survey was…

Audit correspondence studies are field experiments that test for discriminatory behavior in active markets. Researchers measure discrimination by comparing how responsive individuals ("audited units") are to correspondences from different types of people. This article elaborates on the tradeoffs researchers face between sending audited…