In this paper, we investigate the conditions under which data imbalances, a common data characteristic that occurs when factor values are unevenly distributed, are problematic for the performance of Coincidence Analysis (CNA). We further examine how such imbalances relate to fragmentation and noise in data. We show that even extreme data…

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

This paper adds an algorithmic epistemology perspective to previous works that examine the datafication of subjective social and emotional characteristics, perceptions, and behaviours. The paper employs a comparative epistemological approach to explore two behavioural educational platforms: RedCritter Teacher and Panorama Education. We unpack…

In the context of higher education's growing significance and the persistence of inequalities in it, the article aims to further develop the understanding of higher education as a public good and to explore its association with social cohesion in a European comparative perspective. It shifts the focus from the content of higher education as a…

In the current study, we compare propensity score (PS) matching methods for data with a cross-classified structure, where each individual is clustered within more than one group, but the groups are not hierarchically organized. Through a Monte Carlo simulation study, we compared sequential cluster matching (SCM), preferential within cluster…

Recent trends in vaccine hesitancy have brought to light the importance of using accurate school vaccination data. This study evaluated the accuracy of a pilot statewide kindergarten vaccination survey in Oklahoma. School vaccination and exemption data were collected from November 2017 to April 2018 via the Research Electronic Data Capture system.…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

The majority of adolescents communicate via text-based messaging, particularly through WhatsApp, a widely used free communication application. Written content on WhatsApp has the methodological potential to provide rich qualitative interview data. This study compares data collected using text-based WhatsApp versus face-to-face interview…

Purpose: Comparative data of autism-sensitive standardized measures of emotion regulation and lability, describing percentage change over time for populations of young autistic children, are currently publicly unavailable. We propose publication of such data as a support for future therapeutic intervention studies. Methods: We generate and present…

Qualitative comparative analysis (QCA) is an empirical research method that has gained some popularity in the social sciences. At the same time, the literature has long been convinced that QCA is prone to committing causal fallacies when confronted with non-causal data. More specifically, beyond a certain case-to-factor ratio, the method is…

Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in an experiment of three distinct survey designs…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Systematic reviews are vital for guiding practice, research and policy, although they are often slow and labour-intensive. Large language models (LLMs) could speed up and automate systematic reviews, but their performance in such tasks has yet to be comprehensively evaluated against humans, and no study has tested Generative Pre-Trained…

Data visualization enables users to transform data into visually compelling graphics that tell a rich story for effective communication (Vora, 2019). Data visualization's visual and artistic nature has also attracted artists and educators, leading them to explore its application in artistic creation and education (e.g., Bertling et al., 2021; Dean…