In this paper, we investigate the conditions under which data imbalances, a common data characteristic that occurs when factor values are unevenly distributed, are problematic for the performance of Coincidence Analysis (CNA). We further examine how such imbalances relate to fragmentation and noise in data. We show that even extreme data…

In the current study, we compare propensity score (PS) matching methods for data with a cross-classified structure, where each individual is clustered within more than one group, but the groups are not hierarchically organized. Through a Monte Carlo simulation study, we compared sequential cluster matching (SCM), preferential within cluster…

The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

The robustness of qualitative comparative analysis (QCA) results features high on the agenda of methodologists and practitioners. This article aims at advancing this debate on several fronts. First, in line with the extant literature, we take a comprehensive view on robustness arguing that decisions on calibration, consistency, and frequency…

Mixed-mode surveys are popular as they can save costs and maintain (or improve) response rates relative to single-mode surveys. Nevertheless, it is not yet clear how design decisions like survey mode or questionnaire length impact measurement quality. In this study, we compare measurement quality in an experiment of three distinct survey designs…

Systematic reviews are vital for guiding practice, research and policy, although they are often slow and labour-intensive. Large language models (LLMs) could speed up and automate systematic reviews, but their performance in such tasks has yet to be comprehensively evaluated against humans, and no study has tested Generative Pre-Trained…

Data visualization enables users to transform data into visually compelling graphics that tell a rich story for effective communication (Vora, 2019). Data visualization's visual and artistic nature has also attracted artists and educators, leading them to explore its application in artistic creation and education (e.g., Bertling et al., 2021; Dean…

Diversity audits are frequently used as an assessment method to measure the diversity of a library collection. Yet, there is not frequent research on the aftermath of diversity audits, especially in the context of comparing data from several audits to assess the difference in the makeup of a library collection. In this article, the author…

In the context of higher education's growing significance and the persistence of inequalities in it, the article aims to further develop the understanding of higher education as a public good and to explore its association with social cohesion in a European comparative perspective. It shifts the focus from the content of higher education as a…

Generative AI (GenAI) has the potential to revolutionize the analysis of educational data, significantly impacting learning analytics (LA). This study explores the capability of non-experts, including administrators, instructors, and students, to effectively use GenAI for descriptive LA tasks without requiring specialized knowledge in data…

The main goal of this study was to evaluate the impact of an animation and visualization of data structures (AVDS) tool on both perceptions and objective test performance. The study involved a rigorous experiment that assessed the usability, acceptability, and effectiveness of the AVDS tool in solving exercises. A total of 78 participants…

Third Mission (TM) drives universities to a purpose beyond their traditional role, especially in local socioeconomic and innovation ecosystems. To investigate the issue, we consider an exploratory and comparative study of two different governance systems of public universities (Southeast Brazil-region 1 and Texas-US-region 2). The comparison took…

We contribute to the higher education returns discourse by examining perceptions among college graduates. Using 2021 U.S. Survey of Household Economics of Decisionmaking data, we observe that over 80% of degree holders perceive that they received positive financial returns from college, while only 7% of college degree holders regret their decision…

Recent trends in vaccine hesitancy have brought to light the importance of using accurate school vaccination data. This study evaluated the accuracy of a pilot statewide kindergarten vaccination survey in Oklahoma. School vaccination and exemption data were collected from November 2017 to April 2018 via the Research Electronic Data Capture system.…

This article introduces researchers in the science concerned with developing and studying research methods, measurement, and evaluation (RMME) to the educational data mining (EDM) community. It assumes that the audience is familiar with traditional priorities of statistical analyses, such as accurately estimating model parameters and inferences…