In this paper, we investigate the conditions under which data imbalances, a common data characteristic that occurs when factor values are unevenly distributed, are problematic for the performance of Coincidence Analysis (CNA). We further examine how such imbalances relate to fragmentation and noise in data. We show that even extreme data…

In this article, we discuss the methodological implications of data and theory integration for Theory-Based Evaluation (TBE). TBE is a family of approaches to program evaluation that use program theories as instruments to answer questions about whether, how, and why a program works. Some of the groundwork about TBE has expressed the idea that a…

The field of qualitative comparative analysis (QCA) is witnessing a heated debate on which one of the QCA's main solution types should be at the center of substantive interpretation. This article argues that the different QCA solutions have complementary strengths. Therefore, researchers should interpret the three solution types in an integrated…

Currently, dynamic structural equation modeling (DSEM) and residual DSEM (RDSEM) are commonly used in testing intensive longitudinal data (ILD). Researchers are interested in ILD mediation models, but their analyses are challenging. The present paper mathematically derived, empirically compared, and step-by-step demonstrated three types (i.e.,…

Intensive longitudinal data has been widely used to examine reciprocal or causal relations between variables. However, these variables may not be temporally aligned. This study examined the consequences and solutions of the problem of temporal misalignment in intensive longitudinal data based on dynamic structural equation models. First the impact…

School attendance and absenteeism are critical targets of educational policies and practices that often depend heavily on aggregated attendance/absenteeism data. School attendance/absenteeism data in aggregated form, in addition to having suspect quality and utility, minimizes individual student variation, distorts detailed and multilevel…

Estimation of causal effects requires making comparisons across groups of observations exposed and not exposed to a a treatment or cause (intervention, program, drug, etc). To interpret differences between groups causally we need to ensure that they have been constructed in such a way that the comparisons are "fair." This can be…

Context: Prolonged disconnection from school and work represents major setbacks during the transition to adulthood and is a distinct feature of the developmental trajectories of many disadvantaged youths, especially those from a marginalized racial background (Hong and Chung 2022; Shanahan 2000). Differential schooling experiences are hypothesized…

Qualitative Comparative Analysis (QCA) is a relatively young method of causal inference that continues to diffuse across the social sciences. However, recent methodological research has found the conservative (QCA-CS) and the intermediate solution type (QCA-IS) of QCA to fail fundamental tests of correctness. Even under conditions otherwise ideal…

Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

A wide range of machine-learning-based approaches have been developed in the past decade, increasing our ability to accurately model nonlinear and nonadditive response surfaces. This has improved performance for inferential tasks such as estimating average treatment effects in situations where standard parametric models may not fit the data well.…

Emergent technologies present platforms for educational researchers to conduct randomized controlled trials (RCTs) and collect rich data on study students' performance, behavior, learning processes, and outcomes in authentic learning environments. As educational research increasingly uses methods and data collection from such platforms, it is…

Emergent technologies present platforms for educational researchers to conduct randomized controlled trials (RCTs) and collect rich data to study students' performance, behavior, learning processes, and outcomes in authentic learning environments. As educational research increasingly uses methods and data collection from such platforms, it is…

Randomized control trials are considered the pinnacle for causal inference. In many cases, however, randomization of participants in social work research studies is not feasible or ethical. This paper introduces the co-twin control design study as an alternative quasi-experimental design to provide evidence of causal mechanisms when randomization…

We present new estimates of the internal rate of return to early childhood education. Utilizing the nationwide expansion of preschool education in Japan between 1960 and 1980, we initially assess the impact of preschool attendance on high school graduation and college enrollment for men. Subsequently, we compute the social rate of return to…