In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

Researchers in behavioral sciences are often interested in longitudinal behavior change outcomes and the mechanisms that influence changes in these outcomes over time. The statistical models that are typically implemented to address these research questions do not allow for investigation of mechanisms of dynamic change over time. However, latent…

This paper looks at the tension between the desire to claim predictive ability for Agent-Based Models (ABMs) and its extreme difficulty for social and ecological systems, suggesting that this is the main cause for the continuance of a rhetoric of prediction that is at odds with what is achievable. Following others, it recommends that it is better…

Integration is a valuable yet underutilized process in scientific literatures, including the achievement motivation literature. In this piece, we advocate for and illustrate the benefits of giving integration a central place within the achievement motivation literature. We pay particular attention to the hierarchical model of achievement…

Research questions regarding how, for whom, and where a treatment achieves its effect on an outcome have become increasingly valued in substantive research. Such questions can be answered by causal moderated mediation analysis, which assesses the heterogeneity of the mediation mechanism underlying the treatment effect across individual and…

This paper presents a model of recurrent multinomial sequences. Though there exists a quite considerable literature on modeling autocorrelation in numerical data and sequences of categorical outcomes, there is currently no systematic method of modeling patterns of recurrence in categorical sequences. This paper develops a means of discovering…

Qualitative comparative analysis (QCA) is an empirical research method that has gained some popularity in the social sciences. At the same time, the literature has long been convinced that QCA is prone to committing causal fallacies when confronted with non-causal data. More specifically, beyond a certain case-to-factor ratio, the method is…

Longitudinal studies including a time-to-event outcome in social research often use a form of event history analysis to analyse the influence of time-varying endogenous covariates on the time-to-event outcome. Many standard event history models however assume the covariates of interest to be exogenous and inclusion of an endogenous covariate may…

Purpose: This paper aims to consider ways to visually model data generated by qualitative case studies, pointing out a need for visualizations that depict both synchronic relations across representations and how those relations change diachronically. To develop an appropriate modeling approach, the paper critically examines Max Boisot's I-Space…

Since the early 1990s the number of systematic reviews (SR) of animal studies has steadily increased. There is, however, little guidance on when and how to conduct a meta-analysis of human-health-related animal studies. To gain insight about the methods that are currently used we created an overview of the key characteristics of published…

The paradigm on which a methodological approach is developed determines the situations in which its application will be most appropriate. The quantitative approach implies a positivist paradigm, the basis of which is cause-and-effect relationships, as well as the questioning and verifying of existing theories. Positivism aims to prove that…

This article argues that Agent-Based Modelling, owing to its capabilities and methodology, has a distinctive contribution to make to delivering coherent social science prediction. The argument has four parts. The first identifies key elements of social science prediction induced from real research across disciplines, thus avoiding a straw person…

Social scientists have frequently sought to understand the distinct effects of age, period, and cohort, but disaggregation of the three dimensions is difficult because cohort = period - age. We argue that this technical difficulty reflects a disconnection between how the cohort effect is conceptualized and how it is modeled in the traditional…

This paper discusses methodological challenges in researching practice. The primary challenge discussed arises from the view that practice is inextricable from its performance, and that performance is embedded in social relations, material infrastructures and historical context. The paper argues for a philosophical hermeneutics approach that works…

The Nuremberg Code established ethics for the involvement of humans in research, initially in the area of health and medical research. While aspects of the code have been extended to the social and behavioral sciences, program evaluation does not always implement those policies, procedures, and protocols for protecting research participants,…