A growing body of research shows that findings from studies often fail to replicate (Open Science Collaboration, 2015; Simmons, Nelson, & Simonsohn, 2011). Deviations from study protocols, sampling error, reduced statistical power, and unethical reporting procedures have been cited as reasons for replication failure (Gilbert, King, Pettigrew,…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

This paper aims to extend understanding of the business and societal impact of academic research. From a business school perspective, it has taken stock of the role of academic research and relevance in business and society. The proposed conceptual framework highlights the forces influencing the pursuit of academic rigour and relevance in…

The "Journal of Political Science Education (JPSE)" provides over a decade of research on political science pedagogy, featuring empirical research documenting best practices in the field. This article provides an overview of "JPSE"-published research on the topics of civic education and engagement. It summarizes the number and…

In this rejoinder, the authors describe the aim of the original study as an effort to conduct a critical test of an important postulate underlying the Cross-Battery Assessment PSW approach (XBA PSW; Kranzler, Floyd, Benson, Zaboski, & Thibodaux, this issue). The authors used classification agreement analysis to examine the concordance between…

This volume brings together both political and educational scientists. While educational research literature has so far not systematically addressed the tool of simulations of decision-making, political scientists have hardly used insights from research on assessment or on motivation and interest of students. Almost all political science…

This study deals with the statistical properties of a randomization test applied to an ABAB design in cases where the desirable random assignment of the points of change in phase is not possible. To obtain information about each possible data division, the authors carried out a conditional Monte Carlo simulation with 100,000 samples for each…

This dissertation comprises three papers that propose, discuss, and illustrate models to make improved inferences about research questions regarding student achievement in education. Addressing the types of questions common in educational research today requires three different "extensions" to traditional educational assessment: (1)…

Scientifically based research used to inform evidence based school reform efforts has been required by the federal government in order to receive grant funding since the reenactment of No Child Left Behind (2002). Educational evaluators are thus faced with the challenge to use rigorous research designs to establish causal relationships. However,…

One of the goals of game designers is to design for an engaging experience and for social interaction. The question is how. We know that games can be engaging and allow for social interaction, but how do we achieve this or even improve on it? This article provides an overview of several scientific approaches that deal with this question. It…

In gifted education research, it is common for outcome variables to exhibit strong floor or ceiling effects due to insufficient range of measurement of many instruments when used with gifted populations. Common statistical methods (e.g., analysis of variance, linear regression) produce biased estimates when such effects are present. In practice,…

The authors aimed to incorporate learning into the cognitive assessment framework that exists for static assessment data. In order to accomplish this, they derive a common likelihood function for dynamic models and introduce Parameter Driven Process for Change + Cognitive Diagnosis Model (PDPC + CDM), a dynamic model which tracks learning…

A simulation study was conducted to evaluate the performance of three tests of mediation: the bias-corrected and accelerated bootstrap (Efron & Tibshirani, 1993), the asymmetric confidence limits test (MacKinnon, 2008), and a multiple regression approach described by Kenny, Kashy, and Bolger (1998). The evolution of these methods is reviewed and…

When the errors in an ordinary least squares (OLS) regression model are heteroscedastic, hypothesis tests involving the regression coefficients can have Type I error rates that are far from the nominal significance level. Asymptotically, this problem can be rectified with the use of a heteroscedasticity-consistent covariance matrix (HCCM)…