The recent commentary by Beaujean and Farmer (2020) on the original paper by Dixon et al. (2019) serves a cautionary tale of selective p-values, the law of small N sizes, and the type-II error. We believe these authors have crafted a somewhat questionable argument in which only 57% of the original Dixon et al. data were re-analyzed, based on a…

Although the null hypothesis significance testing procedure is problematic, many still favor the use of "p"-values as indicating the state of evidence against the model used to generate the "p"-value. From this perspective, "p"-values benefit science; or would benefit science if used correctly. In contrast, the novel…

The purpose of this study was to compare and contrast frameworks for evaluating methodological rigor in single case research. Specifically, research on high-probability requests to increase compliance in young children was evaluated. Ten studies were identified and were coded using 4 frameworks. These frameworks were the Council for Exceptional…

In this paper, we investigate two purported problems with Bayesian Knowledge Tracing (BKT), a popular statistical model of student learning: "identifiability" and "semantic model degeneracy." In 2007, Beck and Chang stated that BKT is susceptible to an "identifiability problem"--various models with different…

Recently, Stephen Gorard has outlined strong objections to the use of significance testing in social research. He has argued, first, that as the samples used in social research are almost always non-random it is not possible to use inferential statistical techniques and, second, that even if a truly random sample were achieved, the logic behind…

Educational assessment concerns inference about students' knowledge, skills, and accomplishments. Because data are never so comprehensive and unequivocal as to ensure certitude, test theory evolved in part to address questions of weight, coverage, and import of data. The resulting concepts and techniques can be viewed as applications of more…

Policy analysis, or policy study, is defined as the study of the nature, causes, and effects of alternative public policies; sometimes policy analysis refers to specific methods used. Two new developments associated with policy analysis are discussed. One is the concern for deducing the effects of alternative policies before they are adopted, as…

Comments on "The Timing of a First Birth and High School Completion" (Dawn M. Upchurch and James McCarthy) (1990). In considering relationships between adolescent childbearing and completion of high school, Upchurch and McCarthy misinterpret socioeconomic data. Their conclusion that young mothers are no less likely to graduate from high school is…