Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Beliefs may be described as Type A, scientific and verifiable (objective), or Type B, not verifiable and personal (subjective). Type B might be considered subjective opinion, something other than empirically confirmed, objective truth. Nevertheless, Type B is asserted as truth by some and can be valued over Type A. Both kinds of belief are…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

This special issue of "Assessment in Education" contains the type of debate needed about what Cizek (2015) calls a "… lingering flaw in the concept of validity…." Some practitioners might not agree that the current theory of validation is flawed. Specifically, the debate Jon Twing is referencing concerns the role of the…

A misconception exists that validity may refer only to the "interpretation" of test scores and not to the "uses" of those scores. The development and evolution of validity theory illustrate test score interpretation was a primary focus in the earliest days of modern testing, and that validating interpretations derived from test…

Overlap-based measures are increasingly applied in the synthesis of single-subject research. This article considers two criticisms of overlap-based metrics, specifically that they do not measure magnitude of effect and do not adequately correspond with visual analysis. It is argued that these criticisms are based on fundamental misconceptions…

Shortly after we published "Addressing Flawed Research in Developmental Education" (2012) in the "Journal of Developmental Education," Thomas Bailey, Shanna Smith Jaggars, and Judith Scott- Clayton from the Community College Research Center (CCRC) wrote a response rebutting several of our claims. Though their response corrects…

Much of recent research in postsecondary developmental education leaves the distinct impression that most remedial courses in community colleges are unsuccessful in helping students and that they should be entirely overhauled. Legislators and administrators are now taking these recommendations very seriously and are ready to cut programs that are…

The present paper aims to review two motivations to conduct "what if" analyses using Excel and "R" to understand the statistical significance tests through the sample size context. "What if" analyses can be used to teach students what statistical significance tests really do and in applied research either prospectively to estimate what sample size…

Background: Historically, significant advances in scientific understanding have followed advances in measurement and observation. As the resolving power of an instrument increased, so have gains in the understanding of the phenomena being observed. Modern interactive systems are potentially the new "microscopes" when they are…

The national Study of Education Data Systems and Decision Making documented the availability and features of education data systems and the prevalence and nature of data-informed decision making in districts and schools. That study, like past research, found that teachers' likelihood of using data in decision making is affected by how confident…

We present a data-based perspective concerning recent (e.g., 2008) "Maclean's" magazine rankings of Canadian universities, including cluster analysis of the 2008 data. Canadian universities empirically resemble and relate to each other in a manner different from their formal classification and final rank ordering in the…

In recent years a number of reports have raised alarm over the deteriorating state of U.S. science and technology (S&T) competitiveness. But a recent report by the RAND Corporation, "U.S. Competitiveness in Science and Technology," argues that the U.S. continues to lead the world. RAND's report has been interpreted to suggest that the "clarion…

Educators' fear of statistics stems from various factors, including deficiencies in their preparation programs: insufficient relevance, inadequately integrated technologies, and stress on inferential statistics. Attendance statistics are worthless unless principals and superintendents can interpret them and incorporate them into their…