Binary logistic regression is one of the most widely used statistical tools. The method uses odds, log odds, and odds ratios, which are difficult to understand and interpret. Understanding of logistic regression tends to fall down in one of three ways: (1) Many students and researchers come to believe that an odds ratio translates directly into…

Retrospective confidence refers to the phenomenological experience of the level of certainty that retrieved information is, in fact, correct. Retrospective confidence judgments are examined across a range of sub-disciplines in psychology from perception to memory research, and in education and legal applications. This paper focuses on…

This paper argues for three aspects of tolerance with respect to QCA research: tolerance with respect to different approaches to QCA; producing QCA research with tolerance (work that is resistant to criticism); and for QCA researchers to be clear about the tolerance of the solutions they present -- especially in terms of calibration and truth…

Since the No Child Left Behind Act (No Child Left Behind [NCLB], 2001) was enacted, the Bookmark method has been used in many state standard setting studies (Karantonis and Sireci; Zieky, Perie, and Livingston). The purpose of the current study is to evaluate the criticism that when panelists are presented with data during the Bookmark standard…

Teaching conceptions in higher education, or so-called academics' conceptions of teaching (ACTs), are essential in informing teaching behaviors and influencing students' learning. Consequently, several attempts have been made since the 1990s to understand what ACTs represent and how they can be developed towards student-centered teaching. However,…

When people interpret the outcome of a research study, do they consider other relevant information such as prior research? In the current study, 251 college graduates read a single brief fictitious news article. The article summarized the findings of a study that found positive results for a new drug. Three versions of the article varied the…

Biologists use tree diagrams to illustrate phylogenetic relationships among species. However, both novices and experts are prone to misinterpret this notational form. A difficulty with reasoning with cladograms is that intuitive narrative conceptions of evolution as a linear progression interfere with perceiving the hierarchical relationships that…

Cronbach's alpha is the most frequently used measure to investigate the reliability of measurement instruments. Despite its frequent use, many warn for misinterpretations of alpha. These claims about regular misunderstandings, however, are not based on empirical data. To understand how common such beliefs are, we conducted a survey study to test…

Beliefs may be described as Type A, scientific and verifiable (objective), or Type B, not verifiable and personal (subjective). Type B might be considered subjective opinion, something other than empirically confirmed, objective truth. Nevertheless, Type B is asserted as truth by some and can be valued over Type A. Both kinds of belief are…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

Racial bias in research impacts a study's relevancy, validity and reliability, though presently this aspect is not addressed in critical appraisal tools, and consequently appraisers may not take racial bias into account when assessing a paper's quality. Drawing on critical race theory (CRT) tenets that racism is ubiquitous and race a social…

This special issue of "Assessment in Education" contains the type of debate needed about what Cizek (2015) calls a "… lingering flaw in the concept of validity…." Some practitioners might not agree that the current theory of validation is flawed. Specifically, the debate Jon Twing is referencing concerns the role of the…

Refutational text is one of the many instructional techniques that have been proposed to be used in education as a way to achieve effective learning. The aim of refutational text is to transform misconceptions into conceptions that are in line with current scientific concepts. This is done by explicitly stating a misconception, refuting it, and…

This article engages the philosophy of science of data, with a focus on the extent to which data are always already imbued with racializations. As Alexander Weheliye has argued, racializations are not to be reduced to race but rather is the sociopolitical process that hierarchizes and differentiates bodies producing the entangled by-products of…