Applying qualitative comparative analysis (QCA) to large Ns relaxes researchers' case-based knowledge. This is problematic because causality in QCA is inferred from a dialogue between empirical, theoretical, and case-based knowledge. The lack of case-based knowledge may be remedied by various robustness tests. However, being a case-based method,…

When fitting unidimensional item response theory (IRT) models, the population distribution of the latent trait ([theta]) is often assumed to be normally distributed. However, some psychological theories would suggest a nonnormal [theta]. For example, some clinical traits (e.g., alcoholism, depression) are believed to follow a positively skewed…

Media articles often communicate the latest scientific findings, and readers must evaluate the evidence and consider its potential implications. Prior work has found that the inclusion of graphs makes messages about scientific data more persuasive (Tal & Wansink, 2016). One explanation for this finding is that such visualizations evoke the…

The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Technical documentation for educational tests focuses primarily on properties of individual scores at single points in time. Reliability, standard errors of measurement, item parameter estimates, fit statistics, and linking constants are standard technical features that external stakeholders use to evaluate items and individual scale scores.…

In developing nations, health systems are still fragmented, especially components such as public supply chain and procurement systems, often resulting in medicine stock-outs at last mile health facilities. Sophisticated systems are needed to address these challenges, often in alignment with a demand driven supply chain management (DDSCM) strategy,…

We constructed a new taxonomy for inferential thinking, a construct called Integrative Inferential Reasoning (IIR). IIR extends Pearson and Johnson's (1978) framework of "text-implicit" and "script-implicit" question-answer relations, and integrates several other prominent literacy theories to form a unified inferential…

Cognitive diagnostic models (CDMs) have received sustained attention in educational settings because they can be used to operationalize formative assessment to provide diagnostic feedback and inform instruction. A large number of CDMs have been developed over the past few years. An important component of all CDMs is a Q-matrix that specifies a…

Motivation and self-concept count among the educationally most relevant factors and the evaluation of many educational interventions requires their valid measurement. The present study examined the psychometric properties of a shortened version of the Students' Approaches to Learning questionnaire measuring 10 distinct motivational and…

Assessment of clinical competence is complex and inference based. Trustworthy and defensible assessment processes must have favourable evidence of validity, particularly where decisions are considered high stakes. We aimed to organize, collect and interpret validity evidence for a high stakes simulation based assessment strategy for certifying…

In the late 1980s Batia Laufer worked with teachers who believed that to understand a text it was enough to understand 80% of the text's word tokens. In response, Laufer set out to calculate the minimal text coverage, i.e., percentage of running words in a text the reader should understand to comprehend it reasonably well. In 1992, she explored…

Background: Validity is a notable concept in language testing which has concerned many researchers and scholars in the field of language testing due to its importance in decision making process. Tests' results always introduce consequences to test takers' lives which emphasizes the need to ensure their validity. Detecting and delineating the…

Making inferences and reasoning with new scientific information is critical for successful performance in biology coursework. Thus, identifying students who are weak in these skills could allow the early provision of additional support and course placement recommendations to help students develop their reasoning abilities, leading to better…

A large body of research has examined students' conceptions of evolution and their relationships to acceptance of evolution. Proficiency in statistical and probabilistic reasoning has long been considered to be an essential feature of evolutionary reasoning, yet almost no empirical work has explored these putative connections. The RaPro…

Explicit attention to research design issues is essential in experimental second language (L2) research. Too often, however, such careful attention is not paid. This article examines some of the issues surrounding experimental L2 research and its relationships to causal inferences. It discusses the place of research questions and hypotheses,…