Therapeutic reasoning is when the purpose, task, or goal for engaging in reasoning is to determine the patient's management plan. As the field's understanding of the process of therapeutic reasoning is less well understood, we focused on studies that collected data on the process of therapeutic reasoning. To synthesize previous studies of…

Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a…

Context: A perennial problem in applied statistics is the inability to justify strong claims about cause-and-effect relationships without full knowledge of the mechanism determining selection into treatment. Few research designs other than the well-implemented random assignment study meet this requirement. Researchers have proposed partial…

This short article continues the exploration of the Common Online Data Analysis Platform (CODAP) and statistics begun in the previous article "Statistical Investigations and CODAP, Part 1: EDA." In Part 2, the author discusses the teaching of statistical inference focusing on activities for the senior secondary years. In particular, the…

In recent years, there have been calls for researchers to report and interpret confidence intervals (CIs) rather than relying solely on p-values. Such reforms, however, may be hindered by a general lack of understanding of CIs and how to interpret them. In this study, we assessed conceptual knowledge of CIs in undergraduate and graduate psychology…

In recent years, there have been calls for researchers to report and interpret confidence intervals (CIs) rather than relying solely on p-values. Such reforms, however, may be hindered by a general lack of understanding of CIs and how to interpret them. In this study, we assessed conceptual knowledge of CIs in undergraduate and graduate psychology…

It is well known that Newton's work on mechanics depended in a crucial way on the previous observations of Galileo. The key insight of Galileo was that one can analyze the motion of bodies using experiments and mathematical equations. One experimental observation that roughly emerges from this work in modern terms is that two objects of different…

This study presents a novel approach contributing to our understanding of the design, development, and implementation AI-based systems for conducting double-blind online randomized controlled trials (RCTs) for higher education research. The process of the entire interaction with the participants (n = 1193) and their allocation to test and control…

In this paper, we explore the role that examples play as mathematicians formulate conjectures, and we describe and exemplify one particular example-related activity that we observed in interviews with thirteen mathematicians. During our interviews, mathematicians productively used examples as they formulated conjectures, particularly by creating…

Jokes, cartoons, songs, and games can help engage students in discussion and learning key concepts about hypothesis testing.

A design experiment where students in Grade 5 (11-12 years old) play the Color Run game constitutes the context for investigating how students can be introduced to informal hypothesis testing. The result outlines a three-step hypothetical learning trajectory on informal hypothesis testing. In the first step, students came to favor sample space…

Generating a testable hypothesis is a necessary skill for engaging in science, requiring both general reasoning skills and specific content knowledge of the phenomenon being investigated. While many students have the reasoning skills necessary for developing testable hypotheses in a general science context, it can be challenging for students to…

Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we…

We investigate two non-iterative estimation procedures for Rasch models, the pair-wise estimation procedure (PAIR) and the Eigenvector method (EVM), and identify theoretical issues with EVM for rating scale model (RSM) threshold estimation. We develop a new procedure to resolve these issues--the conditional pairwise adjacent thresholds procedure…

While national curricula in science education highlight the importance of inquiry-based learning, assessing students' capabilities in scientific inquiry remains a subject of debate. Our study explored the construction, developmental trends and validation techniques in relation to assessing scientific inquiry using a systematic literature review…