Data reasoning is an essential component of scientific reasoning, as a component of evidence evaluation. In this paper, we outline a model of scientific data reasoning that describes how data sensemaking underlies data reasoning. Data sensemaking, a relatively automatic process rooted in perceptual mechanisms that summarize large quantities of…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

It is now widely accepted that the standard inferential toolkit used by the scientific research community--null-hypothesis significance testing (NHST)--is not fit for purpose. Yet despite the threat posed to the scientific enterprise, there is no agreement concerning alternative approaches for evidence assessment. This lack of consensus reflects…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

When comparing social science phenomena through a time perspective, absolute and relative difference (RD) are the two typical presentation formats used to communicate interpretations to the audience, while time distance (TD) is the least frequently used of such formats. This article argues that the chosen presentation format is extremely important…

In light of the replication crisis in psychology, null-hypothesis significance testing (NHST) and "p"-values have been heavily criticized and various alternatives have been proposed, ranging from slight modifications of the current paradigm to banning "p"-values from journals. Since the physics education research community…

Purpose: The purpose of this work is to illustrate the processes involved in managing teams in order to assist designers and developers to build software that support teamwork. A deeper investigation into the role of team analytics is discussed in this article. Design/methodology/approach: Many researchers over the past several decades studied the…

In this paper the hypothesis is presented that Franz Kafka was a person with autism. This is done by analyzing and discussing his biography, letters, diaries and major works. Kafka's autism is an integral diagnosis which encompasses both his personal life and his work. This interpretation is contrary to other interpretations from the past which in…

The article provides perspectives on p values, null hypothesis testing, and alternative techniques in light of modern robust statistical methods. Null hypothesis testing and "p" values can provide useful information provided they are interpreted in a sound manner, which includes taking into account insights and advances that have…

Null hypothesis significance testing (NHST) has been the subject of debate for decades and alternative approaches to data analysis have been proposed. This article addresses this debate from the perspective of scientific inquiry and inference. Inference is an inverse problem and application of statistical methods cannot reveal whether effects…

Studies on reading literacy have yet to connect how students perceive the importance of different literacy areas to their ability perception in those areas. This article analyzes students' importance ranking of four different areas of literacy: prose (comprehending written information), document (interpreting information in forms, schedules,…

Could the research you read be fundamentally flawed? Could critical defects in methodology slip by you undetected? To become informed consumers of research, students need to thoughtfully evaluate the research they read rather than accept it without question. This second edition of a classic text gives students the tools they need to apply critical…

This article describes a lesson in which high school biology, ecology, environmental science, anatomy, and physiology students can devise hypotheses and test them with scientific data, identify unanswered questions, and design an additional study to answer those questions. This module connects students with exciting research and current science…

It is increasingly important for students to develop practiced and applied knowledge, teamwork skills, and civic engagement in addition to core curriculum knowledge in order to be prepared for the demands of the 21st century workforce. We propose that service-learning, or learning through an applied community service project, can uniquely address…