When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

When comparing social science phenomena through a time perspective, absolute and relative difference (RD) are the two typical presentation formats used to communicate interpretations to the audience, while time distance (TD) is the least frequently used of such formats. This article argues that the chosen presentation format is extremely important…

In light of the replication crisis in psychology, null-hypothesis significance testing (NHST) and "p"-values have been heavily criticized and various alternatives have been proposed, ranging from slight modifications of the current paradigm to banning "p"-values from journals. Since the physics education research community…

Studies on reading literacy have yet to connect how students perceive the importance of different literacy areas to their ability perception in those areas. This article analyzes students' importance ranking of four different areas of literacy: prose (comprehending written information), document (interpreting information in forms, schedules,…

It is increasingly important for students to develop practiced and applied knowledge, teamwork skills, and civic engagement in addition to core curriculum knowledge in order to be prepared for the demands of the 21st century workforce. We propose that service-learning, or learning through an applied community service project, can uniquely address…

Individuals have difficulty changing their causal beliefs in light of contradictory evidence. We hypothesized that this difficulty arises because people facing implausible causes give greater consideration to causal alternatives, which, because of their use of a positive test strategy, leads to differential weighting of contingency evidence.…

The use of confidence intervals (CIs) as an addition or as an alternative to null hypothesis significance testing (NHST) has been promoted as a means to make researchers more aware of the uncertainty that is inherent in statistical inference. Little is known, however, about whether presenting results via CIs affects how readers judge the…

This study examined the status of critical thinking (CT) and reasoning skills in information communication and technology (ICT) for 190 college students in a higher education system. It analyzed how the students performed in CT, reasoning, and internet copyright and ethical issues. A CT assessment was designed to analyze the CT and reasoning…

We describe a perceptual experiment that we have successfully used in Research Methods classes. Students attempt to identify a series of simple cookie cutter shapes using only the fingers and hands (haptic perception). Students read archival studies that have used this procedure, identify confounds, generate and test alternate hypotheses, and…