When a psychologist announces a new research finding, it is often based on a rejected null hypothesis. However, if that hypothesis is true, the claim is a false alarm. Many students mistakenly believe that the probability of committing a false alarm equals alpha, the criterion for statistical significance, which is typically set at 5%. Instructors…

Null hypothesis significance testing (NHST) has been the subject of debate for decades and alternative approaches to data analysis have been proposed. This article addresses this debate from the perspective of scientific inquiry and inference. Inference is an inverse problem and application of statistical methods cannot reveal whether effects…

Two basic data sources required for research studies have been secondary and primary. Secondary data collection helps the researcher to provide relevant background to the study and are, in most cases, available for retrieval from recorded sources. Primary data collection requires the researcher to venture into the field where the study is to take…

Tests the hypotheses that overconfidence occurs when strength is high and weight is low and that underconfidence occurs when weight is high and strength is low in 4 experiments with 153 students. Discusses weighing evidence, overconfidence/underconfidence in intuitive judgments, and item difficulty's effect on overconfidence. Relates the…

Hypothesis generation and testing is outlined as an additional domain for program evaluators. Program evaluation involves a thorough analysis of the processes that contribute to change (or a lack of change) among program recipients. This process of change is analyzed in two ways: (1) treating programs as naturally occurring field studies; and (2)…

Dismissing research that is not theory driven, hypothesis testing, or generalization producing does injustice to the variety of contributions that qualitative research can make. Studies conducted through qualitative approaches are reviewed to summarize the desirable outcomes that can result. No research model has a monopoly on quality. (SLD)

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…

Provides an exercise for introducing research methods to undergraduates. The students view a graph revealing that left-handed people are underrepresented in older age groups. Small group discussions attempt to explain this phenomenon. A follow-up class discussion focuses on the different approaches and methods available for interpreting the data.…

This study reexamines results reported by Angoff and Schrader regarding formula directions and rights directions for standardized tests. In that study, it was concluded that the two scoring directions were essentially equivalent. In this study, methodological concerns are discussed and additional data analyses undertaken. Among various…