Psychology teachers have likely heard about the "replication crisis" and the "open science movement" in psychology, and they are probably aware that psychologists have proposed new standards for research practice. How should our psychology courses reflect these new standards? We describe several modern practices that have…

Current developments in the statistics community suggest that modern statistics education should be structured holistically, that is, by allowing students to work with real data and to answer concrete statistical questions, but also by educating them about alternative frameworks, such as Bayesian inference. In this article, we describe how we…

We describe how students can be encouraged to actively review course contents on inferential statistics by creating application-oriented exercises and sample solutions on the basis of concrete and realistic research articles and their data. For evaluation purposes, we use students' reactions to the activity and investigate its effects on the final…

Purpose: The purpose of this study is to improve the understanding of stakeholder engagement in the context of sustainability reporting (SR) for higher education institutions (HEIs), together with the materiality principle and stakeholder expectations. Design/methodology/approach: This research uses an exploratory approach based on content…

The central role of the propensity score analysis (PSA) in observational studies is for causal inference; as such, PSA is often used for making causal claims in research articles. However, there are still some issues for researchers to consider when making claims of causality using PSA results. This summary first briefly reviews PSA, followed by…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

This paper offers a practical guide to use null hypotheses significance testing and its alternatives. The focus is on improving the quality of statistical inference in quantitative communication research. More consistent reporting of descriptive statistics, estimates of effect size, confidence intervals around effect sizes, and increasing the…

This substantially revised text provides a comprehensive, highly accessible, and student friendly introduction to the principles, concepts, and methods currently used in educational research. This text provides a balanced combination of quantitative and qualitative methods and enables students to master skills in reading, understanding,…

This paper makes the point that descriptive and inferential measures of nonnormality and graphic displays of the frequency distribution of important variables should be routine in research reporting. This point is particularly true for research involving measures with nonarbitrary metrics where the distribution shape is unaffected by measurement…

Proposes guidelines for revising the American Psychological Association (APA) publication manual or other APA materials to clarify the application of statistics in research reports. The guidelines are intended to induce authors and editors to recognize the thoughtless application of statistical methods. Contains 54 references. (SLD)

Analyzed 150 articles from the "Journal of Applied Psychology" (JAP) from 1940 to 1999 to determine statistical reporting practices related to null hypothesis significance testing, American Psychological Association guidelines, and reform recommendations. Findings show little evidence that decades of cogent criticisms by reformers have…

This paper addresses the state of the art regarding the use of statistical significance tests (SSTs). How social science research will be conducted in the future is impacted directly by current debates regarding hypothesis testing. This paper: (1) briefly explicates the current debate on hypothesis testing; (2) reviews the newly published report…

Significance tests are often used inappropriately in counseling research. In addition to comments on the significance test controversy (Vacha-Haase and Nilsson, this issue), a wider historical context and personal experiences are provided. The controversy is discussed, and seven recommendations for using significance tests are included. (EMK)

Introduces the three subsequent articles from this special section, which extend the discussion of future prospects for progress in the reporting and interpreting of effect sizes by researchers. The authors of these pieces represent diverse views. (SLD)

Makes the case that science is best served when researchers focus on the size of effects and their practical significance. Advocates the use of confidence intervals for deciding whether chance or sampling variability is an unlikely explanation for an observed effect. Calls for more emphasis on effect sizes in the next edition of the American…