J. Frass and I. Newman (2000) proposed a hypothesis testing procedure that incorporated the following three key elements: (1) the establishment of a practical significance value; (2) the construction of a non-nil null hypothesis that incorporated the practical significance value; and (3) statistical testing of the non-nil null hypothesis with a…

This paper presents a testing procedure that incorporates three key elements. The first element is the use of non-nil null hypotheses. The second element is the determination of a practically significant level that is incorporated into the corresponding non-nil null hypothesis. The third element is the use of a randomization test to statistically…

Over the last few years, there has been evolution, although not a linear one, that has progressed from an emphasis on statistical significance to an emphasis on effect size to an emphasis on both of these concepts to what is believed to be a pragmatic emphasis on replicability. This paper presented two methods of estimating a study's replicability…

Statistical significance and practical significance can be considered jointly through the use of non-nil null hypotheses that are based on values deemed to be practically significant. When examining differences between the means of two groups, researchers can use a randomization test or an independent t test. The issue addressed in this paper is…

A new method for evaluating model fit that is easy to use and interpret is presented. The new method, which uses a binomial test of the number of hypotheses (paths) in a model that are supported by the data, has heuristic value when considering problems associated with other goodness-of-fit measures. An application of the binomial test as a…