In his early exposition of path analysis, Duncan (1966) noted that the method "provides a calculus for indirect effects." Despite the interest in indirect causal effects, most users treat them as if they are population parameters and do not test whether they are statistically significant. Sobel (1982) has recently derived the asymptotic…

A dialog between two fictional teachers provides some basic examples of how research that uses approved methodology may provide results that are significant statistically but not significant practically. (PGD)

The second half of a dialogue between two fictional teachers examines the significance of statistical significance in research and considers the factors affecting the extent to which research results provide important or useful information. (PGD)

An explanation of the misuse of statistical significance testing and the true meaning of "significance" is offered. Literature about the criticism of current practices of researchers and publications is reviewed in the context of tests of significance. The problem under consideration occurs when researchers attempt to do more than just establish…

The original nine programs for semantic differential analysis have been condensed into three programs which have been further refined and augmented. They yield: (1) means, standard deviations, and standard errors for each subscale on each concept; (2) Evaluation, Potency, and Activity (EPA) means, standard deviations, and standard errors; (3)…

Attempts to distill a growing technical literature on repeated-measures analysis of variance into a few simple principles for selecting an analytic technique. Argues that researchers ought not opt for a general analysis strategy when current computer technology makes it possible to select the optimal analysis technique for a given data set. (RH)

This commentary on EC 603 695 argues that significance testing is a necessary but insufficient condition for positivistic research, that judgment-based assessment and single-subject research are not substitutes for significance testing, and that sampling fluctuation should be considered as one of numerous epistemological concerns in any…

This paper reviews criticism on misinterpretation and overuse of significance testing in the social sciences and examines use of effect size measures to enhance interpretation of significance testing. Review of typical effect size measures and their application is followed by analysis of use of effect size measures in studies reported over 10…

This article compares three models that have been the foundation for approaches to the analysis of statistical significance in early childhood research--the Fisherian and the Neyman-Pearson models (both considered "classical" approaches), and the Bayesian model. The article concludes that all three models have a place in the analysis of research…

This tutorial summarizes some of the widely known limitations of tests of statistical significance and then focuses on extracting measures of variation accounted for as a supplement to significance testing. Two measures of variation accounted for, eta squared and omega squared, are discussed. Computational formulas, computational examples, and…

This paper argues that judgment-based assessment of data from multiply replicated single-subject or small-N studies should replace normative-based (p=less than 0.05) assessment of large-N research in the clinical sciences, and asserts that inferential statistics should be abandoned as a method of evaluating clinical research data. (Author/JDD)

A general model is described which can be used to represent the four common types of meta-analysis: (1) estimation of effect size by combining study outcomes; (2) estimation of effect size by contrasting study outcomes; (3) estimation of statistical significance by combining study outcomes; and (4) estimation of statistical significance by…

Theories employed to explain regularities in social behavior often contain explicit or implicit reference to the presence of nonlinear and/or nonadditive (i.e., multiplicative) relationships among germane variables. While such nonadditive features are theoretically important, the inclusion of quadratic or multiplicative terms in structural…

The present essay outlines how mixed methods research can be used to enhance the interpretation of significant findings. First, we define what we mean by significance in educational evaluation research. With regard to quantitative-based research, we define the four types of significance: statistical significance, practical significance, clinical…

Statistical measures of practical significance report the extent to which variation in the dependent variable can be explained by the independent variable. Reports of special education research sometimes discuss practicality using the estimate of statistical significance. Practical significance, however, may vary greatly among samples even though…