We present three strategies to replace the null hypothesis statistical significance testing approach in psychological research: (1) visual representation of cognitive processes and predictions, (2) visual representation of data distributions and choice of the appropriate distribution for analysis, and (3) model comparison. The three strategies…

Various indices for measuring agreement among several raters on the presence or absence of a trait can be interpreted as intraclass correlation coefficients. Such a reformulation clarifies the relationships among the measures, simplifies the computations involved, and permits simple significance tests to be carried out. An illustrative example is…

To determine the effect of violating the assumption of homogeneity of covariance for the Tukey Wholly Significant Difference (WSD) test, Monte Carlo simulations varied the number of treatment groups, sample size, and degree of covariance heterogeneity. As covariance heterogeneity was increased, the empirical significance levels increased beyond…

Theta is a statistic which measures the degree to which a designated pattern successfully partitions a matrix of pre- and post-treatment ratings into regions typical of each of two treatments. In this paper, theta is extended to multivariate and multigroup cases. (Author/BW)

Procedures are described for determining the statistical significance of a set of ratings made on bidirectional (B) scales. B and its statistical significance can be determined on samples of items or raters. The statistical significance of a mean of B values can be assessed by applying a normal approximation test. (Author/DWH)

Available approaches for determing significant differences between various groups are considered for use when the homogeneity of slopes precludes standard analysis of covariance. The advantages and statistical procedures for relating to a reference group are presented and criteria are suggested for choosing the best groups. (Author)

The effects of some restraints not included in the classical assumptions of the F- and H-Test (e.g., correlation of mean and sample size) were examined in a simulation design. Also simulated was a situation in which two assumptions were not met simultaneously. (Author/BW)

An analytic procedure is presented which casts sequential moderator analysis in the role of a multivariate test of parallelism of regressions. The procedure addresses a test for comparing predictor-criterion relationships for one set of measurements or multiple predictors and repeated measurements on a criterion. (Author/PN)

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)

Either Bartlett's chi-square test of sphericity or Steiger's chi-square test can be used to test the significance of a correlation matrix to determine the appropriateness of factor analysis. They were evaluated using computer-generated correlation matrices. Steiger's test is recommended due to its increased power and computational simplicity.…

The interpretation of significant left-tailed analysis of variance (ANOVA) F-ratios is supported by considering the case of a fixed effects ANOVA model. The conclusions of this case are generalizable to other standard ANOVA models. (Author/PN)