We present three strategies to replace the null hypothesis statistical significance testing approach in psychological research: (1) visual representation of cognitive processes and predictions, (2) visual representation of data distributions and choice of the appropriate distribution for analysis, and (3) model comparison. The three strategies…

A common question in test evaluation is whether an a priori assignment of items to subtests is supported by empirical data. If the analysis results indicate the assignment of items to subtests under study is not supported by data, the assignment is often adjusted. In this study the authors compare two methods on the quality of their suggestions to…

Differences between per experiment (PE) and experimentwise (EW) error rates were studied through simulation for several multiple-comparison procedures for both pairwise comparisons and planned contrasts. Results suggest ways to control PE rates through new multiple-comparison procedures that maximize experimental power while controlling Type I…

Kelley compared three methods for setting a confidence interval (CI) around Cohen's standardized mean difference statistic: the noncentral-"t"-based, percentile (PERC) bootstrap, and biased-corrected and accelerated (BCA) bootstrap methods under three conditions of nonnormality, eight cases of sample size, and six cases of population…

Sixteen measures of reliability for two-category nominal scales are compared. Upon correcting for chance agreement, there are only five distinct indices: Fleiss's modification of A-sub-1, the phi coefficient, Cohen's kappa, and two intraclass coefficients. Recommendations for choosing an agreement index are made based on definitions, magnitude,…

Complete paired comparisons data was obtained by use of multiple rank order (MRO) in the context of gathering rank order preferences of grade six students, their parents, and teachers for instructional objectives. Partially balanced incomplete block designs with two associate classes were used in the MRO instruments instead of the usual balanced…

The authors previously discussed the importance of effect size and Type II errors as factors in determining sample size. Tables were developed and presented for one-factor designs with k levels. As these tables could not be used for the one sample case, comparable tables were developed and are presented. (Author/DWH)

The Little Jiffy" consists of principal components analysis and varimax rotation of all components with eigenvalues greater than one. (DG)

A computer program designed to compare factors from similar concept matrices (person by scale) obtained at different times is presented. (PR)

Either Bartlett's chi-square test of sphericity or Steiger's chi-square test can be used to test the significance of a correlation matrix to determine the appropriateness of factor analysis. They were evaluated using computer-generated correlation matrices. Steiger's test is recommended due to its increased power and computational simplicity.…

A strategy is proposed for conceptualizing moderating relationships based on their type (strictly correlational and classically correlational) and form, whether continuous, noncontinuous, logistic, or quantum. Results of computer simulations comparing three statistical approaches for assessing moderator variables are presented, and advantages of…