The results of a study of find alternative techniques for testing distributional normality are presented. A group of statistical techniques--some established and some new--were compared using empirical techniques. One new technique which appears to have higher power than the Lilliefors test was subjected to a better definition. Distributions under…

Two-stage sampling procedures for comparing two population means when variances are heterogeneous have been developed by D. G. Chapman (1950) and B. K. Ghosh (1975). Both procedures assume sampling from populations that are normally distributed. The present study reports on the effect that sampling from non-normal distributions has on Type I error…

This study was concerned with the effects of reliability of observations, sample size, magnitudes of treatment effects, and the shape of the sampled population on the relative power of the paired samples rank transform statistic and Wilcoxon's signed ranks statistic. (Author/LMO)

The assumption of normality underlies much of the standard statistical methodology. Knowing how to determine whether a sample of measurements is from a normally distributed population is crucial both in the development of statistical theory and in practice. W. Ware and J. Ferron have developed a new test statistic, modeled after the K-squared test…

The test of homogeneity developed by L. V. Hedges (1982) for the fixed effects model is frequently used in quantitative meta-analyses to test whether effect sizes are equal. Despite its widespread use, evidence of the behavior of this test for the less-than-ideal case of small study sample sizes paired with large numbers of studies is…

New multivariate permutation tests are proposed that may be effectively substituted for Hotelling's T-Square test in situations commonly arising in educational research. The new tests: (1) are distribution-free; (2) provide tests of directional as well as non-directional hypotheses; (3) may be tailored for sensitivity to specific treatment…

This paper investigates the performance of CATSIB (a modified version of the SIBTEST computer program) to assess differential item functioning (DIF) in the context of computerized adaptive testing (CAT). One of the distinguishing features of CATSIB is its theoretically built-in regression correction to control for the Type I error rates when the…

Most of the multivariate statistical techniques rely on the assumption of multivariate normality. The effects of non-normality on multivariate tests are assumed to be negligible when variance-covariance matrices and sample sizes are equal. Therefore, in practice, investigators do not usually attempt to remove non-normality. In this simulation…

A comparison is made of the power and actual alpha levels of three tests of homogeneity for independent product-moment correlation coefficients using Monte Carlo methods while selectively studying sample size and varying the number of correlation reliabilities. How robust these are in applied work is discussed. (SLD)

Type I error rate and power for the t test, Wilcoxon-Mann-Whitney test, van der Waerden Normal Scores, and Welch-Aspin-Satterthwaite (W) test are compared for two simulated independent random samples from nonnormal distributions. Conditions under which the t test and W test are best to use are discussed. (SLD)

Power and Type I error rates were estimated for contingency tables with small sample sizes for the following four types of tests: (1) Pearson's chi-square; (2) chi-square with Yates's continuity correction; (3) the likelihood ratio test; and (4) Fisher's Exact Test. Various marginal distributions, sample sizes, and effect sizes were examined. (SLD)

This study investigated the robustness of the James second-order test (James 1951; Wilcox, 1989) and the univariate F test under a two-factor fixed-effect analysis of variance (ANOVA) model in which cell variances were heterogeneous and/or distributions were nonnormal. With computer-simulated data, Type I error rates and statistical power for the…

Psychology studies often have low statistical power. Sample size tables, as given by J. Cohen (1988), may be used to increase power, but they are based on Monte Carlo studies of relatively "tame" mathematical distributions, as compared to psychology data sets. In this study, Monte Carlo methods were used to investigate Type I and Type II…

Monte Carlo methods were employed to assess the relative power of the paired samples t test and Wilcoxon's signed-ranks test under ten population shapes. Results of the study indicated that: (1) each of the two statistics was more powerful than the other in given situations; (2) the power advantages of the t test under normal theory were small;…

This paper presents 11 statistical procedures which test the equality of m coefficient alphas when the sample alpha coefficients are dependent. Several of the procedures are derived in detail, and numerical examples are given for two. (Author/LMO)