A recent paper uses Bayes factors to argue a large minority of rigorous, large-scale education RCTs are "uninformative." The definition of "uninformative" depends on the authors' hypothesis choices for calculating Bayes factors. These arguably overadjust for effect size inflation and involve a fixed prior distribution,…

The aim of the current study is to validate the invariance of major profile patterns derived from multidimensional scaling (MDS) by bootstrapping. Profile Analysis via Multidimensional Scaling (PAMS) was employed to obtain profiles and bootstrapping was used to construct the sampling distributions of the profile coordinates and the empirical…

This study was concerned with the effects of reliability of observations, sample size, magnitudes of treatment effects, and the shape of the sampled population on the relative power of the paired samples rank transform statistic and Wilcoxon's signed ranks statistic. (Author/LMO)

The use of and emphasis on statistical significance testing has pervaded educational and behavioral research for many decades in spite of criticism by prominent researchers in this field. Much of the controversy is caused by lack of understanding or misinterpretations. This paper reviews criticisms of statistical significance testing and discusses…

Central limit theorem (CLT) is considered an important topic in statistics, because it serves as the basis for subsequent learning in other crucial concepts such as hypothesis testing and power analysis. There is an increasing popularity in using dynamic computer software for illustrating CLT. Graphical displays do not necessarily clear up…

This paper discusses the issue of multiple testing and overall Type I error rates in contexts other than multiple comparisons of means. It demonstrates, using a 5 x 5 correlation matrix, the application of 5 recently developed modified Bonferroni procedures developed by the following authors: (1) Y. Hochberg (1988); (2) B. S. Holland and M. D.…

Formulae and graphs are presented allowing computation of the variances of three prototypical distributions over a finite number of categories. The uses of the variances of the maximum variance distribution, the uniform distribution and a unimodal triangular distribution to make inferences about distribution shapes are shown in several examples.…

An approximate statistical test is derived for the hypothesis that the intraclass reliability coefficients associated with two measurement procedures are equal. Control of Type 1 error is investigated by comparing empirical sampling distributions of the test statistic with its derived theoretical distribution. A numerical illustration is…

A statistical test for the detection of answer copying on multiple-choice tests is presented. The test is based on the idea that the answers of examinees to test items may be the result of three possible processes: (1) knowing, (2) guessing, and (3) copying, but that examinees who do not have access to the answers of other examinees can arrive at…

New multivariate permutation tests are proposed that may be effectively substituted for Hotelling's T-Square test in situations commonly arising in educational research. The new tests: (1) are distribution-free; (2) provide tests of directional as well as non-directional hypotheses; (3) may be tailored for sensitivity to specific treatment…

Despite the increasing criticism of statistical significance testing by researchers, particularly in the publication of the 1994 American Psychological Association's style manual, statistical significance test results are still popular in journal articles. For this reason, it remains important to understand the logic of inferential statistics. A…

To assess problems in hypothesis testing and model comparisons based on normed indices caused by latent class models with sparse contingency tables, a simulation was carried out investigating the distributions of the likelihood ratio statistic, the Pearson statistic chi-square, and a new goodness of fit statistic. (SLD)

The observed probability "p" is the social scientist's primary tool for evaluating the outcome of statistical hypothesis tests. The small-sample accuracy of nonnull asymptotic distributions of several functions of "p" was studied. Implications for use of the approximations are discussed. (SLD)

Modifications are proposed to the recently developed method of comparing one-step M-estimators of location corresponding to two independent groups that provides good control over the probability of Type I error even for unequal sample size, unequal variances, and different shaped distributions. Simulation results reveal cautions required. (SLD)

This study compared the model of J. E. Grizzle, C. F. Starmer, and G. G. Koch (GSK, 1969) and log-linear model-based approaches for testing hypotheses in r x c contingency tables. Tables were simulated under various conditions of table, sample, row-effect size, and column-effect size. Test statistics for column (main) and interaction effects were…