Researchers are encouraged to report effect size statistics to quantify treatment effects or effects due to group differences. However, estimates of effect sizes, most commonly Cohen's "d," make assumptions about the distribution of data that are not always true. An alternative nonparametric estimate of effect size, relying on the median…

Multilevel latent class analysis (MLCA) has been increasingly used to investigate unobserved population heterogeneity while taking into account data dependency. Nonparametric MLCA has gained much popularity due to the advantage of classifying both individuals and clusters into latent classes. This study demonstrated the need to relax the…

Many of the analytical models commonly used in educational research often aim to maximize explained variance and identify variable importance within models. These models are useful for understanding general ideas and trends, but give limited insight into the individuals within said models. Data envelopment analysis (DEA), is a method rooted in…

Randomized controlled trials are not always feasible in educational research, so researchers must use alternative methods to study treatment effects. Propensity score matching is one such method for observational studies that has shown considerable growth in popularity since it was first introduced in the early 1980s. This paper outlines the…

Some IRT models can be equivalently modeled in alternative frameworks such as logistic regression. Logistic regression can also model time-to-event data, which concerns the probability of an event occurring over time. Using the relation between time-to-event models and logistic regression and the relation between logistic regression and IRT, this…

This study investigated the effect of complex structure on dimensionality assessment in compensatory multidimensional item response models using DETECT- and NOHARM-based methods. The performance was evaluated via the accuracy of identifying the correct number of dimensions and the ability to accurately recover item groupings using a simple…

Latent class analysis is an analytic technique often used in educational and psychological research to identify meaningful groups of individuals within a larger heterogeneous population based on a set of variables. This technique is flexible, encompassing not only a static set of variables but also longitudinal data in the form of growth mixture…

The authors performed a Monte Carlo simulation to empirically investigate the robustness and power of 4 methods in testing mean differences for 2 independent groups under conditions in which 2 populations may not demonstrate the same pattern of nonnormality. The approaches considered were the t test, Wilcoxon rank-sum test, Welch-James test with…

The authors generated exact probability distributions for sample sizes up to 35 in each of three groups ("n" less than or equal to 105) and up to 10 in each of four groups ("n" less than or equal to 40). They compared the exact distributions to the chi-square, gamma, and beta approximations. The beta approximation was best in…

Increasing the correlation between the independent variable and the mediator ("a" coefficient) increases the effect size ("ab") for mediation analysis; however, increasing a by definition increases collinearity in mediation models. As a result, the standard error of product tests increase. The variance inflation caused by…

Reporting effect size plays an integral role in educational and psychological research and is required by many journals. Certainly, the best-known measure of effect size is Cohen's d, which represents a substantial improvement over using p values. But Cohen's d is known to suffer from some fundamental concerns. The author's goal was to illustrate…

Uses computer simulation to study the effects on parametric and nonparametric statistical tests when assumptions of normality and homogeneity of variance are violated. Results reveal that nonparametric methods are not always acceptable substitutes for parametric methods in research studies when parametric assumptions are not satisfied. (SLD)

The power functions of Student t tests performed on initial scores, ordinary ranks, 3 kinds of modular ranks, and dichotomies were investigated for 1 normal and 3 nonnormal distributions using 2 samples of 26 simulated scores each. Advantages of extending the rank transformation concept are discussed. (SLD)

Explains a situation in which the standard nonparametric one-sample runs test gives anomalous results and describes a procedure that allows the maximum run length to be determined empirically through a Monte Carlo permutation test. Illustrates the new procedure with examples from suicide research and psycholinguistics. (SLD)

It is argued that outlier-prone distributions reduce the power of nonparametric tests, but power can be restored through procedures usually associated with parametric tests. Computer simulation is used to show how an outlier detection and downweighting procedure augments the power of the t-test and the Wilcoxon-Mann-Whitney test. (SLD)