Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions and recent work has considered the role of bounding approaches that provide a range of treatment impact…

Bayesian inference for structural equation models (SEMs) is increasingly popular in social and psychological sciences owing to its flexibility to adapt to more complex models and the ability to include prior information if available. However, there are two major hurdles in using the traditional Bayesian SEM in practice: (1) the information nested…

Recently Watkins, Bargagliotti, and Franklin (2014) discovered that simulations of the sampling distribution of the mean can mislead students into concluding that the mean of the sampling distribution of the mean depends on sample size. This potential error arises from the fact that the mean of a simulated sampling distribution will tend to be…

New York City's elite public specialized high schools have a long history of offering a rigorous college preparatory education to the City's most academically talented students. Though immensely popular and highly selective, their policy of admitting students on the basis of a single entrance exam has been heavily criticized. Many argue, for…

In this study, we compared 12 statistical strategies proposed for selecting loglinear models for smoothing univariate test score distributions and for enhancing the stability of equipercentile equating functions. The major focus was on evaluating the effects of the selection strategies on equating function accuracy. Selection strategies' influence…

On the 2009 AP[c] Statistics Exam, students were asked to create a statistic to measure skewness in a distribution. This paper explores several of the most popular student responses and evaluates which statistic performs best when sampling from various skewed populations. (Contains 8 figures, 3 tables, and 4 footnotes.)

Restricted the range of nonnormal distributions by eliminating scores above a designated cutoff value or eliminating scores above or below the mean by a certain distance. Results of a simulation study show that range restriction sometimes increased the correlation between variables having outlier prone distributions. Discusses practical…

Examined the sampling distributions of equating coefficients produced by the characteristic curve method for tests using graded and nominal response scoring using simulated data. For both models and across all three equating situations, the sampling distributions were generally bell-shaped and peaked, and occasionally had a small degree of…

Describes available variance component tests and presents three new score tests. One test uses the asymptotic normal distribution of the test statistic as a reference distribution; the others use a Satterthwaite approximation for the null distribution of the test statistic. Evaluates the performance of these tests through Monte Carlo simulation.…

Compared the analysis of variance (ANOVA) "F" and several nonparametric competitors for two-way designs for empirical alpha and power through simulation. Results suggest the ANOVA "F" suffers from conservative alpha and power for the mixed normal distribution, but is generally recommended. (Author/SLD)

The normality of number distributions generated by various random-number generators were studied, focusing on when the random-number generator reached a normal distribution and at what sample size. Findings suggest the steps that should be followed when using a random-number generator in a Monte Carlo simulation. (SLD)

Previous studies that investigated the effect of unequal ability distributions on the Type I error (TIE) of the Mantel-Haenszel chi-square test for detecting differential item functioning (DIF) simulated ability distributions that differed only in means. This simulation study suggests that the magnitude of TIE inflation is increased, and the type…

Presents a hierarchical Bayes approach to modeling parameter heterogeneity in generalized linear models. The approach combines the flexibility of semiparametric latent class models that assume common parameters for each subpopulation and the parsimony of random effects models that assume normal distributions for the regression parameters.…

Assessed the relative merits of the Student "t" test and the Wilcoxon rank sum test under four population distributions and six sample-size pairings through Monte Carlo methods. The Wilcoxon rank sum test demonstrated an advantage in statistical power for nonnormal distributions (but not normal distributions), with fewer Type III errors…

This paper evaluated multidimensional linking procedures with which multidimensional test data from two separate calibrations were put on a common scale. Data were simulated with known ability distributions varying on two factors which made linking necessary: mean vector differences and variance-covariance (v-c) matrix differences. After the…