The paper describes the small sample stability of least square estimates of variance components within the context of generalizability theory. Monte Carlo methods are used to generate data conforming to some selected multifacet generalizability designs to illustrate the sampling behavior of variance component estimates. (Author/CTM)

A new approximation is proposed for testing the equality of "k" independent means in the face of heterogeneity of variance. Monte Carlo simulations show that the new procedure has nearly nominal Type I error rates and Type II error rates that are close to those produced by James's second-order approximation. (SLD)

The variance of the sample difference and the power of the "F" test for mean differences were studied under group matching on covariates and also under random assignment. Results shed light on systematic assignment procedures advocated to provide more precise estimates of treatment effects than simple random assignment. (TJH)

This study integrates into one comprehensive Monte Carlo simulation a vast array of previously defined and substantively interrelated research studies of the robustness of analysis of variance (ANOVA) and analysis of covariance (ANCOVA) statistical procedures. Three sets of balanced ANOVA and ANCOVA designs (group sizes of 15, 30, and 45) and one…

Two bootstrapping or resampling strategies were investigated to determine their applicability to estimating standard errors and ensuing confidence intervals on variance components in two-factor random analysis of variance models. In light of prior negative findings regarding the application of bootstrapping to this particular problem, a…

An influential statistics test recommends a Levene text for homogeneity of variance. A recent note suggests that Levene's test is upwardly biased for small samples. Another report shows inflated Alpha estimates and low power. Neither study utilized more than two sample sizes. This Monte Carlo study involved sampling from a normal population for…

The purpose of this study is to help define the precise nature and limits of the tolerable range in which a researcher may be relatively confident about the statistical validity of his or her research findings, focusing specifically on the statistical validity of results when violating the assumptions associated with the one-way, fixed-effects…

A statistical method has been developed for nested incomplete samples in a longitudinal study in which part of the sample has dropped out in such a way that the data have a nested pattern. A procedure which performed well in a Monte Carlo experiment was extended to a two-factor incomplete design with repeated measures on one factor. Methods…

Accurate estimation of variance components used in generalizability theory is essential for the theory to be viewed as an efficacious mechanism for studying the reliability and validity of a measurement procedure. This paper explores two alternatives for dealing with the apparent instability of small sample size used in determining the accuracy of…