The work of R. MacCallum et al. (1992) was extended by examining chance modifications through a Monte Carlo simulation. The stability of post hoc model modifications was examined under varying sample size, model complexity, and severity of misspecification using 2- and 4-factor oblique confirmatory factor analysis (CFA) models with four and eight…

In the present study Monte Carlo methods were employed to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. Sampling error influences were investigated across variations in variable and sample (n) sizes, and across variations in average within-set correlation sizes and in…

This article proposes a method for testing equality of variances which exploits Pitman's idea and the computational power of simulations. Several advantages to this method are illustrated. A Monte Carlo study for several combinations of sample sizes and number of variables is presented. (Author/LMO)

Simulation studies were used to explore the relationship between Type I error rates (statistical conclusion validity) and multiple testing in data sets exhibiting varying degrees of independence. Implications for reporting and interpreting educational data are discussed, and methods of determining or reducing Type I error incidence are presented.…

A new approximation is proposed for testing the equality of "k" independent means in the face of heterogeneity of variance. Monte Carlo simulations show that the new procedure has nearly nominal Type I error rates and Type II error rates that are close to those produced by James's second-order approximation. (SLD)

Monte Carlo studies explored the sampling characteristics of Cohen's d and three approximations to Cohen's d when used as average effect size measures in meta-analysis. Reviews of 10, 100, and 500 studies (M) were simulated, with degrees of freedom (df) varied in seven steps from 8 to 58. In a two independent groups design, samples were obtained…

The present simulation study confirms that the corrected epsilon approximate test of B. Lecoutre yields a less biased estimation of population epsilon and reduces Type I error rates when compared to the epsilon approximate test of H. Huynh and L. S. Feldt. (SLD)

A Monte Carlo study was done to determine the adequate sample size for quasi-experimental regression studies, which compare regression lines for two groups and estimate their point of intersection. Populations of 1,000 subjects in each of two groups were constructed (using random normal deviates) to yield equivalent regression lines of opposite…

A modification of a test of the equality of nonindependent alpha reliability coefficients is proposed. It avoids the limitation that the product of the number of test parts times the number of subjects be quite large. Monte Carlo studies indicate that this test can be used in comparing interrater reliabilities. (SLD)

A normally distributed data set of 1,000 values--ranging from 50 to 150, with a mean of 50 and a standard deviation of 20--was created in order to evaluate the bootstrap method of repeated random sampling. Nine bootstrap samples of N=10 and nine more bootstrap samples of N=25 were randomly selected. One thousand random samples were selected from…

This paper presents 11 statistical procedures which test the equality of m coefficient alphas when the sample alpha coefficients are dependent. Several of the procedures are derived in detail, and numerical examples are given for two. (Author/LMO)

Simulated data typical of those from meta analyses are used to evaluate the reliability, Type I and Type II errors, bias, and standard error of the meta-analytic procedures of Schmidt and Hunter (1977). Concerns about power, reliability, and Type I errors are presented. (SLD)

In an experiment manipulating artificial data in a factorial design, model misspecification and varying levels of error in measurement and in model structure are shown to have significant effects on LISREL parameter estimates in a modified peer influence model. (Author/LMO)

Item analysis data fitting the normal ogive model were simulated in order to investigate the problems encountered when applying the three-parameter logistic model. Binary item tests containing 10 and 35 items were created, and Monte Carlo methods simulated the responses of 2,000 and 500 examinees. Item parameters were obtained using Logist 5.…

Meta-analytic methods were used to summarize results of Monte Carlo (MC) studies investigating the robustness of various statistical procedures for testing within-subjects effects in split-plot repeated measures designs. Through a literature review, accessible MC studies were identified, and characteristics (simulation factors) and outcomes (rates…