The purpose of this study was to explore the degree of grain size of the attributes and the sample sizes that can support accurate parameter recovery with the General Diagnostic Model (GDM) for a large-scale international assessment. In this resampling study, bootstrap samples were obtained from the 2003 Grade 8 TIMSS in Mathematics at varying…

Two-stage sampling procedures for comparing two population means when variances are heterogeneous have been developed by D. G. Chapman (1950) and B. K. Ghosh (1975). Both procedures assume sampling from populations that are normally distributed. The present study reports on the effect that sampling from non-normal distributions has on Type I error…

Investigates the BILOG computer program's ability to recover known item parameters for different numbers of items, examinees, and variances of the prior distributions of discrimination parameters for the two-parameter logistic item-response theory model. For samples of at least 250 examinees and 15 items, simulation results support using BILOG.…

New multivariate permutation tests are proposed that may be effectively substituted for Hotelling's T-Square test in situations commonly arising in educational research. The new tests: (1) are distribution-free; (2) provide tests of directional as well as non-directional hypotheses; (3) may be tailored for sensitivity to specific treatment…

Asymptotic distributions of H. Brogden's and F. Lord's modified sample biserial correlation coefficients (SBCCs) are derived. Asymptotic variances of these estimators are evaluated for bivariate normal populations and compared to the maximum likelihood estimator's asymptotic variance. These estimators are less variable than ordinary SBCCs when the…

The L statistic of E. B. Page (1963) tests the agreement of a single group of judges with an a priori ordering of alternative treatments. This paper extends the two group test of D. W. Leitner and C. M. Dayton (1976), an extension of the L test, to analyze difference in consensus between two unequally sized groups of judges. Exact critical values…

Most of the multivariate statistical techniques rely on the assumption of multivariate normality. The effects of non-normality on multivariate tests are assumed to be negligible when variance-covariance matrices and sample sizes are equal. Therefore, in practice, investigators do not usually attempt to remove non-normality. In this simulation…

The observed probability "p" is the social scientist's primary tool for evaluating the outcome of statistical hypothesis tests. The small-sample accuracy of nonnull asymptotic distributions of several functions of "p" was studied. Implications for use of the approximations are discussed. (SLD)

Modifications are proposed to the recently developed method of comparing one-step M-estimators of location corresponding to two independent groups that provides good control over the probability of Type I error even for unequal sample size, unequal variances, and different shaped distributions. Simulation results reveal cautions required. (SLD)

The extent to which log-linear smoothing could improve the accuracy of common-item equating by the chained equipercentile method in small samples of examinees was investigated with responses from a 100-item test and 93,283 examinees. Smoothing reduced the sample size required for a given degree of accuracy. (SLD)

Psychology studies often have low statistical power. Sample size tables, as given by J. Cohen (1988), may be used to increase power, but they are based on Monte Carlo studies of relatively "tame" mathematical distributions, as compared to psychology data sets. In this study, Monte Carlo methods were used to investigate Type I and Type II…

The effects of sample size, number of variables, and population value of the congruence coefficient on the sampling distribution of the congruence coefficient were examined. Sample data were generated on the basis of the common factor model, and principal axes factor analyses were performed. (Author/LMO)

Effects of test length, sample size, and assumed ability distribution were investigated in a multiple replication Monte Carlo study under the 1-parameter (1P) and 2-parameter (2P) logistic graded model with five score levels. Accuracy and variability of item parameter and ability estimates were examined. Monte Carlo methods were used to evaluate…

The empirical performance of the technique proposed by P. O. Johnson and J. Neyman (1936) (the JN technique) and the modification of R. F. Potthoff (1964) was studied in simulated data settings. The robustness of the two JN techniques was investigated with respect to their ability to control Type I and Type III errors. Factors manipulated in the…

Large sample standard errors of linear equating for the single-group design are derived without making the normality assumption. Two general methods based on the delta method of M. Kendall and A. Stuart (1977) are described. One method uses the exact partial derivatives, and the other uses numerical derivatives. Simulation using the beta-binomial…