Monte Carlo studies explored the sampling characteristics of Cohen's d and three approximations to Cohen's d when used as average effect size measures in meta-analysis. Reviews of 10, 100, and 500 studies (M) were simulated, with degrees of freedom (df) varied in seven steps from 8 to 58. In a two independent groups design, samples were obtained…

This Monte Carlo study examines whether, given various numbers of variables, treatments, and sample sizes, in a one-way multivariate analysis of variance, Type I error rates of the test approximations provided by the BMDP program, the Statistical Analysis System (SAS), and the Statistical Package for the Social Sciences (SPSS) for Roy's largest…

A Monte Carlo study was done to determine the adequate sample size for quasi-experimental regression studies, which compare regression lines for two groups and estimate their point of intersection. Populations of 1,000 subjects in each of two groups were constructed (using random normal deviates) to yield equivalent regression lines of opposite…

This report documents a computer program for simulation evaluation of item response theory (IRT) ability estimators. This Honeywell DPS version is a very slight modification of the program originally developed in FORTRAN-77 on a DEC VAX 11/780. The model of the world simulated by the program involves a unidimensional test in which the probability…

A normally distributed data set of 1,000 values--ranging from 50 to 150, with a mean of 50 and a standard deviation of 20--was created in order to evaluate the bootstrap method of repeated random sampling. Nine bootstrap samples of N=10 and nine more bootstrap samples of N=25 were randomly selected. One thousand random samples were selected from…

The effects of varying degrees of correlation between abilities and of various correlation configurations between item parameters on ability and item parameter estimation using the three parameter logistic model were examined. Ten two-trait configurations and one unidimensional test configuration for 30 item tests were simulated. Each…

A nominal response model-based computerized adaptive testing procedure (nominal CAT) was implemented using simulated data. Ability estimates from the nominal CAT were compared to those from a CAT based upon the three-parameter logistic model (3PL CAT). Furthermore, estimates from both CAT procedures were compared with the known true abilities used…

This paper reviews the basic elements of the EM approach to estimating item parameters and illustrates its use with one simulated and one real data set. In order to illustrate the use of the BILOG computer program, runs for 1-, 2-, and 3-parameter models are presented for the two sets of data. First is a set of responses from 1,000 persons to five…

The purpose of this study was to investigate the effect of using multidimensional items in a computer adaptive test (CAT) setting which assumes a unidimensional item response theory (IRT) framework. Previous research has suggested that the composite of multidimensional abilities being estimated by a unidimensional IRT model is not constant…

Two approaches for conceptualizing and estimating a contextual model for analyzing student achievement are the separate equation approach and the single equation approach. The separate equation method determines the relationship between the individual-level independent variable and the individual-level dependent variable within each group. It then…

Some examinees' test-taking behavior may be so idiosyncratic that their scores are not comparable to the scores of more typical examinees. Appropriateness indices, which provide quantitative measures of response-pattern atypicality, can be viewed as statistics for testing a null hypothesis of normal test-taking behavior against an alternative…