An approximate statistical test is derived for the hypothesis that the intraclass reliability coefficients associated with two measurement procedures are equal. Control of Type 1 error is investigated by comparing empirical sampling distributions of the test statistic with its derived theoretical distribution. A numerical illustration is…

A Monte Carlo simulation explored how to optimize power in the extreme groups strategy when sampling from nonnormal distributions. Results show that the optimum percent for the extreme group selection was approximately the same for all population shapes, except the extremely platykurtic (uniform) distribution. (SLD)

The adequacy of multidimensional trait and item parameters using multidimensional item response theory analysis was studied through simulation using different degrees of correlation between two trait dimensions and the existence of a restricted trait on the second dimension. Conditions allowing adequate recovery of trait and item parameters are…

Investigates the BILOG computer program's ability to recover known item parameters for different numbers of items, examinees, and variances of the prior distributions of discrimination parameters for the two-parameter logistic item-response theory model. For samples of at least 250 examinees and 15 items, simulation results support using BILOG.…

Performance of the logistic regression (LR) procedure was compared to that of the Mantel Haenszel (MH) procedure in the detection of uniform and nonuniform differential item functioning on a simulation examining distributional properties of the LR and MH test statistics and the relative power of the two procedures. (SLD)

Studied the extent to which three appropriateness indexes, Z(sub 3), ECIZ4, and W, are well standardized in a Monte Carlo study. The ECIZ4 most closely approximated a normal distribution, and its skewness and kurtosis were more stable and less affected by test length and item response theory model than the others. (SLD)

Previous work on the mathematical and implementation details of the marginalized maximum likelihood estimation procedure is extended to encompass the marginalized Bayesian procedure for estimating item parameters of R. J. Mislevy (1986) and to communicate this procedure to users of the BILOG computer program. (SLD)

The sensitivity of marginal maximum likelihood estimation of item and ability (theta) parameters was examined when prior ability distributions were not matched to underlying ability distributions. Thirty sets of 45-item test data were generated. Conditions affecting the accuracy of estimation are discussed. (SLD)

Derivations of several item selection algorithms for use in fitting test items to target information functions (IFs) are described. These algorithms, which use an average growth approximation of target IFs, were tested by generating six test forms and were found to provide reliable fit. (SLD)

A new model is presented that explains reaction time fluctuations in prolonged work tasks. The model extends the so-called Poisson-Erlang model and accounts for long-term trend effects in the reaction time curve. The model is consistent with Spearman's hypothesis that inhibition increases during work and decreases during rest. (TJH)

A mathematical model is proposed to describe how group differences in distributions of abilities, which are distinct from the target ability, influence the probability of a correct item response. In the multidimensional approach, differential item functioning is considered a function of the educational histories of the examinees. (SLD)