This article uses simulation to compare two test equating methods under the common-item nonequivalent groups design: the frequency estimation method and the chained equipercentile method. An item response theory model is used to define the true equating criterion, simulate group differences, and generate response data. Three linear equating…

Restricted the range of nonnormal distributions by eliminating scores above a designated cutoff value or eliminating scores above or below the mean by a certain distance. Results of a simulation study show that range restriction sometimes increased the correlation between variables having outlier prone distributions. Discusses practical…

Examined the sampling distributions of equating coefficients produced by the characteristic curve method for tests using graded and nominal response scoring using simulated data. For both models and across all three equating situations, the sampling distributions were generally bell-shaped and peaked, and occasionally had a small degree of…

A general delta method is described for computing the standard error (SE) of a chain of linear equations. The general delta method derives the SEs directly from the moments of the score distributions obtained in the equating chain. Computer simulations demonstrate the method. (SLD)

Proposes a marginal Bayesian estimation procedure to improve item parameter estimates for the three parameter logistic model. Computer simulation suggests that implementing the marginal Bayesian estimation algorithm with four-parameter beta prior distributions and then updating the priors with empirical means of updated intermediate estimates can…

Studied whether the theoretical sampling distribution of the U3 person-fit statistic is in agreement with the simulated sampling distribution under different item response theory models and varying item and test characteristics. Simulation results suggest that the use of standard normal deviates for the standardized version of the U3 statistic may…

Compared approaches to determining the precision of gain scores: (1) the asymptotic normal distribution of the maximum likelihood estimator of the person parameter; and (2) the exact conditional distribution of the gain score. Use of three data sets illustrates that these methods yield more relevant and more detailed information than traditional…

A person-fit method that allows researchers to identify nonfitting response vectors is the l(z) statistic. Simulation results show that l(z) may not perform as expected when estimated person parameters are used rather than true person parameters. Other considerations in using true and estimated person parameters are discussed. (SLD)

Using the characteristic curve method for dichotomously scored test items, the sampling distributions of equating coefficients were examined. Simulations indicate that for the equating conditions studied, the sampling distributions of the equating coefficients appear to have acceptable characteristics, suggesting confidence in the values obtained…

Compared the nominal and empirical null distributions of the standardized log-likelihood statistic for polytomous items for paper-and-pencil (P&P) and computerized adaptive tests (CATs). Results show that the empirical distribution of the statistic differed from the assumed standard normal distribution for both P&P tests and CATs. Also…

The reliability coefficient is predicted from the test information function (TIF) or two modified TIF formulas and a specific trait distribution. Examples illustrate the variability of the reliability coefficient across different trait distributions, and results are compared with empirical reliability coefficients. (SLD)

An approximate statistical test is derived for the hypothesis that the intraclass reliability coefficients associated with two measurement procedures are equal. Control of Type 1 error is investigated by comparing empirical sampling distributions of the test statistic with its derived theoretical distribution. A numerical illustration is…

A Monte Carlo simulation explored how to optimize power in the extreme groups strategy when sampling from nonnormal distributions. Results show that the optimum percent for the extreme group selection was approximately the same for all population shapes, except the extremely platykurtic (uniform) distribution. (SLD)

The adequacy of multidimensional trait and item parameters using multidimensional item response theory analysis was studied through simulation using different degrees of correlation between two trait dimensions and the existence of a restricted trait on the second dimension. Conditions allowing adequate recovery of trait and item parameters are…

The delta method was used to derive standard errors (SES) of the Levine observed score and Levine true score linear test equating methods using data from two test forms. SES derived without the normality assumption and bootstrap SES were very close. The situation with skewed score distributions is also discussed. (SLD)