This paper presents a derivation of an average between-test overlap index as a function of the item exposure index, for fixed-length computerized adaptive tests (CAT). This relationship is used to investigate the simultaneous control of item exposure at both the item and test levels. Implications for practice as well as future research are also…

There is variability in the estimation of an equating transformation because common-item parameters are obtained from responses of samples of examinees. The most commonly used standard error of equating quantifies this source of sampling error, which decreases as the sample size of examinees used to derive the transformation increases. In a…

The purpose of this study was to investigate the degree to which various selected test item discrimination indices reflect a common factor. The indices used include the point-biserial, biserial, phi and tetrachoric coefficients, Flanagan's approximation of the product-moment correlation, Gulliksen's item reliability index, and Findley's difference…

An empirical investigation of the statistical procedure entitled nonlinear principal components analysis was conducted on a known equation and on measurement data in order to demonstrate the procedure and examine its potential usefulness. This method was suggested by R. Gnanadesikan and based on an early paper of Karl Pearson. (Author/AL)

Relationships among patterns of answer changing and item characteristics on multiple-choice tests are discussed. Results obtained were similar to those found in previous studies but pointed to further relationships among these variables. (Author/GK)

Guttman's mapping sentence technique is examined as a mechanism for defining domains of cognitive behavior and for generating test items to measure achievement in those domains. The utility of the mechanism as compared to alternatives is discussed. (Author/JKS)

The G index is a measure of similarity between pairs of dichotomized items. The G index is generalized here to the case where items are trichotomized. (JKS)

The simultaneous assessment of differential item functioning (DIF) for a collection of test items through an index that measures the variance of DIF on a test as an indicator of the degree to which different items show DIF in different directions is proposed and evaluated through simulations. (SLD)

Analysis of test item banks in 10 auditing textbooks found that 75% of questions violated one or more guidelines for multiple-choice items. In comparison, 70% of a certified public accounting exam bank had no violations. (SK)

Describes an extension to the Rasch model for fundamental measurement in which there is parameterization not only for examinee ability and item difficulty but also for judge severity. Discusses variants of this model and judging plans, and explains its use in an empirical testing situation. (SLD)

Presents empirically based item selection guidelines for moving the cut score on equated tests consisting of "n" dichotomous items calibrated assuming the Rasch model. Derivations of lemmas that underlie the guidelines are provided as well as a simulated example. (SLD)

The mixture index of fit (T. Rudas et al, 1994) is used to estimate the fraction of a population for which differential item functioning (DIF) occurs, and this approach is compared to the Mantel Haenszel test of DIF. The proposed noniterative procedure provides information about data portions contributing to DIF. (SLD)

Presents two mathematical programming approaches for the assembly of ability tests from item pools calibrated under a multidimensional item response theory model. Item selection is based on the Fisher information matrix. Illustrates the method through empirical examples for a two-dimensional mathematics item pool. (SLD)

Examined the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system based on the partial credit model. Simulation results show the Sympson-Hetter technique can be used with minimal impact on measurement precision,…

Studied the impact of systematic item feature variation on item statistical characteristics and the degree to which such information could be used as collateral information to supplement examinee performance data and reduce pretest sample size by generating 2 families of 48 word problem variants for the Graduate Record Examinations. Results with…