In the nonequivalent groups with anchor test (NEAT) design, there are several ways to use the information provided by the anchor in the equating process. One of the NEAT-design equating methods is the linear observed-score Levine method (Kolen & Brennan, 2004). It is based on a classical test theory model of the true scores on the test forms…

Current modeling of response times on test items has been strongly influenced by the paradigm of experimental reaction-time research in psychology. For instance, some of the models have a parameter structure that was chosen to represent a speed-accuracy tradeoff, while others equate speed directly with response time. Also, several response-time…

A widely used approach for categorizing the level of differential item functioning (DIF) in dichotomous items is the scheme proposed by Educational Testing Service (ETS) based on a transformation of the Mantel-Haeszel common odds ratio. In this article two classification schemes for DIF in polytomous items (referred to as the P1 and P2 schemes)…

Most item response theory models are not robust to violations of conditional independence. However, several modeling approaches (e.g., conditioning on other responses, additional random effects) exist that try to incorporate local item dependencies, but they have some drawbacks such as the nonreproducibility of marginal probabilities and resulting…

In this article, data from the Reading Literacy study conducted in 2000 and 2001 as part of the OECD "Programme for International Student Assessment" (PISA) were analysed in order to explore equivalence issues across the 47 test adaptations in various languages of instruction that were used by the participating countries. On average,…

Type I error rates of the likelihood ratio test for the detection of differential item functioning (DIF) in the partial credit model were investigated using simulated data. The partial credit model with four ordered performance levels was used to generate data sets of a 30-item test for samples of 300 and 1,000 simulated examinees. Three different…

An alternative method of finding a common metric for separate calibrations through the use of a common (anchor) set of items is presented. Based on Raju's (1988) method of calculating the area between the two item response functions, this (area-minimization) method minimizes the sum of the squared exact unsigned areas of each of the common items.…

This study provided preliminary results about the performance of the DIMTEST statistical procedure for detecting multidimensionality with data simulated from both compensatory and noncompensatory models under a latent structure where all items in a test were influenced by the same two abilities. For the first case, data were simulated to reflect…

Considers tests of unidimensionality in polytomous Rasch models against a specified alternative, given by a partition of the items into subgroups, that are believed to measure different dimensions of the latent construct. Uses data from an occupational health study to motivate and illustrate the methods. (SLD)

Studied the evidence for the practice of using parcels of item as manifest variables in structural equation modeling procedures. Findings suggest that the unconsidered use of parcels is never warranted, but the considered use of parcels cannot be dismissed out of hand. Describes a number of parceling techniques and their strengths and weaknesses.…

Provides a general method that adjusts for the inflation of information associated with a test containing item clusters and a computational scheme for the evaluation of the factors of adjustment for clusters in the restrictive and general cases. Illustrates the approach with an analysis of National Assessment of Educational Progress data. (SLD)

Evaluated multidimensional linking procedures based on a framework recently proposed by T. Davey, T. Oshima, and K. Lee (1966): (1) the Direct method; (2) the Equated Function method; (3) the Test Characteristic Function method; and (4) the Item Characteristic Function method. Simulation results indicate advantages to the last two methods, but all…

Demonstrates how the mean and covariance structure analysis model of D. Sorbom (1974) can be used to detect uniform and nonuniform differential item functioning (DIF) on polytomous ordered response items assumed to approximate a continuous scale. Uses results from 773 civil service employees administered the Kirton Adaption-Innovation Inventory…

The primary purpose of this study was to provide preliminary validity evidence for a 140-item form of the Vocabulary Size Test, which is designed to measure written receptive knowledge of the first 14,000 words of English. Nineteen native speakers of English and 178 native speakers of Japanese participated in the study. Analyses based on the Rasch…

Title III of Public Law 107-110 (No Child Left Behind; NCLB) provided for creation of assessments of English language learners (ELLs) and established, through the Enhanced Assessment Grant program, a platform from which four consortia of states developed ELL tests aligned to rigorous statewide content standards. Those four tests (ACCESS for ELLs,…