The standard error of the maximum likelihood ability estimator is commonly estimated by evaluating the test information function at an examinee's current maximum likelihood estimate (a point estimate) of ability. Because the test information function evaluated at the point estimate may differ from the test information function evaluated at an…

This article examines nonmathematical linguistic complexity as a source of differential item functioning (DIF) in math word problems for English language learners (ELLs). Specifically, this study investigates the relationship between item measures of linguistic complexity, nonlinguistic forms of representation and DIF measures based on item…

The five papers in this special issue of the "Journal of Applied Testing Technology" address fundamental issues of validity when tests are modified or accommodations are provided to English Language Learners (ELL) or students with disabilities. Three papers employed differential item functioning (DIF) and factor analysis and found the…

The present study employed multi-faceted Rasch measurement (MFRM) to explore the rater bias patterns of native English-speaker (NES) raters when they rate EFL essays. Forty NES raters rated 40 essays written by female Japanese university students on a single topic adapted from the TOEFL Test of Written English (TWE). The essays were assessed using…

The High School Longitudinal Study of 2009 (HSLS:09) is the fifth in a series of National Center for Education Statistics (NCES) secondary longitudinal studies. The core research questions for HSLS:09 explore secondary to postsecondary transition plans and the evolution of those plans; the paths into and out of science, technology, engineering,…

Should the Russians be included in the evaluation and, if so, how can that be done? Based on the axiological assumption that the social justice theory of ethics leads to an awareness of the need to redress inequalities by giving precedence, or at least equal weight, to the voice of the least advantaged groups in society who may not have sufficient…

N. S. Raju, W. J. van der Linden, and P. F. Fleer (in press) have proposed an item response theory-based, parametric procedure for the detection of differential item functioning (DIF)/differential test functioning (DTF) known as differential functioning of item and test (DFIT). DFIT can be used with dichotomous, polytomous, or multidimensional…

On a test (Black Intelligence Test of Cultural Homogeneity) oriented toward the language, attitudes, and life-styles of Afro-Americans, white students perform more poorly than blacks do on tests oriented toward white middle-class values, indicating that there are important dissimilarities in the cultural backgrounds of blacks and whites.…

A test bias definition, applicable at the item-level of a test is presented. The definition conceptually equates test bias with measuring different things in different groups, and operationally equates test bias with a difference in item fit to the Rasch Model, greater than one, between groups. It is suggested that the proposed definition avoids…

A computer program for a comparative evaluation of the extent of item bias between two subgroups in a test population is described. The program calculates an index of bias based on Angoff's elliptical distance measure, and provides statistics for determining the similarity of intergroup item parameters. (Author/JKS)

High item discrimination can indicate a special kind of measurement disturbance via an item that gives high-ability persons a special advantage. The measurement disturbance is described, which occurs when an item is sensitive to individual differences on a second, undesired dimension that is correlated with the variable intended to be measured.…

A new method of measuring item bias based on the latent class model proposed by the author is suggested. A test for item bias is also suggested that is based on standard asymptotic results. (Author/DWH)

Describes what publishers of major achievement tests are now doing to minimize bias and offers recommendations for changes still needed. (Author/ABB)

The correlation between bias components of test scores and unbiased observed scores is shown to be an effective predictor of changes in reliability and validity resulting from elimination of bias. Plausible assumptions about value of correlation and size of related variance components indicate that reducation in reliability and validity is a…