Threats to construct validity should be reduced to a minimum. If true, sources of bias, namely raters, items, tests as well as gender, age, race, language background, culture, and socio-economic status need to be spotted and removed. This study investigates raters' experience, language background, and the choice of essay prompt as potential…

The research reported in this article investigates differential item functioning (DIF) in a listening comprehension test. The study explores the relationship between test-taker age and the items' language domains across multiple test forms. The data comprise test-taker responses (N = 2,861) to a total of 133 unique items, 46 items of which were…

In this article, I describe a practical application of the Roussos and Stout (1996) multidimensional analysis framework for interpreting group performance differences on an ESL reading proficiency test. Although a variety of statistical methods have been developed for flagging test items that function differentially for equal ability examinees…

This sampler of student responses to mathematics and science items was assembled to show how student responses differ depending on whether students are tested in English or in their native languages. The sampler aims to promote awareness among teachers and assessment developers that low language proficiency in English is a factor that can penalize…

This article reports the results of a survey of third-grade teachers of English Language Learners (ELLs) in Arizona regarding school language and accountability policies--Proposition 203, which restricts bilingual education and mandates sheltered English Immersion; the federal No Child Left Behind Act of 2001 (NCLB); and Arizona LEARNS, the…