Examined standardized test scores of black and white elementary and middle school students in impoverished, socioeconomically mixed, and affluent schools. The proportion of students performing at or above the U.S. norm was higher in affluent schools for both racial groups. The 36 percentage points separating black and white students overall in…

Research has suggested that inappropriate or misfitting response patterns may have detrimental effects on the quality and validity of measurement. It has been suggested that factors like language and ethnic background are related to the generation of misfitting response patterns, but the empirical research on this is rather poor. This research…

Differential item functioning (DIF) is an important consideration in assessing the validity of test scores (Camilli & Shepard, 1994). A variety of statistical procedures have been developed to assess DIF in tests of dichotomous (Hills, 1989; Millsap & Everson, 1993) and polytomous (Penfield & Lam, 2000; Potenza & Dorans, 1995) items. Some of these…

This study has investigated the comparability of computer-based testing writing prompts in the Test of English as a Foreign LanguageTM (TOEFL) for examinees of different native language backgrounds. A total of 81 writing prompts introduced from July 1998 through August 2000 were examined using a 3-step logistic regression procedure for ordinal…

Ipsative data (individual scores subject to a constant-sum constraint), suggested to minimize response bias, are sometimes observed in behavioral sciences. Chan and Bentler (1993, 1996) proposed a method to analyze ipsative data in a single-group case. Cheung and Chan (2002) extended the method to multiple-group analysis. However, these methods…

This article presents an analysis of Ordinate Corporation's PhonePass Spoken English Test-10. The company promotes this product as being a useful assessment tool for screening job candidates' ability in spoken English. In the real-life domain of the work environment, one of the primary target language use tasks involves extended production…

Determining the cross-cultural equivalence of multilingual tests is a challenge that is more complex than simple horizontal equating of test forms. This study examines the functioning of a trilingual test of preschool readiness to determine the equivalence. Different forms of the test have previously been examined using classical statistical…

These guidelines, prepared by the Special Populations Strand of the Assessment and Accountability Comprehensive Center (AACC), focus on the technical quality of assessments for English language learners (ELLs) and students with disabilities (SWDs). This document is an evolving document that will periodically be updated to incorporate new…

In this article, I describe a practical application of the Roussos and Stout (1996) multidimensional analysis framework for interpreting group performance differences on an ESL reading proficiency test. Although a variety of statistical methods have been developed for flagging test items that function differentially for equal ability examinees…

A 24-item short form of the 96-item Developmental Behaviour Checklist was developed to provide a brief measure of Total Behaviour Problem Score for research purposes. The short form Developmental Behaviour Checklist (DBC-P24) was chosen for low bias and high precision from among 100 randomly selected item sets. The DBC-P24 was developed from…

This study investigates differential item functioning (DIF) in a 36-item test of English as a Second Language pragmalinguistics, assessing 254 learners' knowledge of implicature, routines, and speech acts. Two common DIF techniques, the Mantel-Haenszel method and the standardization method, detected nine items functioning differentially for test…

A multiple choice test item is identified as flawed if it has no single best answer. In spite of extensive quality control procedures, the administration of flawed items to test-takers is inevitable. Common strategies for dealing with flawed items in conventional testing, grounded in the principle of fairness to test-takers, are reexamined in the…

The interest in the application of large-scale computerized adaptive testing has served to focus attention on issues that arise when theoretical advances are made operational. Some of these issues stem less from changes in testing conditions and more from changes in testing paradigms. One such issue is that of the order in which questions are…

The possibility exists that some people might be at a disadvantage in registering their responses to a computerized test if mouse manipulation were complicated. This would be of particular concern if some groups were differentially affected by the complexity of manipulation. This study analyzed data from a pilot test conducted in 1991 for the…

This study examined the social and cognitive competence of immigrant preschool children in France. A total of 25 immigrant (Maghreb) children and 25 nonimmigrant French children age 4 and 5 years participated in the study, which compared their cognitive abilities, adaptive behaviors, play abilities, and success in the first year of elementary…