ERIC Number: EJ948457
Record Type: Journal
Publication Date: 2011
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1543-4303
EISSN: N/A
Available Date: N/A
An Investigation of Differential Item Functioning in the MELAB Listening Test
Aryadoust, Vahid; Goh, Christine C. M.; Kim, Lee Ong
Language Assessment Quarterly, v8 n4 p361-385 2011
Differential item functioning (DIF) analysis is a way of determining whether test items function differently across subgroups of test takers after controlling for ability level. DIF results are used to evaluate tests' validity arguments. This study uses Rasch measurement to examine the Michigan English Language Assessment Battery listening test for DIF across gender subgroups. After establishing the unidimensionality and local independence of the data, the authors used two methods to test for DIF: (a) a t-test uniform DIF analysis, which showed that two test items displayed substantive DIF, and favored different gender subgroups; and (b) nonuniform DIF analysis, which revealed several test items with significant DIF, many of which favored low-ability male test takers. A possible explanation for gender-ability DIF is that lower ability male test takers are more likely to attempt lucky guesses, particularly on multiple-choice items with unattractive distracters, and that having only two distracters makes this strategy likely to succeed. (Contains 4 figures, 4 tables, and 2 footnotes.)
Descriptors: Test Items, Listening Comprehension Tests, Test Bias, Test Validity, Listening Skills, Gender Differences, Auditory Stimuli, Foreign Countries
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A