ERIC Number: EJ1486186
Record Type: Journal
Publication Date: 2025-Oct
Pages: 22
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0265-5322
EISSN: EISSN-1477-0946
Available Date: 0000-00-00
Generating Language Assessment Content Free from Representational Harms
Ikkyu Choi1; Jiyun Zu1
Language Testing, v42 n4 p539-560 2025
Today's language models can produce syntactically accurate and semantically coherent texts. This capability presents new opportunities for generating content for language assessments, which have traditionally required intensive expert resources. However, these models are also known to generate biased texts, leading to representational harms. Therefore, to utilize language models for language assessment content generation, it is crucial to address this bias issue to ensure all test takers have a fair and beneficial assessment experience. This paper proposes a novel method to ensure the generation of language assessment content free from representational harms. Specifically, the method eliminates any systematic relationship between demographic groups and their attributes through a two-step process. Two case studies were conducted to illustrate and evaluate the method's effectiveness. In both studies, the method produced language assessment content comparable with their respective targets and successfully prevented representational harms in a systematic manner.
Descriptors: Artificial Intelligence, Language Tests, Test Bias, Test Construction, Test Items, Culture Fair Tests, Reading Tests
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1ETS, USA

Peer reviewed
Direct link
