NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1481471
Record Type: Journal
Publication Date: 2025-Aug
Pages: 59
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2049-6613
Available Date: 2025-08-12
Enhancing Transparency in High-Stakes English Language Assessment: A Mixed-Methods Synthesis of Empirical Evidence and Stakeholder Perspectives
Nathaniel Owen1; Ananda Senel1
Review of Education, v13 n2 e70096 2025
Transparency in high-stakes English language assessment has become crucial for ensuring fairness and maintaining assessment validity in language testing. However, our understanding of how transparency is conceptualised and implemented remains fragmented, particularly in relation to stakeholder experiences and technological innovations. This study addresses this gap through a mixed-methods synthesis of empirical evidence and stakeholder perspectives, combining systematic review methodology with primary data from a pilot study of a computer-adaptive English language test. The research employed a comprehensive approach following PRISMA guidelines, integrating findings from systematic database searches (2000-2024) with empirical evidence from test takers (n = 299) and test centre managers (n = 41). Factor analysis of test-taker responses revealed six key dimensions of assessment transparency: task confidence, test-taking confidence, time management, perceived difficulty, instructional clarity, and task familiarity. Cluster analysis identified four distinct stakeholder response patterns, with significant variations across demographic groups. The synthesis of systematic review and empirical data analysis reveals that transparency has evolved from a technical consideration into a multi-dimensional construct that fundamentally shapes stakeholder experiences. Key findings demonstrate that different stakeholder groups engage with transparency initiatives in systematically different ways, that technological transparency has emerged as a fundamental dimension of stakeholder experience, and that transparency requirements evolve in response to external pressures. The COVID-19 pandemic particularly highlighted how crisis conditions can rapidly transform transparency needs. These findings have significant implications for assessment design and implementation. They suggest that assessment providers must develop 'layered transparency' approaches that accommodate differentiated stakeholder needs while maintaining consistent standards. The research also indicates that future assessment frameworks, especially those informed by AI, must balance competing demands while ensuring all stakeholders have clear understanding of and engagement with high-stakes assessment processes that profoundly affect their lives.
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Oxford University Press, Oxford, UK