The semi-direct speaking test format has limitations, particularly due to its lack of situational authenticity and contextualized input. To address this issue, virtual reality (VR) can be integrated into speaking proficiency tests to enhance authenticity. In this study, a newly designed VR speaking test was administered, and test-takers'…

This report briefly reviews the design and scoring procedure for the "TOEIC"® Speaking test and summarizes existing evidence about the consistency of TOEIC Speaking test scores. It then describes several analyses conducted using generalizability theory to provide additional information about the consistency of scores across different…

For educational tests, it is critical to maintain consistency of score scales and to understand the sources of variation in score means over time. This practice helps to ensure that interpretations about test takers' abilities are comparable from one administration (or one form) to another. This study examines the consistency of reported scores…