Measurement of language learners' development in speaking proficiency is important for practicing language teachers, not only for assessment purposes, but also for evaluating the effectiveness of materials and approaches used. However, doing so effectively and efficiently presents challenges. Commercial speaking tests are often costly, and beyond…

This technical manual describes the purpose and intended uses of the TOEFL iBT test, its target test-taker population, and relevant language use domains. The test design and scoring procedures are presented first, followed by a research agenda intended to support the interpretation and use of test scores. Given the updates to the test starting…

This study aims to examine whether differences exist in the factors influencing the difficulty of scoring English summaries and determining scores based on the raters' attributes, and to collect candid opinions, considerations, and tentative suggestions for future improvements to the analytic rubric of summary writing for English learners. In this…

English proficiency assessments have become a necessary metric for filtering and selecting prospective candidates for both academia and industry. With the rise in demand for such assessments, it has become increasingly necessary to have the automated human-interpretable results to prevent inconsistencies and ensure meaningful feedback to the…

An increasing number of language testing companies are developing and deploying deep learning-based automated essay scoring systems (AES) to replace traditional approaches that rely on handcrafted feature extraction. However, there is hesitation to accept neural network approaches to automated essay scoring because the features are automatically…

Information units (IUs) have been proposed as a way of grading students' notes. However, little work has been done to validate and check the reliability of such an approach. This study explores how teacher-researchers (TRs) use information units (IUs) to rate content items in students' listening notes using a rubric. Data were collected from six…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

Stakeholders in exam-driven countries are responsible for developing test-related tasks to assess the quality of English as a Foreign Language (EFL) teaching and learning. Hence, the language assessment literacy (LAL) of different stakeholders has to be investigated. This mixed-methods study explored the required LAL competencies among two groups…

We believe that is culturally situated. In this conceptual article, we problematize some of the phrasing used for prosody indicators and explore how three of the most spoken languages in the United States (other than English) enact aspects of prosody when reading. We probe potential linguistic and sociocultural implications and contribute to the…

This chapter reports on a study investigating non-expert raters' scoring behavior and cognitive processes involved in evaluating speech acts and pragmatic routines in L2 Chinese. Pragmatic production data were collected from 51 American learners of Chinese, who completed a 12-item oral Discourse Completion Test (DCT). The learners were divided…

The International English Language Testing System (IELTS) is a high-stakes exam where Writing Task 2 significantly influences the overall scores, requiring reliable evaluation. While trained human raters perform this task, concerns about subjectivity and inconsistency have led to growing interest in artificial intelligence (AI)-based assessment…

Some previous researchers attempted to bridge the gap between two bodies of research: the role of metacognitive knowledge in second language (L2) writing and L2 collaborative writing (CW). Although recent studies unveiled the positive impacts of learners' metacognitive knowledge on L2 collaborative writing, there is not yet consensus regarding the…

This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing…

Language learning has increasingly benefited from Computer-Assisted Language Learning (CALL) technologies, especially with Artificial Intelligence involved in recent years. CALL in writing learning acknowledged as the core of language learning is being realized by technologies like Automated Writing Evaluation (AWE), and Automated Essay Scoring…

In the rapidly evolving language education landscape, integrating innovative pedagogical approaches is essential to meet the diverse needs of learners. This study explores the efficacy of a Micro-Learning Media with Station Rotation Blended Learning Model (MLM-SRM) in enhancing the Japanese communication skills--specifically speaking, listening,…