This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is…

The increasing popularity of the Common European Framework of Reference (CEFR) in non-native English-speaking countries has generated a demand for concrete examples in the creation of CEFR-based tests that assess the four main English skills. In response, this research endeavors to provide insight into the development and validation of a…

Since its implementation in 2004, the Canadian English Language Benchmark Assessment for Nurses (CELBAN) has been accepted as evidence of language ability for licensure of internationally educated nurses (IENs) in Canada. This article focuses on the complexities of sustaining an occupation-specific assessment over time. The authors reference the…

This paper analyzes writing tasks in academic writing textbooks for Japanese university students, focusing on the organization and difficulty of these tasks based on the Common European Framework of Reference for Languages (CEFR). A total of 411 writing tasks from 30 textbooks were coded by two experienced Japanese English teachers. The author…

In L2 pragmatics, only a few studies have examined task complexity. Furthermore, the existing studies have predominantly focused on the cognitive dimension and have lacked consistent findings. González-Lloret and Ortega (2018) and Pallotti (2019) have thereby contended that socio-interactional features be incorporated into task design. Along this…

This paper studies the use of Reinforcement Learning (RL) policies for optimizing the sequencing of online learning materials to students. Our approach provides an end to end pipeline for automatically deriving and evaluating robust representations of students' interactions and policies for content sequencing in online educational settings. We…

This study examined the impact of the manipulated task complexity (Robinson 2001a, 2001b, 2007, 2011; Robinson & Gilabert, 2007) on second language (L2) speech comprehensibility. I examined whether manipulated task complexity (a) impacts L2 speech comprehensibility, (b) aligns with L2 speakers' perception of task difficulty (cognitive…

This study investigates whether a natural order exists for non-native acquisition in the production of English syllable coda obstruents by Korean and Chinese adult native speakers. We recorded L2 English monosyllabic words produced by 66 Chinese and 51 Korean native speakers. The recorded speech was then evaluated by 11 native-speaker listeners of…

This study investigated whether second language (L2) learners of English could learn to produce stranded prepositions through structural priming. Structural priming is the tendency for speakers to repeat the structure of previously experienced sentences, without intention or conscious awareness of such behaviour, and is thought to be associated…

Worked examples, commonly used in technical domains, are rarely used in language areas such as English literature. In 3 experiments, Korean university students for whom English was a foreign language received worked examples intended to facilitate problem solving in the ill-structured domain of English literature. During the learning phase, half…

As a construct definition, the current study develops a cognitive model describing the knowledge, skills, and abilities measured by critical reading test items on a high-stakes assessment used for selection decisions in the United States. Additionally, in order to establish generalizability of the construct meaning to other similarly structured…

This paper traces developments in educational psychology and measurement that led to the Test of English as a Foreign Language (TOEFL) and the test of English for International Communication (TOEIC) and the application of educational measurement terms such as validity and reliability to testing. Use of a table of specifications for planning…