Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

This study explored the relationship between task complexity, textual emotionality, and linguistic complexity in second language (L2) writing. Fifty-eight L2 English learners performed simple and complex versions of an argumentative writing task manipulated along with resource-­directing variables. The essays were first analysed for textual…

Language proficiency policies act as critical gatekeepers for multilingual international students (MIS) who intend to pursue an education at English-medium universities. The current study revisits the question of the predictive validity of a standardized English proficiency exam--International English Language Testing System (IELTS)--in comparison…

This mixed methods study explores EFL students' experiences and perceptions as they learn to write a composition with ChatGPT's support in a classroom instructional context. Students' perceptions are explored in terms of their motivation to learn about ChatGPT, cognitive load and satisfaction with the learning process. In a workshop format,…

Estimating the difficulty of reading tests is critical in second language education and assessment. This study was aimed at examining various text features that might influence the difficulty level of a high-stakes reading comprehension test and predict test takers' scores. To this end, the responses provided by 17,900 test takers on the reading…

The present study examined the effect of language background and topic on productive formulaic competence. Guided by usage-based theory of language learning, this study used a distribution-based approach to the examination of the native-likeness of formulaic usage in English timed argumentative writing. Six indices informed by a large-scale native…

The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…

The study investigates the effect of the perception of text and task difficulty on adults' performance in reading tests in L1 and L2. The relationship between the following variables is studied: (a) readers' perception of text and task difficulty in L1 and L2 measured in a self-reported post-task questionnaire, (b) the number of correct answers to…

In today's environment of growing class sizes due to the prevalence of online and e-learning systems, providing one-to-one instruction and feedback has become a challenging task for teachers. Anyhow, the dialectical integration of instruction and assessment into a seamless and dynamic activity can provide a continuous flow of assessment…

Elicited imitation (EI), a short-cut measure of global proficiency in second language (L2) research, requires participants to listen to sentences and repeat them as closely as possible. To support instrument sharing and assessment of L2 proficiency for longitudinal and crosslinguistic research, we created a parallel form of an EI task (EIT) for L2…

This study explored how task complexity, writing behaviors (i.e., pausing and revision behaviors), and writing performance (i.e., task completion, coherence and cohesion, language use, and expression and tone) influence and relate to each other. Thirty advanced-level Korean EFL undergraduates completed writing tasks differing in complexity. A…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

This study examined the impact of the manipulated task complexity (Robinson 2001a, 2001b, 2007, 2011; Robinson & Gilabert, 2007) on second language (L2) speech comprehensibility. I examined whether manipulated task complexity (a) impacts L2 speech comprehensibility, (b) aligns with L2 speakers' perception of task difficulty (cognitive…

This study investigates the effects of adding stem preview to an English for Academic Purposes (EAP) multiple-choice listening assessment. In stem preview, listeners may view the item stems, but not response options, before listening. Previous research indicates that adding preview to an exam typically decreases difficulty, but raises concerns…

This study was an attempt to investigate the effect of choice theory-based instruction on Iranian EFL learners' vocabulary achievement. To fulfil the purpose of this study, 60 female advanced EFL learners were selected from among a total number of 90 learners through their performance on a piloted sample Cambridge ESOL Certificate of Advanced…