This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

This study investigates whether re-thinking the separation of lexis and grammar in language testing could lead to more valid inferences about proficiency across modes. As argued by Römer, typical scoring rubrics ignore important information about proficiency encoded at the lexis-grammar interface, in particular how the co-selection of lexical and…

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated…

While recent studies find that contextual diversity (CD) is a better determinant of visual word recognition than token frequency, there is a dearth of work comparing contextual diversity and token frequency in developing readers. In two sets of character and lexical decision experiments we examined token frequency and contextual diversity effects…

This study explored the role of written languaging (WL) in response to automated written corrective feedback (AWCF) in L2 accuracy improvement in English classrooms at a university in China. A total of 254 freshmen enrolled in intermediate composition classes participated, and they wrote 4 essays and received AWCF. A half of them engaged in WL…

This study compared the effects of teacher feedback (TF) and online automated feedback (AF) on the quality of revision of English writing. It also examined the strengths and weaknesses of the two types of feedback perceived by English language learners (ELLs) as a foreign language (FL). Sixty-eight Chinese students from two English classes…

Recent research investigating embedded stem priming effects with the masked priming paradigm and pseudoword primes (e.g., "quickify"--"quick") has shown that priming effects can be obtained even when the embedded target word is followed by a non-morphological ending (e.g., "quickald"--"quick"). Here we…

Theoretically grounded in Vygotsky's sociocultural theory of mind, Dynamic Assessment (DA) provides researchers with the opportunity to investigate different aspects of learners' developmental trajectory, including the ways they overcome their errors. As a qualitative inquiry into the nature of errors reflecting learners' development in academic…

This study investigates the impact on extemporaneous English-language first drafts by using Google Translate (GT) in three different tasks assigned to Chinese sophomore, junior, and senior students of English as a Foreign Language (EFL) majoring in English. Students wrote first in Chinese (Step 1), then drafted corresponding texts in English (Step…

In the present study, we take a longitudinal, corpus-based perspective to investigate short-term (over 9 months) linguistic change in the language produced for the spoken and written sections of the "TOEFL iBT"® test by a group of English-as-a-foreign-language (EFL) learners in China. The goal of the study is to identify patterns that…

The present research examines the mechanisms underlying the comprehension of focus alternatives. In particular, we investigate whether listeners determine alternatives based on general semantic priming mechanisms or whether they only consider contrastive alternatives, elements that can replace the expression in focus. In a probe recognition…

The paper describes initial efforts on creating a system for the automatic assessment of Swedish second language (L2) learner essays from two points of view: holistic evaluation of the reached level according to the Common European Framework of Reference (CEFR), and the lexical analysis of texts for receptive and productive vocabulary per CEFR…