The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

This study aims to provide a comprehensive profile of collocational competence, a key component of one's overall linguistic competence. For the maximum of ecological validity, we elicited naturalistic oral/written production data from 84 Chinese intermediate EFL learners and performed a 2×2 fashion of analysis on their performance in each of the…

This plenary speech provides an overview of applications of corpus research in several core areas of applied linguistics, including second language acquisition and language assessment. It does this by showcasing a number of recent studies carried out by or with involvement of the author. These studies all focus on phraseological aspects of…

The present study attempted to examine the effect of using the connectivist approach on developing secondary-stage students' cross-cultural awareness and translation performance. The study comprised thirty-two first-year secondary stage students enrolled in El-Jalawea Institute, Sohag Governorate. The study adopted the quasi-experimental design.…

Published work on vocabulary assessment has grown substantially in the last 10 years, but it is still somewhat outside the mainstream of the field. There has been a recent call for those developing vocabulary tests to apply professional standards to their work, especially in validating their instruments for specified purposes before releasing them…

Corpus-based studies have offered the domain definition inference for test developers. Yet, corpus-based studies on temporal fluency measures (e.g., speech rate) have been limited, especially in the context of academic lecture settings. This made it difficult for test developers to sample representative fluency features to create authentic…

The present study investigates L1 and L2 English speakers' knowledge of the "wh"-clausal construction along the parameters of (a) conventionality, distinguishing between high-frequency conventional and low-frequency unconventional formulations ("I asked him why they agreed/why did they agree"), and (b) proposition type,…

Recently there has been some debate about the appropriacy of different lexical units in pedagogy and research (e.g., Brown et al., 2020; Dang & Webb, 2016a; Kremmel, 2016; Laufer & Cobb, 2020; McLean, 2018; Nation, 2016; Nation & Webb, 2011; Vilkaite-Lozdiene & Schmitt, 2020). The lexical unit (word types, lemmas, flemmas, word…

Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…

This article introduces the CELI corpus, a new learner corpus of written Italian consisting of ca. 600,000 tokens, evenly distributed among CEFR (Common European Framework of Reference for Languages) proficiency levels B1, B2, C1 and C2. The collected texts derive from the language certification exams administered by the University for Foreigners…

Most common words in English have multiple different meanings, but relatively little is known about why children grasp some meanings better than others. This study aimed to examine how variables at the child-level, wordform-level, and meaning-level impact knowledge of words with multiple meanings. In this study, 174 children aged 5- to 9-years-old…

L3 acquisition is influenced by L1-L3 typology, learners' proficiency in those languages, and metalinguistic knowledge. However, the precise patterns of cross-linguistic influence (CLI) in L3 acquisition are still unclear. This study aimed to examine how the abovementioned factors affect learners' sensitivity to subject placement in L3 Italian. We…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Comparing language tests and test preparation materials holds important implications for the latter's validity and reliability. However, not enough studies compare such materials across a wide range of indices. Therefore, this study investigated the text complexity of IELTS academic reading tests (IRT) and IELTS reading practice tests (IRPrT).…