Distances derived from word embeddings can measure a range of gradational relations--similarity, hierarchy, entailment, and stereotype--and can be used at the document- and author-level in ways that overcome some of the limitations of weighted dictionary methods. We provide a comprehensive introduction to using word embeddings for relation…

Recent developments in the use of large-language models have led to substantial improvements in the accuracy of content-based automated scoring of free-text responses. The reported accuracy levels suggest that automated systems could have widespread applicability in assessment. However, before they are used in operational testing, other aspects of…

Recent advancements in large language models (LLMs) hold significant promise for improving physics education research that uses machine learning. In this study, we compare the application of various models for conducting a large-scale analysis of written text grounded in a physics education research classification problem: identifying skills in…

This study aims to evaluate the extent to which Taylor Swift's song lyrics incorporate vocabulary from the Oxford 3000 and 5000 word lists and to categorize these words based on CEFR levels. The goal is to narrow down the vast selection of songs available to EFL learners, focusing on the most essential vocabulary to enhance their learning…

This paper introduces AMMORE, a new dataset of 53,000 math open-response question-answer pairs from Rori, a mathematics learning platform used by middle and high school students in several African countries. Using this dataset, we conducted two experiments to evaluate the use of large language models (LLM) for grading particularly challenging…

This study aims to investigate the VOT values of English wordinitial plosive consonants produced by young Thai learners to understand current trends in English pronunciation among Thai speakers and its future direction. The study analyzes how phonological mismatches between Thai and English affect the pronunciation of Thai learners, using a speech…

Anticipatory "it" pattern, which encodes interpersonal stance, plays a crucial role in academic writing. While previous studies have been explored the overuse and the underuse of this pattern among English as a Foreign Language (EFL) learners and published writers, there has been limited exploration of how EFL learners use the…

A writer's L1 is generally believed to influence their L2 English writing significantly. However, the extent to which L1 backgrounds influence Asian learners' L2 English writing has not been wholly elucidated due to the lack of data covering various learners in Asia. Therefore, this study analysed more than one-million-word essays written by 2,318…