As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

Syntactic complexity has long been used to gauge language learners' performance, proficiency, and development, offering language teachers valid recommendations for syllabus design and materials development. Progress in syntactic complexity research foreshadows the imperative of measuring syntactic features at a high level of granularity, which…

As an important practice for researchers, citing sources is a challenging task for undergraduate students as they deal with the types of citation forms, the variety of reporting verbs and their tenses, and the writer stances through reporting verbs. Therefore, the current research is aimed at investigating the surface forms, reporting verb tenses,…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…

In this article, we explore the concept of a "hidden curriculum" within generative AI, specifically Large Language Models (LLMs), and its intersection with the hidden curriculum in education. We highlight how AI, trained on biased human data, can perpetuate societal inequities and discriminatory practices despite appearing objective. We…

In recent years, there has been a growing trend of using informal styles in academic writing, including research articles. To examine the degree of formality in students' writing, this corpus-based study aimed to analyze the formal linguistic features in the academic writing assignments of English-major students at a Thai university. The learner…

This corpus-based study investigates lexical richness in English writing by Chinese senior high school students. Lexical uses in 303 compositions were compared across three grades in terms of lexical sophistication, variation, density and errors. Timed compositions were sampled from Writing Corpus of English Learners, and the sample sizes of three…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

The purpose of this study is to analyze the grammatical complexity features of international teaching assistants' (ITAs) mock-teaching presentations and to compare the distributions of these features to those found in the Oral English Proficiency Test (a local ITA assessment), university classroom teaching, conversation, and academic writing. The…

To test the predictive power of the SSARC (stabilize, simplify, automatize, reconstruct, and complexify) model of pedagogic task sequencing in second language (L2) writing development, the present study explores the performance of written decision-making tasks with varied levels of cognitive complexity in a simple-to-complex sequence in comparison…

A perfect writing skill has been deemed instrumental to achieving competence in EFL, yet it is considered one of the most impressive learning domains. This study investigates the impact of human-AI collaborative feedback on the writing proficiency of EFL students. It examines key teaching domains, including the teaching environment, teacher…

The assessment of writing competency in French as a Foreign Language presents significant challenges due to the multidimensional nature of writing and heterogeneous evaluation practices. This research introduces an innovative framework integrating artificial intelligence and interactive visualization to support the formative assessment of writing…

A writer's L1 is generally believed to influence their L2 English writing significantly. However, the extent to which L1 backgrounds influence Asian learners' L2 English writing has not been wholly elucidated due to the lack of data covering various learners in Asia. Therefore, this study analysed more than one-million-word essays written by 2,318…