Writing is generally assessed internationally using rubric-based approaches, but there is a growing body of evidence to suggest that the reliability of such approaches is poor. In contrast, comparative judgement studies suggest that it is possible to assess open ended tasks such as writing with greater reliability. Many previous studies, however,…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

Manually scoring and revising student essays has long been a time-consuming task for educators. With the rise of natural language processing techniques, automated essay scoring (AES) and automated essay revising (AER) have emerged to alleviate this burden. However, current AES and AER models require large amounts of training data and lack…

Writing comprehensibly, dynamically, and persuasively in a foreign language is a significant challenge for learners. Written communication assesses language and writing progress for various summative and developmental goals. Scenario-based assessment (SBA), as one of the methodologies of classroom-based assessment (CBA), aims to elicit both…

This study investigated the efficacy of varying degrees of written corrective feedback (WCF) explicitness on the accuracy of revised drafts and new pieces of writing among learners of different proficiency levels. A total of 130 learners of English were divided into three proficiency groups (basic, independent, and proficient users), with learners…

Ethical considerations, including transparency, play an important role when using artificial intelligence (AI) in education. Explainable AI has been coined as a solution to provide more insight into the inner workings of AI algorithms. However, carefully designed user studies on how to design explanations for AI in education are still limited. The…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

This study seeks to clarify whether teachers are able to distinguish between essays written by English L2 students or generated by ChatGPT. 47 instructors who hold experience teaching English to native speakers of Japanese in universities or other higher education institutions were tested on whether they could identify between human written essays…

Digital multimodal composing (DMC) has attracted language instructors' and researchers' increasing attention during recent years. Previous studies mainly investigated the students' DMC processes and perceptions, but DMC products are underexamined, and in particular, scarce is research comparing collaborative DMC products and individual DMC…

First-year composition courses must balance a range of writing instruction priorities including genre and audience awareness with language instruction, particularly for second-language writers. Despite the attested efficacy of "dynamic" written corrective feedback for language gains in intensive English programs, little research has…

Purpose: There is limited research on the writing of young Spanish-English bilinguals and their writing in both languages. In the current study, we addressed whether written syntax features differed by language (English and Spanish) and varied as a function of grade level, English learner status, and instructional program (dual or English…

Purpose: There is limited research on the writing of young Spanish-English bilinguals and their writing in both languages. In the current study, we addressed whether written syntax features differed by language (English and Spanish) and varied as a function of grade level, English learner status, and instructional program (dual or English…

Grounded in the activity theory, we adopted a sequential explanatory mixed-methods approach to explore the impact of automated written corrective feedback (AWCF) on English as a foreign language (EFL) learners' academic writing skills (i.e. task achievement, coherence and cohesion, lexicon, and grammatical range and accuracy). To this end, two…

Automated Essay Scoring (AES) can reliably grade essays at scale and reduce human effort in both classroom and commercial settings. There are currently three dominant supervised learning paradigms for building AES models: feature-based, neural, and hybrid. While feature-based models are more explainable, neural network models often outperform…