Background: Learning to write the complex academic language (AL) associated with a discipline (like science) is a critical task in education, with middle school being a key developmental period. However, we need more research to guide how we assess students' learning to write AL, especially if we want to create assessment that guides more…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Children's increasing expertise in composition relies partly on word choice. Little is known about how children consider words as they write, their meta-lexical awareness, or about their choice of words for writing. In this study, we investigate children's meta-lexical awareness, as one aspect of their metalinguistic awareness, which guides their…

Background: Generative artificial intelligence (AI) represents a potentially powerful, time-saving tool for grading student essays. However, little is known about how AI-generated essay scores compare to human instructor scores. Objective: The purpose of this study was to compare the essay grading scores produced by AI with those of human…

In fewer than two years, generative artificial intelligence (GenAI) has transformed the educational experience for both students and faculty. Writing feedback and evaluation tools like MyEssayFeedback, EssayGrader, and Markr have been released with the promise that faculty will be able to focus more on teaching than simply grading. However, the…

To investigate how task complexity cognitive factors influence the lexical complexity in essay writing, this study was guided by Robinson's Cognition Hypothesis (CH) and Skehan's Limited Attentional Capacity Model (LACM), and examined the effects of task complexity on lexical complexity in undergraduates' essay writing. Using Lu's Lexical…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

Purpose: The authors constructed an automatic essay scoring (AES) model in a discussion forum where the result was compared with scores given by human evaluators. This research proposes essay scoring, which is conducted through two parameters, semantic and keyword similarities, using a SentenceTransformers pre-trained model that can construct the…

Phraseology has been flourishing in the field of English writing studies in recent years. However, the focus has primarily been on items with less variability, such as ngrams or lexical bundles. To address this gap, this study investigates concgrams (Cheng et al., 2006), which encompass both constituency and positional variations, in advanced…

Employing G-theory and rater interviews, the study investigated how a high-stakes writing assessment procedure (i.e., a single-task, single-rater, and holistic scoring procedure) impacted the variability and reliability of its scores within the Turkish higher education context. Thirty-two essays written on two different writing tasks (i.e.,…

The present study explored the effects of interactionist Dynamic Assessment (DA) and age on the writing accuracy of IELTS candidates. This research investigated the existence of an interactional effect between the age of learners and the type of treatment they received. First, 140 IELTS candidates were split into two age groups, adult and young.…

Although, written corrective feedback (hereafter referred to as CF) is applauded in many writing courses for fostering students' quality writing, its impact on grammatical accuracy in L2 students' writing remains a debated topic. Thus, this study looked into the effect of CF types on L2 students' grammatical accuracy in writing. To achieve this…

In the existing literature, scholars have proposed various indices to measure the lexical richness (LR) of English as a foreign language (EFL) writing. However, there are currently issues of redundant indices and inconsistent usage. Attempting to address the research question of which indices are the most sensitive and effective ones to…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

The authors discuss the issues and benefits of collaborative writing in journalistic education, comparing the texts written by students in different conditions: in group collaboration, individually after prewriting group discussion, and individually without any collaboration. We used a survey for collecting both quantitative and qualitative data.…