In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

To investigate whether a creative writing unit in upper secondary education would improve students' creative as well as argumentative text quality and to examine whether it would change students' writing behavior, we tested a creative writing unit based on encouraging writing in flow by using divergent thinking tasks. Four classes (Grade 10)…

The benefits of writing strategy feedback are well established. This study examined the extent to which adding spelling and grammar checkers support writing and revision in comparison to providing writing strategy feedback alone. High school students (n = 119) wrote and revised six persuasive essays in Writing Pal, an automated writing evaluation…

This study aims to develop a robust rubric for evaluating artificial intelligence (AI)--assisted essay writing in English as a Foreign Language (EFL) contexts. Employing a modified Delphi technique, we conducted a comprehensive literature review and administered Likert scale questionnaires. This process yielded nine key evaluation criteria,…

This study investigates the impact of ChatGPT on EFL students' argumentative writing development of 30 third-year English majors. The research examines writing quality improvements, student perceptions, and patterns of AI tool usage across a 16-week period. This study employed a mixed-methods design to investigate both students' writing…

Despite growing interest in exploring the application of chatbots in language education, studies on the process of chatbot-assisted language learning are scant. This qualitative study uses activity theory to understand how English as a foreign language students engage with a chatbot, Argumate, when composing argumentative essays. Five Chinese…

This study analyzes the linguistic features of counter-arguments and support arguments using two computational linguistic tools: Coh-Metrix and Gramulator. The research question investigates whether counter-argument paragraphs and support paragraphs are different in terms of their linguistic features. To conduct this study, a corpus of 78…

Writing in a language different from one's mother tongue is a daunting task. The same challenge may apply to languages that have diglossic features whose spoken form differs from the written form. This article investigates Arab students' writing behaviors (fluency, pauses, and revision) in response to an argumentative composition in their L1…

In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

Although artificial Intelligence (AI) is prevalent and impacts facets of daily life, there is limited research on responsible and humanistic design, implementation, and evaluation of AI, especially in the field of education. Afterall, learning is inherently a social endeavor involving human interactions, rendering the need for AI designs to be…

We investigate students' implementation of the feedback messages they received in an automated writing evaluation system ("eRevise") that aims to improve students' use of text evidence in their writing. Seven 5th and 6th-grade teachers implemented "eRevise" (n = 143 students). Qualitative analysis of students' essays across…

Many studies that have investigated the educational value of online machine translation (MT) in second language (L2) writing generally report significant improvements after MT use, but no study as of yet has comprehensively analyzed the effectiveness of MT use in terms of various measures in syntactic complexity, accuracy, lexical complexity, and…

The study investigated the interaction patterns of six ASEAN EFL university students when they worked in small groups on two collaborative writing tasks: a descriptive essay and an argumentative essay. Both groups were homogeneous in terms of gender and heterogeneous in terms of home countries. Data collection included pre- and posttest writing,…

Digital storytelling (DST) is one of the areas which has entered the field of foreign language education and has proved to be beneficial in learning different language skills. However, it remains underexplored whether and how DST can affect learners' writing skill and motivation to write. The present study sought to investigate the impact of DST…

The assessment of argumentative writing generally includes analyses of the specific linguistic and rhetorical features contained in the individual essays produced by students. However, researchers have recently proposed that an individual's ability to flexibly adapt the linguistic properties of their writing may more accurately capture their…