Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

There is a current debate about the extent to which ChatGPT, a natural language AI chatbot, can disrupt processes in higher education settings. The chatbot is capable of not only answering queries in a human-like way within seconds but can also provide long tracts of texts which can be in the form of essays, emails, and coding. In this study, in…

The present study adopted a praxis orientation to second language (L2) research and pedagogy to explore the professional development needs of three English as a foreign language (EFL) teachers after their first attempt at implementing dynamic assessment (DA) of essay writing. To date, few studies have examined how teachers learn to implement DA,…

Measuring lexical diversity in texts that have different lengths is problematic because length has a significant effect on the number of types a text contains, thus hampering any comparison. Treffers-Daller et al. (2018) recommended a simple solution, namely counting the number of types in a section of a given length that was extracted from the…

The upsurge of ICT media and hybrid modalities for learning that stemmed from the world health crisis seem to be destined to stay. In this new paradigm, self-assessment processes have acquired an even more relevant role in the teaching learning process than they already had. Due to the myriad of academic online resources and information at their…

The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…

It is widely believed that raters' cognition is an important aspect of writing assessment, as it has both logical and temporal priority over scores. Based on a critical review of previous research in this area, it is found that raters' cognition can be boiled to two fundamental issues: building text images and strategies for articulating scores.…

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

E-learning systems are transforming the educational sector and making education more affordable and accessible. Recently, many e-learning systems have been equipped with advanced technologies that facilitate the roles of educators and increase the efficiency of teaching and learning. One such technology is Automatic Essay Grading (AEG) or…

Increased expectations for writing performance have created a need for formative writing assessments that will help middle school teachers better understand adolescents' grade-appropriate writing skills and monitor the progress of students with or at risk for writing disabilities. In this practice piece, we first explain research-based…

In this article, I report on examiners' views and experiences of using Pairwise Comparative Judgement (PCJ) and Rank Ordering (RO) as alternatives to traditional analytical marking for GCSE English Language essays. Fifteen GCSE English Language examiners took part in the study. After each had judged 100 pairs of essays using PCJ and eight packs of…

Writing comprehensibly, dynamically, and persuasively in a foreign language is a significant challenge for learners. Written communication assesses language and writing progress for various summative and developmental goals. Scenario-based assessment (SBA), as one of the methodologies of classroom-based assessment (CBA), aims to elicit both…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

The purpose of this multiple intrinsic case study was to describe how Northeastern United States middle school teachers and students engaged with a new automated writing evaluation tool used to score and provide feedback on extended essay assignments to improve teaching and learning writing. Richard Elmore's (1993) instructional core framework is…

This essay considers the relative merits of critical writing and writing in role as a means of enabling and assessing students' responses to literary texts. Drawing largely on the author's experience of teaching "Frankenstein," it argues that the distinction between critical and creative writing is not as absolute as is sometimes…