There has been substantial research on doctoral supervision and examination, yet rarely a focus on what happens at the end-stage of the process when examiner feedback is received and addressed. This article reports survey findings (n = 262) from a study investigating supervisor perceptions about Australian end-stage doctoral examination processes.…

The theory of formative assessment highlights the importance of ipsative assessment, which uses internally generated criteria and goals to compare students' performance with their past performance. This study designed a formative ipsative assessment practice as part of inquiry learning in high school and clarified its significance and challenges.…

Business writing has been a desired skill in managers. The existing traditional business writing assessment tools like written examination and hand-in assignments based on genre-specific instructions do not create a workplace writing environment. The business management students (n = 98) engage with an innovative Web 2.0-based business writing…

Automated Writing Evaluation program (AWE) has gained increasing ground in ESL/EFL writing instruction because of its instructional features, such as the instant automated writing score system and the diagnostic corrective feedback in real-time for individual written drafts. However, there is little known about how the automated feedback provided…

As labor-based grading contracts gain momentum in first-year writing classrooms, new kinds of response to writing take center stage. We explore how session notes composed by embedded peer tutors and students become rich tools in a writing process and create a gateway to the writing center for first-year students. By reading session notes in…

While a great deal is known about instructor response to student writing--from commenting practices to student perceptions--less is known about how feedback impacts students' writing and writerly development. While we set out to study students' explicit engagement with written instructor feedback, our initial experimental design was disrupted by…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

As an important practice for researchers, citing sources is a challenging task for undergraduate students as they deal with the types of citation forms, the variety of reporting verbs and their tenses, and the writer stances through reporting verbs. Therefore, the current research is aimed at investigating the surface forms, reporting verb tenses,…

The computer-supported writing assessment (CSWA) has been widely used to reduce instructor workload and provide real-time feedback. Interpretability of CSWA draws extensive attention because it can benefit the validity, transparency, and knowledge-aware feedback of academic writing assessments. This study proposes a novel assessment tool,…

We know little to what extent peer feedback strategies can be applied on a large scale in higher education for complex tasks. This study aimed to design, implement, and evaluate an online-supported peer feedback module for large-scale use to enhance higher education students' argumentative essay writing performance. To do this, 330 students from…

The release of ChatGPT marked the beginning of a new era of AI-assisted plagiarism that disrupts traditional assessment practices in ESL composition. In the face of this challenge, educators are left with little guidance in controlling AI-assisted plagiarism, especially when conventional methods fail to detect AI-generated texts. One approach to…

This study compared the effects of worked example and scripting on students' argumentative peer feedback, essay and learning qualities. Participants were 80 BSc students who were randomly divided over 40 dyads and assigned to two experimental conditions (worked example and scripting). An online peer feedback environment named EduTech was designed…

The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…