Identifying high-quality educators at the point of hire can reduce future recruitment costs and minimize the impact of attrition on school organizations and student learning. One low-cost way to screen applicants and learn about their beliefs, values, and pedagogy is through their short-essay writing samples. However, there is limited research…

We use a continuous improvement model to evaluate an information design assignment by analyzing 120 student drafts and finals alongside instructor feedback. Using data from across sections (N = 118), we illustrate a process focused on improving student learning that other technical and professional communication program administrators and faculty…

This study examines the potential to use non-expert, crowd-sourced raters to score essays by comparing expert raters' and crowd-sourced raters' assessments of writing quality. Expert raters and crowd-sourced raters scored 400 essays using a standardised holistic rubric and comparative judgement (pairwise ratings) scoring techniques, respectively.…

Background: Learning to write the complex academic language (AL) associated with a discipline (like science) is a critical task in education, with middle school being a key developmental period. However, we need more research to guide how we assess students' learning to write AL, especially if we want to create assessment that guides more…

The evaluation of student essay corrections has become a focal point in understanding the evolving role of Artificial Intelligence (AI) in education. This study aims to assess the accuracy, efficiency, and cost-effectiveness of ChatGPT's essay correction compared to human correction, with a primary focus on identifying and rectifying grammatical…

Generative artificial intelligence technologies, such as ChatGPT, bring an unprecedented change in education by leveraging the power of natural language processing and machine learning. Employing ChatGPT to assist with marking written assessment presents multiple advantages including scalability, improved consistency, eliminating biases associated…

This paper explores the growing complexity of detecting and differentiating generative AI from other AI interventions. Initially prompted by noticing how tools like Grammarly were being flagged by AI detection software, it examines how these popular tools such as Grammarly, EditPad, Writefull, and AI models such as ChatGPT and Microsoft Bing…

Depending on the nature of comments made during peer review of academic writing, students may be able to evaluate and revise their performance. Therefore, it is essential to explore how the content of comments affects student writing. Since peer review is a process of interaction, it is critical to understand how comments affect student academic…

Assessing students' writing performance is essential to adequately monitor and promote individual writing development, but it is also a challenge. The present research investigates a benchmark rating procedure for assessing texts written by upper-elementary students. In two studies we examined whether a benchmark rating procedure (1) leads to…

Students are expected to interpret the complexities and nuances of literary texts yet might struggle with interpreting texts in ways that are valued in literary studies. Examining students' language choices can support instructors and students with developing concrete, explicit understandings of the ways language creates meanings in discourse.…

Background: A common approach to assessing students' integrated understanding of multiple documents is to analyse their post-reading written reports. This study investigated to what extent writing self-efficacy directly and indirectly (via integrative processing) contributed to multiple-document comprehension as assessed with an integrative…

Preschool teachers' literacy-related beliefs and literacy knowledge relate to their educational practices and preschoolers' literacy skills. In this light, we explored how preschool teachers' beliefs regarding early literacy and its promotion predict their knowledge, reflected in how they evaluate three young children's writing products and their…

Evaluating the quality of university exam papers is crucial for universities seeking institutional and program accreditation. Currently, exam papers are assessed manually, a process that can be tedious, lengthy, and in some cases, inconsistent. This is often due to the focus on assessing only the formal specifications of exam papers. This study…

Reflective Learning Journals are used to engage students in the learning process. To motivate students to complete the Reflective Learning Journal it is common practice to allocate marks and it is in this area that problems arise. To address the problems rubrics have been used however, most rubrics are based on assigning marks to very…

This paper reports the findings of a study of student writing that assessed the skill needs of a cohort of developmental writing students enrolled in a co-requisite composition course at a community college that is part of the City University of New York (CUNY). This credit-bearing course fulfills the first half of the required composition…