One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

ChatGPT has garnered unprecedented popularity since its release in November 2022. This artificial intelligence (AI) large language model (LLM) is designed to generate human-like text based on patterns found in massive amounts of data scraped from the internet. ChatGPT is significantly different from previous versions of GPT by its quality of…

With the recent rapid technological advance, second language (L2) educators have increasingly incorporated technologies into writing pedagogy. Two of the major technologies to promote L2 writing are e-portfolios and automated written corrective feedback (AWCF). Notably, feedback-rich portfolios facilitate L2 learners' self-regulation and writing…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

Writing is a necessary skill in our technological world. Many people have a mobile device that they use for e-mailing, social media, as an alarm clock to start the day, reading the news, searching for information, ordering food, managing transportation (e.g., monitoring traffic, accessing public transit), or for relaxing pursuits, such as watching…

This article considers the challenges heralded by digital technology in relation to the management of academic integrity on high-stakes Direct Entry English Programs in Australia. Firstly, a number of the ways in which students are using digital tools to complete assignment writing are examined. Secondly, findings from a review of academic…

The importance of plagiarism in an academic setting cannot be overlooked. Creating an awareness of plagiarism avoidance amongst students may be achievable and teaching students certain skills to avoid plagiarism, like paraphrasing, may also be possible. Although paraphrasing is one of the most important skills for avoiding plagiarism, it is a real…

This paper reports on the development of an analysis engine for the Research Writing Tutor (RWT), an AWE program designed to provide genre and discipline-specific feedback on the functional units of research article discourse. Unlike traditional NLP-based applications that categorize complete documents, the analyzer categorizes every sentence in…

Second language (L2) writing instructors have varying tools at their disposal for providing feedback on students' writing, including ones that enable them to provide written and audio feedback in electronic form. One tool that has been underexplored is Turnitin, a widely used software program that matches electronic text to a wide range of…

This article reports on an English for academic purposes course designed following the tenets of content and language integrated learning (CLIL) to address the needs of language minority (LM) high school graduates entering Canadian universities. The language used in and required of post-secondary study is challenging for many LM students,…

The author finds using software to make audio comments on students' writing improves students' understanding of her responses and increases their willingness to take her suggestions for revision more seriously. In the process of recording audio comments, she came to a new understanding of her students' writing needs and her responsibilities as…

E-rater[R] is an automated essay scoring system that uses natural language processing techniques to extract features from essays and to model statistically human holistic ratings. Educational Testing Service has investigated the use of e-rater, in conjunction with human ratings, to score one of the two writing tasks on the TOEFL-iBT[R] writing…

In this paper we present a system for automatic correction of errors made by learners of English. The system has two novel aspects. First, machine-learned classifiers trained on large amounts of native data and a very large language model are combined to optimize the precision of suggested corrections. Second, the user can access real-life web…

We built a natural language processing (NLP) system implementing a "virtual writing conference" for elementary-school children, with German as the target language. Currently, state-of-the-art computer support for writing tasks is restricted to multiple-choice questions or quizzes because automatic parsing of the often ambiguous and fragmentary…

Describes a method that writing instructors can use for evaluating and commenting on college students' composition papers that uses a stand-alone word processor. Software is discussed, the instructor's role is explained, methods of evaluation and marking papers are suggested, and electronic grading is described. (three references) (LRW)