Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

This study uses an experimental comparative design to accomplish two primary goals related teachers' perceptions of automated writing evaluation (AWE) performance. First, it quantitatively and qualitatively examines teachers' perceptions of the accuracy and trustworthiness of differentially performing AWE models. Second, it synthesizes interview…

One of the most important qualities of learners is the ability to conduct research. Students who grasp this subject acquire critical thinking abilities, which will eventually help them to function a valuable human being in the future. Proficiency in doing research is a prerequisite for academic achievement. The purpose of this study is to assess…

Purpose: This study examines the impact of generative artificial intelligence (GenAI), particularly ChatGPT, on higher education (HE). The ease with which content can be generated using GenAI has raised concerns across academia regarding its role in academic contexts, particularly regarding summative assessments. This research makes a unique…

Storylines exist about the types of learners who participate and excel in mathematics. To understand how AI chatbots participate in such storylines, we examined ChatGPT's feedback to different learners' mathematical writing in an exploratory study. Learners included academic labels, like gifted and special education, and race/ethnicity, like Black…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

Since the sovereignty of Hong Kong was returned to China in 1997, English has remained an official language and been formally referred to as a second language, though in reality it has, arguably, the status of a foreign language. This is especially true for writing because students do not have to write in English outside the classroom.…

In West Africa and in Ghana, there exist many modes of communication beyond the verbal and written. For example, at the chiefs' palaces there exist many systems of communication; notably, symbols (ideographs) that tell the philosophies and stories of the chiefs and the people of the tribes. In Ghana, as in many West African countries, it is…

In this study, we offer a unique perspective of time spent in kindergarten and young children's writing by presenting a multi-dimensional analysis of the writing of 72 children (5-years-old) living in northern communities in two Canadian provinces. We administered the "Drawing, Writing, Talking Task" (DWTT), a research-based classroom…

This article reports on assessments of business letters assigned to students in a business communication course. Assessments were performed by faculty in other disciplines and local business professionals, with each sampled assignment evaluated by one faculty and one business professional. Overall, the assessments by the two groups were similar in…

In this paper, we present a system for automatic evaluation of the quality of a question paper. Question paper plays a major role in educational assessment. The quality of a question paper is crucial to fulfilling the purpose of the assessment. In many education sectors, question papers are prepared manually. A prior analysis of a question paper…

As an important practice for researchers, citing sources is a challenging task for undergraduate students as they deal with the types of citation forms, the variety of reporting verbs and their tenses, and the writer stances through reporting verbs. Therefore, the current research is aimed at investigating the surface forms, reporting verb tenses,…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…