Background: Natural language processing (NLP) and machine learning technologies offer significant advantages, such as facilitating the delivery of reflective feedback in collaborative learning environments while minimising technical constraints for educators related to time and location. Recently, scholars' interest in reflective feedback has…

This study evaluates the ability of large language models (LLMs) to deliver criterion-based grading and examines the impact of prompt engineering with detailed criteria on grading. Using well-established human benchmarks and quantitative analyses, we found that even free LLMs achieve criterion-based grading with a detailed understanding of the…

Student opinions for a course are important to educators and administrators, regardless of the type of the course or the institution. Reading and manually analyzing open-ended feedback becomes infeasible for massive volumes of comments at institution level or online forums. In this paper, we collected and pre-processed a large number of course…

Peer Evaluation Systems (PESs) allow members of student teams to provide one another with computer-mediated feedback in the form of qualitative, open-ended comments. The current research leverages unsupervised Natural Language Processing (NLP), namely Biterm Topic Modeling (BTM) and sentiment analysis, to uncover latent topics and degree of…

Background: Artificial intelligence, particularly natural language processing (NLP), enables automating the formative assessment of written task solutions to provide adaptive feedback automatically. A laboratory study found that, compared with static feedback (an expert solution), adaptive feedback automated through artificial neural networks…

E-learning is the process of sharing knowledge out of the traditional classrooms through different online tools using internet. The availability and use of these tools are not easy for every student. Many institutions gather e-learning feedback to know the problems of students to improve their systems. In e-learning systems, typically a high…

Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students during self-regulated learning. In this light, we propose the application of Large Language Models (LLMs) to…

Free text answers to short questions can reflect students' mastery of concepts and their relationships relevant to learning objectives. However, automating the assessment of free text answers has been challenging due to the complexity of natural language. Existing studies often predict the scores of free text answers in a "black box"…

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a range of educational tasks (eg, question generation, feedback provision, and essay grading), there are…

Advancements in artificial intelligence are rapidly increasing. The new-generation large language models, such as ChatGPT and GPT-4, bear the potential to transform educational approaches, such as peer-feedback. To investigate peer-feedback at the intersection of natural language processing (NLP) and educational research, this paper suggests a…

Artificial Intelligence (AI) based assessments are commonly used in a variety of settings including business, healthcare, policing, manufacturing, and education. In education, AI-based assessments undergird intelligent tutoring systems as well as many tools used to evaluate students and, in turn, guide learning and instruction. This chapter…

Peer assessment can be a more effective pedagogical method when reviewers provide quality feedback. But what makes feedback helpful to reviewees? Other studies have identified quality feedback as focusing on detecting problems, providing suggestions, or pointing out where changes need to be made. However, it is important to seek students'…

Open-ended responses to surveys can be highly beneficial to higher education institutions, providing clarity and context that quantitative data can sometimes lack. However, analyzing open-ended responses typically takes time and manpower most institutional assessment offices do not have to spare. This study focused on finding a potential solution…

This emerging technology report delves into the role of ChatGPT, an OpenAI conversational AI, in language learning. The initial section introduces ChatGPT's nature and highlights its features, including accessibility, personalization, immersive learning, and instant feedback, which render it a valuable asset for language learners and educators…

Knowledge tracing (KT) aims to predict students' future performances based on their former exercises and additional information in educational settings. KT has received significant attention since it facilitates personalized experiences in educational situations. Simultaneously, the autoregressive (AR) modeling on the sequence of former exercises…