A systematic review is a type of literature review that aims to collect and analyse all available evidence from the literature on a particular topic. The process of screening and identifying eligible articles from the vast amounts of literature is a time-consuming task. Specialised software has been developed to aid in the screening process and…

The recent advancement in technology has attracted learners' attention worldwide to Generative Artificial Intelligence (GenAI) for educational purposes. While GenAI has shown promising results for general language purposes (Godwin-Jones, 2023; Xiao & Zhi, 2023), the potential of GenAI for language learning has not been fully explored. This…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Purpose: This study aims to report the design, development and evaluation of a digital quality assurance application aimed at improving and ensuring the quality of assessment programmes in higher education. Design/methodology/approach: The application was developed using a design-based research (DBR) methodology. The application's design was…

The way in which informal learning in a Personal Learning Environment (PLE) is coordinated is poorly understood. Conversation -- with teachers, friends or family -- contributes to the processes involved in meaningfully negotiating resources. While institution-centric education creates contexts for conversations and codifies educational attainment,…

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the…

Interfaces with good usability help their users complete more tasks in less time and with less effort, which gives them greater satisfaction. Given the vast array of options available to users today, usability is an important interface feature that may lead to the commercial success or failure of a software system. Despite its importance, few…

Three real-world datasets are introduced for a petroleum engineering capstone design course, providing detailed problem statements, assessment criteria, team-building practices, and required software packages. Two surveys reveal that students prefer real datasets over synthetic ones, and despite initial challenges, students feel proud of their…

Due to the introduction and rapid ubiquity of artificial intelligence (AI) and AI-integrated programs that can be used by students and teachers, educational scholarship evaluating the capabilities of AI is needed. This study evaluates the abilities of three prominent AI programs--ChatGPT, Microsoft's Bing, and Google's Bard--to create high school…

Today, there is no consensus about proper timing and conditions for integration of PowerPoint presentations into the educational process. But the model-based evaluation can make a decision-making process easier when it comes to using presentations. The purpose of this study is to build a formal model to evaluate presentations. In order to build a…

The study develops a method for monitoring and management of the quality of educational programs using software instruments. The method describes each of the monitoring implementation stages in detail specifying the input and output data, as well as the controls that affect the time and quality of the implementation of the corresponding stage.…

Typical Bayesian methods for models with latent variables (or random effects) involve directly sampling the latent variables along with the model parameters. In high-level software code for model definitions (using, e.g., BUGS, JAGS, Stan), the likelihood is therefore specified as conditional on the latent variables. This can lead researchers to…

This study aims to develop a robust rubric for evaluating artificial intelligence (AI)--assisted essay writing in English as a Foreign Language (EFL) contexts. Employing a modified Delphi technique, we conducted a comprehensive literature review and administered Likert scale questionnaires. This process yielded nine key evaluation criteria,…

The quality of writing in a second language (L2) is one of the indicators of the level of proficiency for many college students to be eligible for departmental studies. Although certain software programs, such as Intelligent Essay Assessor or IntelliMetric, have been introduced to evaluate second-language writing quality, an overall assessment of…

Maturity models fill the need for a measure of overall growth in how outcomes assessment is defined and how feedback informs improvement to meet internal and external expectations at individual institutions of higher education. An exploratory qualitative study was conducted to develop an instrument, the Assessment System Maturity Matrix (ASMM), to…