The evaluation of student essay corrections has become a focal point in understanding the evolving role of Artificial Intelligence (AI) in education. This study aims to assess the accuracy, efficiency, and cost-effectiveness of ChatGPT's essay correction compared to human correction, with a primary focus on identifying and rectifying grammatical…

Computer-supported learning technologies are essential for conducting hands-on cybersecurity training. These technologies create environments that emulate a realistic IT infrastructure for the training. Within the environment, training participants use various software tools to perform offensive or defensive actions. Usage of these tools generates…

In 2017, "Robot-Proof," the first edition, foresaw the advent of the AI economy and called for a new model of higher education designed to help human beings flourish alongside smart machines. That economy has arrived. Creative tasks that, seven years ago, seemed resistant to automation can now be performed with a simple prompt. As a…

Multiple-choice questions have become ubiquitous in educational measurement because the format allows for efficient and accurate scoring. Nonetheless, there remains continued interest in constructed-response formats. This interest has driven efforts to develop computer-based scoring procedures that can accurately and efficiently score these items.…

In automated essay scoring (AES) systems, similarity techniques are used to compute the score for student answers. Several methods to compute similarity have emerged over the years. However, only a few of them have been widely used in the AES domain. This work shows the findings of a ten-year review on similarity techniques applied in AES systems…

Purpose: The purpose of this paper is to identify workforce skills that protect an occupation from elimination due to automation technology. Design/methodology/approach: The authors apply a Gaussian process (GP) classifier, based on the level of non-automatable work activities in an occupation, to USA and Colombian occupational datasets. Findings:…

In this article, we argue that automated scoring engines should be transparent and construct relevant--that is, as much as is currently feasible. Many current automated scoring engines cannot achieve high degrees of scoring accuracy without allowing in some features that may not be easily explained and understood and may not be obviously and…

In this article, we systematize the factors influencing performance and feasibility of automatic content scoring methods for short text responses. We argue that performance (i.e., how well an automatic system agrees with human judgments) mainly depends on the linguistic variance seen in the responses and that this variance is indirectly influenced…

Digital automation is on the rise in a diverse range of industries. The technologies employed here often make use of artificial intelligence (AI) and its common form, machine learning (ML) to augment or replace the work completed by human agents. The recent emergence of a variety of design automation platforms inspired the authors to undertake a…

Purpose: The purpose of this paper is to examine how automation in the ever-changing technological landscape is increasing integrated into, and has become a significant presence in, our personal lives. Design/methodology/approach: Through post qualitative inquiry, the authors provide a contemplation of automation and its effect on creativity, as a…

For predicting and improving the quality of essays, text analytic metrics (surface, syntactic, morphological, and semantic features) can be used to provide formative feedback to the students in higher education. In this study, the goal was to identify a sufficient number of features that exhibit a fair proxy of the scores given by the human raters…

Vehicle automation is becoming more prevalent. Understanding how drivers use this technology and its safety implications is crucial. In a 6-8 week naturalistic study, we leveraged a hybrid naturalistic driving research design to evaluate driver behavior with Level 2 vehicle automation, incorporating unique naturalistic and experimental control…

This article examines the transformative impact of generative artificial intelligence (GenAI) in enhancing feedback quality in a Bachelor of Science course. It the challenges of providing personalized, timely feedback to students in larger educational settings, focusing on the use of GenAI to analyze and respond to student logbooks. These logbooks…

The body language of an educator during a class can affect student's level of interest and concentration. As an attempt to assist educators to improve their body language and speaking characteristics, a pilot body language analysis system that assesses the body language of educators was developed. The proposed application makes use of specific…

This paper reports on a set of three recent experiments utilizing large-scale speech models to assess the oral reading fluency (ORF) of students in Ghana. While ORF is a well-established measure of foundational literacy, assessing it typically requires one-on-one sessions between a student and a trained rater, a process that is time-consuming and…