In automated essay scoring (AES), essays are automatically graded without human raters. Many AES models based on various manually designed features or various architectures of deep neural networks (DNNs) have been proposed over the past few decades. Each AES model has unique advantages and characteristics. Therefore, rather than using a single-AES…

Quality control and assurance plays a fundamental role within higher education contexts. One means by which quality control can be performed is by mapping the course learning outcomes (CLOs) to the program learning outcomes (PLO). This paper describes a system by which this mapping process can be automated and validated. The proposed AI-based…

Artificial Intelligence (AI) has seen a significant rise in public use since the release of ChatGPT in November of 2022. Higher education institutions (HEI) have struggled to negotiate how best to manage AI technologies within their academic communities, acknowledging both positive and negative impacts of AI on education. Focused primarily on…

Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

The main objective of this methodological article is to discuss the contribution of response times as a tool in education research. The use of response times in research is largely a legacy of the work carried out in cognitive psychology, which has made it possible to describe the cognitive processes involved in information processing. In…

Background: Automatically graded programming assignments provide instant feedback to students and significantly reduce manual grading time for instructors. However, creating comprehensive suites of test cases for programming problems within automatic graders can be time-consuming and complex. The effort needed to define test suites may deter some…

Background: Providing students with information on their current performance could help them improve by stimulating their reflection, but negative feedback that saliently mirrors task-related failure can harm motivation. In the context of automated scoring based on artificial intelligence, we explored how feedback on written texts might be…

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly popular in assisting human graders to reduce their workload. However, LLMs' limitations in domain knowledge…

The emergence of artificial intelligence and neural networks creates a significant potential for automating an increasing number of business processes of large, small, and medium-sized businesses in various sectors of the economy. The financial sector, education, medicine, retail trade, and transport are the most promising from the point of view…

The International English Language Testing System (IELTS) is a high-stakes exam where Writing Task 2 significantly influences the overall scores, requiring reliable evaluation. While trained human raters perform this task, concerns about subjectivity and inconsistency have led to growing interest in artificial intelligence (AI)-based assessment…

Forums are essential components facilitating interactions in online courses. However, in large-scale courses, many posts generated, which results in learners' difficulties. First, the posts are poorly organized and some deviate from the topic, making it difficult for learners' knowledge acquisition. Second, learners cannot receive timely feedback…

Systematic reviews are resource-intensive. The machine learning tools being developed mostly focus on the study identification process, but tools to assist in analysis and categorization are also needed. One possibility is to use unsupervised automatic text clustering, in which each study is automatically assigned to one or more meaningful…

Higher education institutions adopt conversational agents, or chatbots, to perform and automate certain business functions. While chatbots exist to support Enrollment Services, Financial Aid, and other departments within an institution, Institutional Research lacks options. Institutional Research supports higher education institutions by providing…

Writing is a critical 21st century skill. Today's knowledge economy places a premium upon collaboration and written communication, which means that the skilled writer enters the job market at a significant advantage (Aschliman, 2016; Brandt, 2005). And yet students typically enter the job market with weak writing skills. Only 27% of 12th-grade…

Automated test assembly (ATA) is a modern approach to test assembly that applies advanced optimization algorithms on computers to build test forms automatically. ATA greatly improves the efficiency and accuracy of the test assembly. This study investigated the effects of the modeling methods and solvers in the mixed-integer programming (MIP)…