Automated assessment is well-established within computer science courses but largely absent from human--computer interaction courses. Automating the assessment of human--computer interaction (HCI) is challenging because the coursework tends not to be computational but rather highly creative, such as designing and implementing interactive…

Due to the development of deep learning technology, its application in education has received increasing attention from researchers. Intelligent agents based on deep learning technology can perform higher order intellectual tasks than ever. However, the high deployment cost of deep learning models has hindered their widespread application in…

Generative artificial intelligence (AI) has shown incredible leaps in performance across data of a variety of modalities including texts, images, audio, and videos. This affords social scientists the ability to annotate variables of interest from unstructured media. While rapidly improving, these methods are far from perfect and, as we show, even…

Creativity is a vital skill in science, technology, engineering, and mathematics (STEM)-related education, fostering innovation and problem-solving. Traditionally, creativity assessments relied on human evaluations, such as the consensual assessment technique (CAT), which are resource-intensive, time-consuming, and often subjective. Recent…

The human face is commonly used for identity verification. While this task was once exclusively performed by humans, technological advancements have seen automated facial recognition systems (AFRS) integrated into many identification scenarios. Although many state-of-the-art AFRS are exceptionally accurate, they often require human oversight or…

This paper presents a study analyzing the perception of artistic products created by or with the support of artificial intelligence (AI). The research builds on previous studies revealing that the output of artificial creativity processes can indeed rival human-made products, satisfy consumer expectations, and derive enjoyment. However, in…

In two experiments, we examine how features of an imperfect automated decision aid influence compliance with the aid in a simplified, simulated nautical collision avoidance task. Experiment 1 examined the impact of providing transparency in the pre-task instructions regarding which attributes of the task that the aid uses to provide its…

Recent advancements in generative Artificial Intelligence (GenAI) were accompanied by both hype and fear regarding the ways in which such technologies of automation would replace human labor in various fields, including education. Rather than focusing on the replacement of humans in teaching, this piece uses new materialist thought [Barad, Karen.…

Much has been written about how to improve the fairness of AI tools for decision-making but less has been said about how to approach this new field from the perspective of philosophy of education. My goal in this paper is to bring together criteria from the general algorithmic fairness literature with prominent values of justice defended by…

Systematic reviews are resource-intensive. The machine learning tools being developed mostly focus on the study identification process, but tools to assist in analysis and categorization are also needed. One possibility is to use unsupervised automatic text clustering, in which each study is automatically assigned to one or more meaningful…

In a range of settings, human operators make decisions with the assistance of automation, the reliability of which can vary depending upon context. Currently, the processes by which humans track the level of reliability of automation are unclear. In the current study, we test cognitive models of learning that could potentially explain how humans…

Peer grading has diverse applications in many fields, including the peer grading of open assignments in online courses. The major challenge in peer grading is improving the seriousness (reviewing carefully) of reviewers. Previous studies have proposed several incentive reward mechanisms intended to reward or punish reviewers. Although these…

Scientific modeling is a vital educational practice that helps students apply scientific knowledge to real-world phenomena. Despite advances in AI, challenges in accurately assessing such models persist, primarily due to the complexity of cognitive constructs and data imbalances in educational settings. This study addresses these challenges by…

The purpose of this study is to introduce and evaluate a method for generating reading comprehension items using template-based automatic item generation. To begin, we describe a new model for generating reading comprehension items called the text analysis cognitive model assessing inferential skills across different reading passages. Next, the…

Background: The recent advent of powerful, exam-passing large language models (LLMs) in public awareness has led to concerns over students cheating, but has also given rise to calls for including or even focusing education on LLMs. There is a perceived urgency to react immediately, as well as claims that AI-based reforms of education will lead to…