This case study applied the "weak theory" of Automatic Item Generation (AIG) to generate isomorphic item instances (i.e., unique but psychometrically equivalent items) for a large-scale assessment. Three representative instances were selected from each item template (i.e., model) and pilot-tested. In addition, a new analytical framework,…

With the increasing use of automated scores in operational testing settings comes the need to understand the ways in which they can yield biased and unfair results. In this paper, we provide a brief survey of some of the ways in which the predictive methods used in automated scoring can lead to biased, and thus unfair automated scores. After…

Research on Automated Essay Scoring has become increasing important because it serves as a method for evaluating students' written responses at scale. Scalable methods for scoring written responses are needed as students migrate to online learning environments resulting in the need to evaluate large numbers of written-response assessments. The…

We describe an automated assessment process for team-coding assignments based on DevOps best practices. This system and methodology includes the definition of Team Performance Metrics measuring properties of the software developed by each team, and their correct use of DevOps techniques. It tracks the progress on each of metric by each group. The…

Research on bias in artificial intelligence has grown exponentially in recent years, especially around racial bias. Many modern technologies which impact people's lives have been shown to have significant racial biases, including automatic speech recognition (ASR) systems. Emerging studies have found that widely-used ASR systems function much more…

Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed "feedback literacy." A previously published teacher "feedback literacy competency framework" has identified what is needed by teachers to implement…

Purpose: To date, there are no automated tools for the identification and fine-grained classification of paraphasias within discourse, the production of which is the hallmark characteristic of most people with aphasia (PWA). In this work, we fine-tune a large language model (LLM) to automatically predict paraphasia targets in Cinderella story…

Automatic Text Simplification (ATS) consists of computing techniques to rewrite text to make it simpler to read and understand, and prior research has explored its use to provide reading assistance to various user groups who may benefit from reading support. Prior literacy research has identified great diversity in literacy skills among DHH…

Intersection of education and deep learning method of artificial intelligence (AI) is gradually becoming a hot research field. Education will be profoundly transformed by AI. The purpose of this review is to help education practitioners understand the research frontiers and directions of AI applications in education. This paper reviews the…

This dissertation focuses on strategies and techniques to enhance code comprehension skills among students enrolled in introductory computer science courses (CS1 and CS2). We propose a novel tutoring system, "DeepCodeTutor," designed to improve the code comprehension abilities of novices. DeepCodeTutor employs scaffolded self-explanation…

Fostering productive engagement within teams has been found to improve student learning outcomes. Consequently, characterizing productive and unproductive time during teamwork sessions is a critical preliminary step to increase engagement in teamwork meetings. However, research from the cognitive sciences has mainly focused on characterizing…

We discuss transforming STEM education using three aspects: learning progressions (LPs), constructed response performance assessments, and artificial intelligence (AI). Using LPs to inform instruction, curriculum, and assessment design helps foster students' ability to apply content and practices to explain phenomena, which reflects deeper science…

Background and Context: Auto-graders are praised by novice students learning to program, as they provide them with automatic feedback about their problem-solving process. However, some students often make random changes when they have errors in their code, without engaging in deliberate thinking about the cause of the error. Objective: To…

The process of generating challenging and appropriate distractors for multiple-choice questions is a complex and time-consuming task. Existing methods for an automated generation have limitations in proposing challenging distractors, or they fail to effectively filter out incorrect choices that closely resemble the correct answer, share synonymous…

Data transfer between isolated clusters is imperative for cybersecurity education, research, and testing. Such techniques facilitate hands-on cybersecurity learning in isolated clusters, allow cybersecurity students to practice with various hacking tools, and develop professional cybersecurity technical skills. Educators often use these remote…