Mastering SQL programming skills is fundamental in computer science education, and Online Judging Systems (OJS) play a critical role in automatically assessing SQL codes, improving the accuracy and efficiency of evaluations. However, these systems are vulnerable to manipulation by students who can submit "cheating codes" that pass the…

Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing…

This study investigates ChatGPT's perspectives on coding education for preschool children to provide a comprehensive understanding that is valuable for educators in early childhood education. An instrumental case study approach was employed, utilizing qualitative research design and case study methods. Data were gathered using a structured…

This paper undertakes a thorough evaluation of ChatGPT's code generation capabilities, contrasting them with those of human programmers from both educational and software engineering standpoints. The emphasis is placed on elucidating its importance in these intertwined domains. To facilitate a robust analysis, we curated a novel dataset comprising…

The relative effectiveness of reflection either through student generation of contrasting cases or through provided contrasting cases is not well-established for adult learners. This paper presents a classroom study to investigate this comparison in a college level Computer Science (CS) course where groups of students worked collaboratively to…

Motivation: Students learning to program often reach states where they are stuck and can make no forward progress--but this may be outside the classroom where no instructor is available to help. In this situation, an automatically generated next-step hint can help them make forward progress and support their learning. It is important to know what…

Generative AI is a disruptive technology that has the potential to transform many aspects of how computer science is taught. Like previous innovations such as high-level programming languages and block-based programming languages, generative AI lowers the technical expertise necessary to create working programs, bringing the power of computation…

The current educational system relies heavily on manual grading, posing challenges such as delayed feedback and grading inaccuracies. Automated grading tools (AGTs) offer solutions but come with limitations. To address this, "GRAD-AI" is introduced, an advanced AGT that combines automation with teacher involvement for precise grading,…

Artificial intelligence (AI) has taken the forefront in discussions of the future of media and education. Although there are valid concerns, AI has the potential to be useful in learning new skills, particularly those related to computer programming. This case study depicts the ways AI was introduced to assist in teaching coding, specifically in a…

The rapid advancement of artificial intelligence and its increasing societal impacts have turned many computing educators' focus toward early education in machine learning (ML). Limited options for educational tools for teaching novice learners about the mechanisms of ML and data-driven systems presents a recognized challenge in K-12 computing…

The ability of large language models (LLMs) to generate code has raised concerns in computer science education, as students may use tools like ChatGPT for programming assignments. While much research has focused on higher education, especially for languages like Java and Python, little attention has been given to K-12 settings, particularly for…

Collaborative dialogue offers rich insights into students' learning and critical thinking. This is essential for adapting pedagogical agents to students' learning and problem-solving skills in STEM+C settings. While large language models (LLMs) facilitate dynamic pedagogical interactions, potential hallucinations can undermine confidence, trust,…

Knowledge Tracing (KT) models predicting student performance in intelligent tutoring systems have been successfully deployed in several educational domains. However, their usage in open-ended programming problems poses multiple challenges due to the complexity of the programming code and a complex interplay between syntax and logic requirements…

Aim/Purpose: This paper is part of a multi-case study that aims to test whether generative AI makes an effective coding assistant. Particularly, this work evaluates the ability of two AI chatbots (ChatGPT and Bing Chat) to generate concise computer code, considers ethical issues related to generative AI, and offers suggestions for how to improve…

Automatic program repair (APR) tools are valuable for students to assist them with debugging tasks since program repair captures the code modification to make a buggy program pass the given test-suite. However, the process of manually generating catalogs of code modifications is intricate and time-consuming. This article proposes contextual error…