Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing…

Contribution: This article analyzes student assessment within a computing faculty employing a full project-based learning (PBL) approach. Examining 2078 final grades across 60 classes and periods, the study reveals a significant correlation between graded self-studies, exams, and projects. This result contributes to understanding the reliability…

The Bachelor's Degree in Computer Engineering at University Jaume I has a capstone project in which the student develops, during a 300-hour internship in an enterprise, a real-world project. We collected data for five academic years to analyze the assessment process to propose a new hybrid model, which combines analytic and holistic assessment and…

The computing education research community now has at least 40 years of published research on teaching ethics in higher education. To examine the state of our field, we present a systematic literature review of papers in the "Association for Computing Machinery" computing education venues that describe teaching ethics in higher-education…

There can be many reasons why students fail to answer correctly to summative tests in advanced computer science courses: often the cause is a lack of prerequisites or misconceptions about topics presented in previous courses. One of the ITiCSE 2020 working groups investigated the possibility of designing assessments suitable for differentiating…

Educational games have gained widespread interest among teachers and researchers across various fields due to their capacity to engage students, foster active participation, and improve learning outcomes. In the context of computer programming, which demands significant cognitive effort, the use of educational games has grown substantially. While…

The evaluation of student projects is a difficult task, especially when they involve both a technical and a creative component. We propose an artificial intelligence (AI)-based methodology to help in the evaluation of complex projects in engineering and computer science courses. This methodology is intended to evaluate the assessment process…

Aim/Purpose: This paper explores the potential value of critical thinking in computer science education and discusses strategies for its integration across the curriculum. Background: As technology rapidly evolves and becomes increasingly integrated into society, there is a growing need for computer science graduates who can think critically about…

Teaching programming efficiently to students in the first year of computer science education is challenging. It is especially cumbersome to retain the interest of both groups, when the student group consists of novice (i.e., those who have never programmed before) and expert programmers in the same crowd. Thus, individualized teaching cannot be…

As universities shifted to online education with the onset of the Coronavirus Disease 2019 (COVID-19) pandemic, both pedagogy and assessment patterns across disciplines underwent a change, with a shift towards collaborative digital assessments. In this context, using qualitative and quantitative methods for data collection from an assessment…

The emergence of Large Language Models (LLMs) has marked a significant change in education. The appearance of these LLMs and their associated chatbots has yielded several advantages for both students and educators, including their use as teaching assistants for content creation or summarisation. This paper aims to evaluate the capacity of LLMs…

Nowadays, few professionals understand the techniques and testing criteria to systematize the software testing activity in the software industry. Towards shedding some light on such problems and promoting software testing, professors in the area have established Massive Open Online Courses as educational initiatives. However, the main limitation…

The COVID-19 pandemic, an unprecedented global health crisis, has not only significantly impacted public health but has also caused substantial disruptions to conventional education systems. In response to these challenges, our institution has undertaken innovative measures within the realm of education. A pivotal aspect of our response involves…

This study proposes a software system for determining gaze patterns in on-screen testing. The system applies machine learning techniques to eye-movement data obtained from an eye-tracking device to categorize students according to their gaze behavior pattern while solving an on-screen test. These patterns are determined by converting eye movement…

Objectives: Automatic assessment systems are widely used to provide rapid feedback for students and reduce grading time. Despite the benefits of increased efficiency and improved pedagogical outcomes, an ongoing challenge is mitigating poor student behaviors when interacting with automatic assessment systems including numerous submissions,…