Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the class textual materials across different semesters to assess LLM outputs across various tasks. By utilizing…

This study adopted the Latent Dirichlet Allocation (LDA) to extract learners' needs based on 70,145 reviews from online course designed for software design and development in China and then applied Quality Function Deployment (QFD) to map learners' differentiated needs into quality attributes. Taking national first-class courses as the…

Background and Context: Feedback on one's progress is essential to new programming language learners, particularly in out-of-classroom settings. Though many study materials offer assessment mechanisms, most do not examine the accuracy of the feedback they deliver, nor give evidence on its validity. Objective: We investigate the potential use of a…

Contribution: This article analyzes student assessment within a computing faculty employing a full project-based learning (PBL) approach. Examining 2078 final grades across 60 classes and periods, the study reveals a significant correlation between graded self-studies, exams, and projects. This result contributes to understanding the reliability…

The Bachelor's Degree in Computer Engineering at University Jaume I has a capstone project in which the student develops, during a 300-hour internship in an enterprise, a real-world project. We collected data for five academic years to analyze the assessment process to propose a new hybrid model, which combines analytic and holistic assessment and…

Critical thinking is a fundamental skill for 21st-century citizens, and it should be promoted from elementary school and developed in computing education. However, assessing the development of critical thinking in educational contexts presents unique challenges. In this study, a systematic mapping was carried out to investigate how to assess the…

Computer Science (CS) is a vital subject in K-12 education, and acquiring proficiency in CS is essential for nurturing talent. However, current teaching practices often rely on standardized tests to evaluate academic performance, which may not offer a comprehensive and multidimensional assessment of students' competency in learning CS.…

Educational games have gained widespread interest among teachers and researchers across various fields due to their capacity to engage students, foster active participation, and improve learning outcomes. In the context of computer programming, which demands significant cognitive effort, the use of educational games has grown substantially. While…

Capstone courses, where students work on a large group project at the end of their degree, are common in computing. Many accreditation and industry bodies explicitly require or recommend them. Over the past two decades, capstone courses specifically focused on game development have become increasingly popular. Game development offers students the…

This research will analyze the issues encountered by two science teachers implementing Arduino-based robotic coding projects. This research employed a case study design. This research has used a criterion sampling group. This study used semi-structured observation, interviews, and video observations as data collection tools. The teachers conducted…

The emergence of Large Language Models (LLMs) has marked a significant change in education. The appearance of these LLMs and their associated chatbots has yielded several advantages for both students and educators, including their use as teaching assistants for content creation or summarisation. This paper aims to evaluate the capacity of LLMs…