In MOOCs for programming, Automated Testing and Feedback (ATF) systems are frequently integrated, providing learners with immediate feedback on code assignments. The analysis of the large amounts of trace data collected by these systems may provide insights into learners' patterns of utilizing the automated feedback, which is crucial for the…

Increased online learning is helping many appreciate that online grading, formative assessment, and summative testing can cause instructor burnout and leave little time for more productive instructor interactions. We reimagined grading, assessment, and testing in an extended program of design-based research using situative theory to refine online…

As a result of containment measures implemented during COVID-19, the authors needed to re-envision and restructure in-person assessments for learning that provided immediate peer feedback to students in their competency-based financial reporting course. Peer feedback is crucial in competency-based education, as mastering a competency necessitates…

Evaluation of instruction has typically occurred during development, before implementation, and after course completion. The problem is that evaluation is typically post delivery; courses are not traditionally updated in real time with feedback from students in the classroom. However the potential to evaluate and modify instruction during delivery…

Previous research regarding peer assessment has investigated the relationships between peer feedback and learners' performance. However, few studies investigate in-depth learning processes during technology-assisted peer assessment activities, particularly from affective, cognitive, and metacognitive perspectives. This study conducts a series of…

The traveling salesman problem (TSP) is a combinatorial optimization problem that requires finding the shortest path through a set of points ("cities") that returns to the starting point. Because humans provide heuristic near-optimal solutions to Euclidean versions of the problem, it has sometimes been used to investigate human visual…

Many universities rely on data gathered from tests that are low stakes for examinees but high stakes for the various programs being assessed. Given the lack of consequences associated with many collegiate assessments, the construct-irrelevant variance introduced by unmotivated students is potentially a serious threat to the validity of the…

The standard evaluation forms used in most college and university courses are ill suited to assess courses and instructors whose goals and pedagogy differ significantly from the "chalk and talk" approach to undergraduate instruction. This article discusses an evaluation form that the author, a professor emeritus of economics at the…

Recent dual-task studies suggest that a bottleneck prevents central mental operations from working on more than one task at a time, especially at relatively low practice levels. It remains highly controversial, however, whether this bottleneck is structural (inherent to human cognitive architecture) or merely a strategic choice. If the strategic…

Most of the emphasis on mining online assessment logs has been to identify content-specific errors. However, the pattern of general "consistency" is domain independent, strongly related to performance, and can itself be a target of educational data mining. We demonstrate that simple consistency indicators are related to student outcomes,…

Ubiquitous computing and mobile technologies provide a new perspective for designing innovative outdoor learning experiences. The purpose of this study is to propose a formative assessment design for integrating PDAs into ecology observations. Three learning activities were conducted in this study. An action research approach was applied to…

The 7th International Conference on Education Data Mining held on July 4th-7th, 2014, at the Institute of Education, London, UK is the leading international forum for high-quality research that mines large data sets in order to answer educational research questions that shed light on the learning process. These data sets may come from the traces…

Defined in its most basic form, distance learning occurs when the student and the instructor are logistically separated. The purpose of this paper is to propose a framework for the development and evaluation of online distance learning courses, based on integrating an adaptation of Tyler's principles within the levels of cognitive learning in…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…