Partially automated assessment is implemented via the 'Printable worksheet' mode in the Numbas e-assessment system to create a mathematical modelling worksheet which is individualised with random parameters but completed and marked as if it were a non-automated piece of coursework, preserving validity while reducing the risk of academic misconduct…

The template-based automated item-generation (TAIG) approach that involves template creation, item generation, item selection, field-testing, and evaluation has more steps than the traditional item development method. Consequentially, there is more margin for error in this process, and any template errors can be cascaded to the generated items.…

This article offers a historical inquiry into behaviorism and its impact on standard of judgement concerning education policies. Drawing from Aldous Huxley's reservation towards behaviorism as a scientific movement that naturalizes the role of control in human affairs, the paper maps the impact of behaviorism on economics of education. By tracing…

In contemporary societies, the processes of transindividuation by which knowledges are transformed into cycles and rhythms of metastability have been dramatically short-circuited. In turn, this has provoked the spiritual misery and pseudo-fabulations so prevalent all around us, including our educational contexts. For Stiegler, this is nothing…

In this article, we systematize the factors influencing performance and feasibility of automatic content scoring methods for short text responses. We argue that performance (i.e., how well an automatic system agrees with human judgments) mainly depends on the linguistic variance seen in the responses and that this variance is indirectly influenced…

The COVID-19 pandemic has forced the rapid adoption of remote teaching modalities including "hyflex" where students attend some class sessions in person and some online. Managing the hyflex course requires faculty to quickly generate several reports and to update these reports rapidly when the authorities adjust the rules, students…

With the increasing use of automated scores in operational testing settings comes the need to understand the ways in which they can yield biased and unfair results. In this paper, we provide a brief survey of some of the ways in which the predictive methods used in automated scoring can lead to biased, and thus unfair automated scores. After…

We describe an automated assessment process for team-coding assignments based on DevOps best practices. This system and methodology includes the definition of Team Performance Metrics measuring properties of the software developed by each team, and their correct use of DevOps techniques. It tracks the progress on each of metric by each group. The…

We discuss transforming STEM education using three aspects: learning progressions (LPs), constructed response performance assessments, and artificial intelligence (AI). Using LPs to inform instruction, curriculum, and assessment design helps foster students' ability to apply content and practices to explain phenomena, which reflects deeper science…

We consider the reference-based approach for Automatic Short Answer Grading (ASAG) that involves scoring a textual constructed student answer comparing to a teacher-provided reference answer. The reference answer does not cover the variety of student answers as it contains only specific examples of correct answers. Considering other language…

Much has been written about how to improve the fairness of AI tools for decision-making but less has been said about how to approach this new field from the perspective of philosophy of education. My goal in this paper is to bring together criteria from the general algorithmic fairness literature with prominent values of justice defended by…

Objective: This paper describes several automation tools and software that can be considered during evidence synthesis projects and provides guidance for their integration in the conduct of scoping reviews. Study Design and Setting: The guidance presented in this work is adapted from the results of a scoping review and consultations with the JBI…

The use of automated decision-making systems is increasing in education. While the potential impacts of ADM are becoming widely known amongst experts, the perspectives of those impacted by ADM remain peripheral. To broaden expertise and participation, this paper proposes that ADM needs to be considered as a sociotechnical controversy, as part of a…

Large parts of the enterprise resource planning (ERP) processes are automated. One example is the item values in the sales order process. To execute a sales order, the ERP system applies a specific "find" strategy on a wide variety of data sources such as customer master, material master, and customer price-specific data tables, and…

Quality control and assurance plays a fundamental role within higher education contexts. One means by which quality control can be performed is by mapping the course learning outcomes (CLOs) to the program learning outcomes (PLO). This paper describes a system by which this mapping process can be automated and validated. The proposed AI-based…