Partially automated assessment is implemented via the 'Printable worksheet' mode in the Numbas e-assessment system to create a mathematical modelling worksheet which is individualised with random parameters but completed and marked as if it were a non-automated piece of coursework, preserving validity while reducing the risk of academic misconduct…

The template-based automated item-generation (TAIG) approach that involves template creation, item generation, item selection, field-testing, and evaluation has more steps than the traditional item development method. Consequentially, there is more margin for error in this process, and any template errors can be cascaded to the generated items.…

This article offers a historical inquiry into behaviorism and its impact on standard of judgement concerning education policies. Drawing from Aldous Huxley's reservation towards behaviorism as a scientific movement that naturalizes the role of control in human affairs, the paper maps the impact of behaviorism on economics of education. By tracing…

In contemporary societies, the processes of transindividuation by which knowledges are transformed into cycles and rhythms of metastability have been dramatically short-circuited. In turn, this has provoked the spiritual misery and pseudo-fabulations so prevalent all around us, including our educational contexts. For Stiegler, this is nothing…

In 2017, "Robot-Proof," the first edition, foresaw the advent of the AI economy and called for a new model of higher education designed to help human beings flourish alongside smart machines. That economy has arrived. Creative tasks that, seven years ago, seemed resistant to automation can now be performed with a simple prompt. As a…

In this article, we systematize the factors influencing performance and feasibility of automatic content scoring methods for short text responses. We argue that performance (i.e., how well an automatic system agrees with human judgments) mainly depends on the linguistic variance seen in the responses and that this variance is indirectly influenced…

The COVID-19 pandemic has forced the rapid adoption of remote teaching modalities including "hyflex" where students attend some class sessions in person and some online. Managing the hyflex course requires faculty to quickly generate several reports and to update these reports rapidly when the authorities adjust the rules, students…

With the increasing use of automated scores in operational testing settings comes the need to understand the ways in which they can yield biased and unfair results. In this paper, we provide a brief survey of some of the ways in which the predictive methods used in automated scoring can lead to biased, and thus unfair automated scores. After…

We describe an automated assessment process for team-coding assignments based on DevOps best practices. This system and methodology includes the definition of Team Performance Metrics measuring properties of the software developed by each team, and their correct use of DevOps techniques. It tracks the progress on each of metric by each group. The…

We discuss transforming STEM education using three aspects: learning progressions (LPs), constructed response performance assessments, and artificial intelligence (AI). Using LPs to inform instruction, curriculum, and assessment design helps foster students' ability to apply content and practices to explain phenomena, which reflects deeper science…

We consider the reference-based approach for Automatic Short Answer Grading (ASAG) that involves scoring a textual constructed student answer comparing to a teacher-provided reference answer. The reference answer does not cover the variety of student answers as it contains only specific examples of correct answers. Considering other language…

Direct assessments of early childhood development (ECD) are a cornerstone of research in developmental psychology and are increasingly used to evaluate programs and policies in lower- and middle-income countries. Despite strong psychometric properties, these assessments are too expensive and time consuming for use in large-scale monitoring or…

Objective: This paper describes several automation tools and software that can be considered during evidence synthesis projects and provides guidance for their integration in the conduct of scoping reviews. Study Design and Setting: The guidance presented in this work is adapted from the results of a scoping review and consultations with the JBI…

This resource is a quick primer on AI, with examples of what the different programs can generate based on user prompts, challenges and opportunities, discussion of implications and our recommendations for higher education institutions.

The use of automated decision-making systems is increasing in education. While the potential impacts of ADM are becoming widely known amongst experts, the perspectives of those impacted by ADM remain peripheral. To broaden expertise and participation, this paper proposes that ADM needs to be considered as a sociotechnical controversy, as part of a…