Automated Essay Scoring (AES) tools aim to improve the efficiency and consistency of essay scoring by using machine learning algorithms. In the existing research work on this topic, most researchers agree that human-automated score agreement remains the benchmark for assessing the accuracy of machine-generated scores. To measure the performance of…

The COVID-19 pandemic has had a significant impact on high-stakes testing, including the national benchmark tests in South Africa. Current linear testing formats have been criticized for their limitations, leading to a shift towards Computerized Adaptive Testing [CAT]. Assessments with CAT are more precise and take less time. Evaluation of CAT…

The aim of the study was to develop a cost-effective form of online proctoring mechanism that can serve as a scalable and secure solution to cater to high-stake assessments in institutions, with a particular focus on attaining high levels of flexibility and user-friendliness. With reference to existing systems, a self-proctored mechanism is…

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the…

This research study focuses on the growing concern of academic misconduct in distance education courses. A quasi-experimental study was conducted to measure the impact of introducing webcam recording software as an online supervision tool for high-stakes exams in two separate online courses (Management and Accounting). Results revealed that…

This paper compares and analyzes a selection of popular multilevel tests used for quick accreditation of English as a foreign language worldwide. The paper begins by stating the current need of accreditation of English language competence for both academic and professional matters. It then looks at their defining features and differences. After,…

As online programs at conventional universities continue to expand, administrators and faculty face new challenges. Academic dishonesty is nothing new, but an online testing environment requires different strategies and tactics from what we have had to consider in the past. Our university has recently adapted successful face-to-face programs in…

In the listening component of the IELTS examination candidates hear the input once, delivered at "normal" speed. This format for listening can be problematic for test takers who often perceive normal speed input to be too fast for effective comprehension. The study reported here investigated whether using computer software to slow down…

This brief research report gives an overview of a visually based methodology that has recently been used to shed light on situated decision-making in a high stakes educational assessment environment. Looking carefully at the feedback interactions taking place between senior and less senior examiners, the project aim was to gain insight into the…

As the use of mobile learning educational applications has become more common anywhere in the world, new concerns have appeared in the classroom, human interaction in software engineering and ergonomics. new tests of foreign languages for a number of purposes have become more and more common recently. However, studies interrelating language tests…

An applied Information Technology (IT) course that is assessed using pen and paper may sound incongruous but it is symptomatic of the state of high-stakes assessment in jurisdictions such as Western Australia. Whereas technology has permeated most aspects of modern life, including schooling, and more has been demanded of education systems in terms…

This document reviews several theoretical frameworks of problem-solving, provides a definition of the construct, suggests ways of measuring the construct, focuses on issues for assessment, and provides specifications for the computer-based assessment of problem solving. As defined in the model of the Center for Research on Evaluation, Standards,…

Automated Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written prose (Shermis & Barrera, 2002; Shermis & Burstein, 2003; Shermis, Raymat, & Barrera, 2003). AES systems are mainly used to overcome time, cost, reliability, and generalizability issues in writing assessment (Bereiter, 2003; Burstein,…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…