The proliferation of large language models represents a paradigm shift in the landscape of automated essay scoring (AES) systems, fundamentally elevating their accuracy and efficacy. This study presents an extensive examination of large language models, with a particular emphasis on the transformative influence of transformer-based models, such as…

In the ever-evolving domain of higher education, the introduction of artificial intelligence (AI) marks a pivotal moment, promising to redefine the essence of academic assessment. This evolution brings with it a surge of potential to streamline and enrich assessment methodologies, yet it simultaneously ushers in a period of uncertainty and…

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate…

This paper presents a CAD (classroom assessment design) of an entry-level undergraduate computer programming course "Computer Programming I". CAD has been the product of a long experience in teaching computer programming courses including teaching "Computer Programming I" 22 times. Each semester, CAD is evaluated and modified…

Assessment is an important part of distance education (DE). As class sizes get larger and workloads increase, the IT infrastructure and processes used for DE assessments become more of an issue. Using the BS ISO/IEC 23988:2007 Standard for the use of technology in the delivery of assessments as a guide, this paper describes a rational approach to…

Revolutionary advancements have been observed in e-learning technologies though an amalgamated evaluation methodology for new generation e-learning content development tools is not available. The evaluation of educational software for online use must consider its usability and as well as its pedagogic effectiveness. This study is a first step…

This paper reports on one aspect of the Joint Information Systems Committee (JISC)-funded project "Scoping a vision of formative e-assessment", namely on cases of formative e-assessment developed iteratively with the UK education practitioner community. The project, which took place from June 2008 to January 2009, aimed to identify…

Purpose: To overcome the high manual effort of assessments for teaching personnel, e-assessment systems are used to assess students using information systems (IS). The purpose of this paper is to propose an extension of EASy, a system for e-assessment of exercises that require higher-order cognitive skills. The latest module allows assessing…

Effective and efficient measurement of the development of skill and knowledge, especially in domains of human activity that involve complex and challenging problems, is important with regard to workplace and academic performance. However, there has been little progress in the area of practical measurement and assessment, due in part to the lack of…

This research investigates the effect of a web-based model, named "Practicing, Reflecting, and Revising with Web-based Assessment and Test Analysis system (P2R-WATA) Assessment Literacy Development Model," on enhancing assessment knowledge and perspectives of secondary in-service teachers, and adopts a single group experimental research…

Many exam programs have begun to include innovative item types in their operational assessments. While innovative item types appear to have great promise for expanding measurement, there can also be genuine challenges to their successful implementation. In this paper we present a set of four activities that can be beneficially incorporated into…

Creation of multimedia (MM) could be a valuable diversification of assessment methods within non-technical modules. The apparent popularity of sites based on user-generated video content such as YouTube and also of podcasting suggests that relevant skills and interest are becoming more mainstream. Translating book learned knowledge into visual…

This article reports on the outcomes from the "e-scape Primary Scientific and Technological Understanding Assessment Project" (2009-2010), which aimed to support primary teachers in developing valid portfolio-based tasks to assess pupils' scientific and technological enquiry skills at age 11. This was part of the wider…

Harnessing student energy for the positive use of technology in the classroom requires significant change for many educators. Students today exhibit a one-click mentality when using computers in the classroom, and are frustrated when they are not provided with instant gratification. Gone are the reading and higher level thinking skills of the pen…

This article reports on selected aspects of a larger study on the use of electronic tools in the context of the management and marking of assignments. The study comprised a literature review, interviews and a review of e-tools. The article briefly summarises the findings from the literature on what comprises quality in assignment marking. The…