ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

This study explores Hong Kong higher education students' perceptions of E-assessment systems, focusing on factors shaping acceptance of E-examinations over traditional formats. Quantitative analysis of 107 respondents reveals significant positive correlations between diverse pre-exam guidance (e.g., tutorials) and key system features (e.g.,…

Example-generation tasks have been suggested as an effective way to both promote students' learning of mathematics and assess students' understanding of concepts. E-assessment offers the potential to use example-generation tasks with large groups of students, but there has been little research on this approach so far. Across two studies, we…

The launch of ChatGPT and the rapid proliferation of generative AI (GenAI) have brought transformative changes to education, particularly in the field of assessment. This has prompted a fundamental rethinking of traditional assessment practices, presenting both opportunities and challenges in evaluating student learning. While numerous studies…

Online assessments of learning, or online exams, have become increasingly widespread with the rise of distance learning. Online exams are preferred by many students and are perceived as a quick and easy tool to measure knowledge. On the contrary, some students are concerned about the possibility of cheating and technological difficulties in online…

This paper contributes to the ongoing efforts aimed at enhancing Outcome-Based Education (OBE) assessment methodologies by addressing some critical gaps and exploring new solutions. Our work focuses on two main areas: firstly, this study proposes an improved assessment method for OBE. It refines traditional approaches by classifying course…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

In recent years, the application of explainability techniques to automated essay scoring and automated short-answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates…

Automated essay scoring (AES), where natural language processing is applied to score written text, can underpin educational resources in blended and distance learning. AES performance has typically been reported in terms of correlation coefficients or agreement statistics calculated between a system and an expert human examiner. We describe the…

The systematic literature review (1) investigates whether 'serious games' provide a viable solution to the limitations posed by traditional high-stakes performance assessments and (2) aims to synthesize game design principles for the game-based performance assessment of professional competencies. In total, 56 publications were included in the…

Adaptive online learning can be realized through the evaluation of the learning process. Monitoring and supervising learners' cognitive levels and adjusting learning strategies can increasingly improve the quality of online learning. This analysis is made possible by real-time measurement of learners' cognitive levels during the online learning…

The advent of Generative AI (GAI) tools such as ChatGPT, Google Gemini, and Microsoft Copilot has significantly impacted higher education. This exploratory study investigates the current perspectives of lecturers in Human Resource Management (HRM) and Psychology on adapting assessment strategies in response to GAI developments. Through an online…

The global pandemic caused by COVID-19 has acted as a significant driver for the adoption of online educational practices, including instruction and assessment. Given the urgent need for an alternative to traditional assessment methods during the pandemic, various studies have explored this topic across different contexts to evaluate the impact,…

Artificial Intelligence (AI) based assessments are commonly used in a variety of settings including business, healthcare, policing, manufacturing, and education. In education, AI-based assessments undergird intelligent tutoring systems as well as many tools used to evaluate students and, in turn, guide learning and instruction. This chapter…

The COVID-19 pandemic put academic institutions around the world in the difficult position of suddenly having to organize many lectures and examinations over online channels only, due to students' physical access to their campus buildings being restricted. While the search for possible solutions to this problem was often challenging, this…