Partially automated assessment is implemented via the 'Printable worksheet' mode in the Numbas e-assessment system to create a mathematical modelling worksheet which is individualised with random parameters but completed and marked as if it were a non-automated piece of coursework, preserving validity while reducing the risk of academic misconduct…

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and…

The Centre for Evaluation and Monitoring (CEM), based in the North of England, recently celebrated its 40th birthday. Arising from an evaluation project at Newcastle University, and a subsequent move to Durham University, it rapidly grew in scope and influence, developing a series of highly regarded school assessments. For a relatively small…

Direct assessments of early childhood development (ECD) are a cornerstone of research in developmental psychology and are increasingly used to evaluate programs and policies in lower- and middle-income countries. Despite strong psychometric properties, these assessments are too expensive and time consuming for use in large-scale monitoring or…

This article describes the 2022 "ITC/ATP Guidelines for Technology-Based Assessment" (TBA), a collaborative effort by the International Test Commission (ITC) and the Association of Test Publishers (ATP) to address digital assessment challenges. Developed by over 100 global experts, these "Guidelines" emphasize fairness,…

Online learning has provided pathways for access to flexible educational experiences, but can also feel isolating and impersonal, lacking authentic relationships with instructors and peers. Centering the discussion of humanizing distance education through the lens of three core pedagogical components of teaching and learning (i.e., instruction,…

ETS experts are exploring and defining the standards for responsible AI use in assessments. A comprehensive framework and principles will be unveiled in the coming months. In the meantime, this document outlines the critical areas these standards will encompass, including the principles of: (1) Fairness and bias mitigation; (2) Privacy and…

In this article, we adopt culturally relevant perspectives on developmental science that acknowledge and value the diversity of backgrounds and experiences of young children and their families to identify opportunities to advance the measurement of early childhood development. We focus on direct child assessments that can drive more equitable…

The field of school psychology has seen the gradual implementation of technology in day-to-day practice. The earliest computer-based technology adopted by school psychologists consisted of software programs used to score tests, run analyses for multi-tiered systems of support, and aid in tele-consultation. These tasks have one thing in common;…

Nurse educators at the undergraduate level spend significant time developing and revising exam questions. Following the exam administration, course faculty have the opportunity to complete an item analysis and question revision to improve reliability and validity. A challenge faculty face is tracking these exam changes when teaching as part of a…

Research shows responsive caregiving enhances children's brain development, with parental knowledge predicting positive behaviors and outcomes. However, knowledge varies widely across educational levels, highlighting the need for targeted interventions. Despite evidence that this knowledge can be improved, no comprehensive metric exists for…

This article describes the development and impact of a faculty development program on improving the readiness of Indonesian educators to teach online. While online learning is seen as a potential solution to increasing access to higher education in Indonesia, most higher education faculty in Indonesia lack the necessary skills to teach online…

This article provides a detailed review of the Computer-based English Listening Speaking Test (CELST) used in Guangdong, China, as part of the National Matriculation English Test (NMET) to assess students' English proficiency. The CELST measures listening and speaking skills as outlined in the "English Curriculum for Senior Middle…

Assessment makes visible what we value and reciprocally what is assessed tends to become what is taken to be of value. Building on this, it can be argued that assessment does more than measure what is present rather it 'makes up' people. This piece offers a reflective commentary some of the insights to be gained from the Research Analysis and…