Assessment and institutional research offices have too much data and too little time. Standard reporting often crowds out opportunities for innovative research. Fortunately, advancements in data science now offer a clear solution. It is equal parts technique and philosophy. The first and easiest step is to modernize data work. This column…

This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received…

This article describes the 2022 "ITC/ATP Guidelines for Technology-Based Assessment" (TBA), a collaborative effort by the International Test Commission (ITC) and the Association of Test Publishers (ATP) to address digital assessment challenges. Developed by over 100 global experts, these "Guidelines" emphasize fairness,…

Clicker-integrated instruction is the current innovation in teaching and learning. Several studies used this technology to investigate learning processes, while others mainly used it to asses for learning, facilitation of group discussion and students' participation. All applications require creativity and analytical thinking and very much…

Manual composition of tasks and exams is a challenging and time-consuming task. Especially when exams are taken remotely without the personal monitoring by examiners, most exams can easily lose their integrity with the use of previously done exercises or student communication. This research introduces an approach that incorporates the principles…

No solution can ultimately eliminate cheating in online courses. However, universities reserve funding for authentication systems to minimize the threat of cheating in online courses. Most higher education institutions use a combination of authentication methods to secure systems against impersonation attacks during online examinations.…

Recent developments in computerized scoring via semantic distance have provided automated assessments of verbal creativity. Here, we extend past work, applying computational linguistic approaches to characterize salient features of creative text. We hypothesize that, in addition to semantic diversity, the degree to which a story includes…

Multiple-choice questions (MCQs) are widely used in digital learning systems, as they allow for automating the assessment process. However, owing to the increased digital literacy of students and the advent of social media platforms, MCQ tests are widely shared online, and teachers are continuously challenged to create new questions, which is an…

Online learning has grown due to the advancement of technology and flexibility. Online examinations measure students' knowledge and skills. Traditional question papers include inconsistent difficulty levels, arbitrary question allocations, and poor grading. The suggested model calibrates question paper difficulty based on student performance to…

This study targets to investigate the opinions and perceptions of the online and distance learners regarding to online proctored exams. A qualitative case study was employed to explore views of the participants related to the online proctored exam practice. The data were collected from 69 undergraduate distance learners via an online form. A…

Online learning has provided pathways for access to flexible educational experiences, but can also feel isolating and impersonal, lacking authentic relationships with instructors and peers. Centering the discussion of humanizing distance education through the lens of three core pedagogical components of teaching and learning (i.e., instruction,…

ETS experts are exploring and defining the standards for responsible AI use in assessments. A comprehensive framework and principles will be unveiled in the coming months. In the meantime, this document outlines the critical areas these standards will encompass, including the principles of: (1) Fairness and bias mitigation; (2) Privacy and…

This study investigated the impact of scoring polytomous items later on measurement precision, classification accuracy, and test security in mixed-format adaptive testing. Utilizing the shadow test approach, a simulation study was conducted across various test designs, lengths, number and location of polytomous item. Results showed that while…

Purpose: This study aims to develop a model for readiness measurement and to study readiness levels for online testing of undergraduate students in Thailand's distance education programs. Design/methodology/approach: In total, 870 undergraduate students enrolled in the 2022 academic year of a Thai university were sampled for the study. The samples…

This paper first analyzed the shortcomings of the summative final exam methods which focuses only on final exams. Then, we showed the specific implementation of the quantitative formative assessment which includes objective results and subjective scores. Objective results include the traditional written chapter test score, online mid-term and…