Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

This study explored the effectiveness of extended time (ET) accommodations in the 2017 NAEP Grade 8 Mathematics assessment to enhance educational equity. Analyzing NAEP process data through an XGBoost model, we examined if early interactions with assessment items could predict students' likelihood of requiring ET by identifying those who received…

Over the last 20 years, many methods have been proposed to use process data (e.g., response time) to detect changes in engagement during the test-taking process. However, many of these methods were developed and evaluated in highly similar testing contexts: 30 or more single-select multiple-choice items presented in a linear, fixed sequence in…

In recent decades, the potential benefits of introducing technologies into large-scale tests have been much discussed. Yet the path to effective technology use on large-scale testing has fallen short of expectations, especially when these tests have medium or high stakes for students. After a temporary cancelation of external assessment of…

The COVID-19 pandemic has had a significant impact on high-stakes testing, including the national benchmark tests in South Africa. Current linear testing formats have been criticized for their limitations, leading to a shift towards Computerized Adaptive Testing [CAT]. Assessments with CAT are more precise and take less time. Evaluation of CAT…

This convergent mixed-methods study investigated Australian teachers' perspectives on the computing competencies required for online National Assessment Program -- Literacy and Numeracy (NAPLAN). A total of 107 teachers completed surveys examining how socio-educational backgrounds and classroom practices shape students' readiness for high-stakes…

This study investigates the time-use patterns of students with learning disabilities during digital mathematics assessments and explores the role of extended time accommodations (ETA) in shaping these patterns. Using latent profile analysis, four distinct time-use profiles were identified separately for students with and without ETA. "Initial…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

This research aims to describe national examination based on CBT methods that looked at human resources, infrastructures, students, strategies, and national examination weakness based on CBT implementation at Vocational School 1 North Sangatta. This research is a descriptive study with a qualitative approach. Data collection techniques can be done…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Process Analysis is an emerging approach to discover meaningful knowledge from temporal educational data. The study presented in this paper shows how we used Process Analysis methods on the National Assessment of Educational Progress (NAEP) test data for modeling and predicting student test-taking behavior. Our process-oriented data exploration…

This study provides an initial statistical approach as an alternative model to detect the fraudulent practice estimation of national examination (NE). Trends, patterns, and relationships were analysed from the national examination (NE) scores and the national examination integrity index (NEII) on pre-and post-computer-based national examination…

In 2018, the National Center for Education Statistics (NCES) administered two assessments--the National Assessment of Educational Progress (NAEP) Technology and Engineering Literacy (TEL) assessment and the International Computer and Information Literacy Study (ICILS)--to two separate nationally representative samples of 8th-grade students in the…

This study investigates the relationship between text-to-speech (TTS) usage and item-by-item performance in the 2017 eighth-grade National Assessment of Educational Progress (NAEP) math assessment, focusing on students with disabilities (SWDs), English language learners (ELLs), and their general education (GE) peers. Results indicate that all…

The aim of this paper is to describe, analyze, and discuss how Swedish schools and the national tests in schools, university teaching and examination, and the college admissions test, Swedish Scholastic Aptitude Test (SweSAT), have been affected by the COVID-19 situation. A further aim is to discuss the challenges in schools, universities and in…