Computer-based testing (CBT) is becoming an increasingly popular format of assessment in educational settings. If students face a digital divide in terms of access to computers at school and at home, CBT may exacerbate measured student achievement gaps. In this paper, we use the rollout of CBT in South Carolina starting in 2015 to investigate its…

To improve the calibration accuracy and calibration efficiency of cognitive diagnostic computerized adaptive testing (CD-CAT) for new items and, ultimately, contribute to the widespread application of CD-CAT in practice, the current article proposed a Gini-based online calibration method that can simultaneously calibrate the Q-matrix and item…

The article deals with the results of mathematics examinations at the University of Finance and Administration in Prague before, during, and immediately after the COVID-19 pandemic-related restrictions. The first objective is to evaluate whether the non-standard forms of testing (correspondence and online), used on an emergency basis during the…

The digital transformation of education is greatly accelerating in various computer-supported applications. As a particularly prominent application of the human-machine interactive system, intelligent learning systems aim to capture users' current intentions and provide recommendations through real-time feedback. However, we have a limited…

The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the COVID-19 pandemic. We believe the testing mode effect consists of four components: the ability to physically write on the test, the method of answer recording, the proctoring/testing environment, and the effect…

Extended time is frequently recommended for students with disabilities (SWD) with an intent to remove barriers to accurate measurement of their underlying knowledge and skills. However, empirical findings have varied in terms of whether extended time conditions are an appropriate method for doing so, raising questions of whether frequent…

ALEKS is an adaptive learning and assessment system, with courses covering subjects such as math, chemistry, and statistics. In this work, we focus on the ALEKS math courses, which cover a wide range of content starting at second grade math and continuing through college-level precalculus. To help instructors and students navigate this content,…

Fit indices are descriptive measures that can help evaluate how well a confirmatory factor analysis (CFA) model fits a researcher's data. In multigroup models, before between-group comparisons are made, fit indices may be used to evaluate measurement invariance by assessing the degree to which multiple groups' data are consistent with increasingly…

In Spring 2020, the need for redesigning online assessments to preserve integrity became a priority to many educators. Many of us found methods to proctor examinations using Zoom and proctoring software. Such examinations pose their own issues. To reduce the technical difficulties and cost, many Zoom proctored examination sessions were shortened;…

The rising use of technology in classrooms has also brought with it a concomitant wave of computer-based assessments. The argument for computer-based testing is often framed in terms of efficiency and data management: computer-based tests facilitate more efficient processing of test data and the rate at which feedback can be leveraged for student…

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

As a result of the increase in online course offerings at colleges and universities, the prevalence of online and computerized examinations has increased over the last two decades. Beyond academia, online examinations have been used to assess competence for certifications by both governments and private firms. Despite this importance, a randomized…

The present study compared the diagnostic accuracy of a single computer adaptive test (CAT), Star Reading or Star Math, and a combination of the two in a gated screening framework to predict end-of-year proficiency in reading and math. Participants included 13,009 students in Grades 3-8 who had at least one fall screening score and end-of-year…

Secondary students with disabilities are given accommodations to support deficits they have in learning and/or behavior. Higher levels of test anxiety within this population are a factor often unaddressed by administrators. The physical environment in which students with disabilities take tests influences their ability to achieve maximum…

Recent years have produced a surge in interest in improving state assessment programs. Many states are designing new assessments. Much of this innovation is aimed at addressing longstanding areas of unhappiness with typical domain-sampled, end-of-year state assessments: States want to streamline assessment activities, enhance the instructional…