This article reviews how National Assessment of Educational Progress (NAEP) has come to collect and analyze data about cognitive and behavioral processes (process data) in the transition to digital assessment technologies over the past two decades. An ordered five-level structure is proposed for describing the uses of process data. The levels in…

The computer based tests are capable of putting together a lot of interactions and fascinating question types, such as simulations, online tests, and measurement of skills, rather than simply assessing by paper-pencil tests. The computerized test result has greater standardization of test administration. The aim of this study is to seek out the…

Instructors may design and implement formative assessments on technology-enhanced platforms (e.g., online quizzes) with the intention of encouraging the use of effective learning strategies like active retrieval of information and spaced practice among their students. However, when students interact with unsupervised technology-enhanced learning…

A decision of whether to move from paper-and-pencil to computer-based tests is based largely on a careful weighing of the potential benefits of a change against its costs, disadvantages, and challenges. This paper briefly discusses the trade-offs involved in making such a transition, and then focuses on a relatively unexplored benefit of…

For item selection in cognitive diagnostic computerized adaptive testing (CD-CAT), ideally, a single item selection index should be created to simultaneously regulate precision, exposure status, and attribute balancing. For this purpose, in this study, we first proposed an attribute-balanced item selection criterion, namely, the standardized…

In this study, how the length and characteristics of routing module in different panel designs affect measurement precision is examined. In the scope of the study, six different routing module length, nine different routing module characteristics, and two different panel design are handled. At the end of the study, the effects of conditions on…

Peer-grading is commonly adopted by instructors as an effective assessment method for MOOCs (Massive Open Online Courses) and SPOCs (Small Private online course). For solving the problems brought by varied skill levels and attitudes of online students, statistical models have been proposed to improve the fairness and accuracy of peer-grading.…

This work presents a study that used distributed language representations of test items to model test item difficulty. Distributed language representations are low-dimensional numeric representations of written language inspired and generated by artificial neural network architecture. The research begins with a discussion of the importance of item…

In the shift to Emergency Remote Teaching and Learning (ERT&L) during the COVID-19 pandemic, remote assessment and feedback became a major source of discontent and challenge for students and staff. This paper is a reflection and analysis of assessment practices during ERT&L, and our theorisation of the possibilities for shifts towards…

Chiang Mai Rajabhat University Test of English Proficiency (CMRU-TEP) is a required English proficiency test for all CMRU students before graduation. Despite its meticulous design, there is an opportunity for students to improve their scores through focused efforts and targeted support. This study employs an explanatory sequential mixed-methods…

With the research reported here, we specifically aim to develop application products of scientific work independence instruments through science integrated learning (SIL) for various education levels (elementary schools, junior high schools, senior high schools, and universities). The SIL model was applied in learning to determine specific…

The COVID-19 pandemic precipitated a rapid shift to virtual learning environments (VLEs) in higher education institutions (HEIs), presenting a complex array of challenges and opportunities. This study investigates the critical factors influencing faculty members' swift transition to VLEs during emergencies, focusing on a semi-government Emirati…

This study inspected how techno-competence in artificial intelligence (AI)-driven evaluations affected EFL learners' boredom, self-esteem, and writing skills. To do so, 66 Saudi Arabian male students from Saudi Arabia participated in the study. They were then split into the experimental group (EG) and the control group (CG). While the CG was…

The COVID-19 pandemic has forced higher education institutions worldwide to rapidly transition to online learning, exposing vulnerabilities and highlighting the critical need for robust ICT infrastructure. This study investigates the readiness of network universities in upper northeastern Thailand to provide education using ICT during the COVID-19…

This paper presents results of a score interpretation study for a computer adaptive mathematics assessment. The study purpose was to test the efficacy of item developers' alignment of items to Range Achievement-Level Descriptors (RALDs; Egan et al.) against the empirical achievement-level alignment of items to investigate the use of RALDs as the…