ERIC Number: EJ1482832
Record Type: Journal
Publication Date: 2025
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2148-7456
Available Date: 0000-00-00
Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
International Journal of Assessment Tools in Education, v12 n3 p681-700 2025
Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis.
Descriptors: Adaptive Testing, Computer Assisted Testing, Paper and Pencil Tests, Test Validity, Audits (Verification), Cheating, Student Behavior, Scores
International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A

Peer reviewed
