NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1482832
Record Type: Journal
Publication Date: 2025
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2148-7456
Available Date: 0000-00-00
Detection of Aberrant Testing Behaviour in Unproctored CAT via a Verification Test
International Journal of Assessment Tools in Education, v12 n3 p681-700 2025
Unproctored Computerized Adaptive Testing (CAT) is gaining traction due to its convenience, flexibility, and scalability, particularly in high-stakes assessments. However, the lack of proctor can give rise to aberrant testing behavior. These behaviors can impair the validity of test scores. This paper explores the use of a verification test to detect aberrant testing behavior in unproctored CAT environments. This study aims to use multiple measures to detect aberrant response patterns in CAT via a paper-and-pencil (P&P) test as well as to compare the sensitivity and specificity performances of the [log-likelihood subscript z] person-fit statistic (PFS) using no-stage and two-stage ([log-likelihood subscript z] is used after the Kullback-Leibler divergence (KLD) measure) methods in different conditions. Three factors were manipulated -- the aberrance percentage, the aberrance scenario, and the aberrant examinee's ability range. The study found that in all scenarios, the specificity performance of [log-likelihood subscript z] in classifying examinees was higher than its sensitivity performance in no-stage and two-stage analyses. However, the sensitivity performance of [log-likelihood subscript z] was higher in two-stage analysis.
International Journal of Assessment Tools in Education. Pamukkale University, Faculty of Education, Kinikli Campus, Denizli 20070, Turkey. e-mail: ijate.editor@gmail.com; Web site: https://dergipark.org.tr/en/pub/ijate
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A