The integration of generative artificial intelligence (GAI) into educational settings offers unprecedented opportunities to enhance the efficiency of teaching and the effectiveness of learning, particularly within online platforms. This study evaluates the development and application of a customized GAI-powered teaching assistant, trained…

Objective: The Conners Continuous Performance Test-3 (CCPT-3) is a computerized test of attention frequently used in clinical neuropsychology. In the present factor analysis, we seek to assess the factor structure of the CCPT-3 and evaluate the suggested dimensions in the CCPT-3 Manual. Method: Data from a mixed clinical sample of 931 adults…

Background/purpose: Artificial Intelligence (AI) is increasingly shaping assessment practices in higher education, promising faster feedback and reduced instructor workload while also raising concerns about fairness and transparency. This study examines how AI technologies are transforming assessment processes and the experiences of stakeholders.…

In recent years, the application of explainability techniques to automated essay scoring and automated short-answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates…

Transparency in high-stakes English language assessment has become crucial for ensuring fairness and maintaining assessment validity in language testing. However, our understanding of how transparency is conceptualised and implemented remains fragmented, particularly in relation to stakeholder experiences and technological innovations. This study…

This study incorporates a random forest (RF) approach to probe complex interactions and nonlinearity among predictors into an item response model with the goal of using a hybrid approach to outperform either an RF or explanatory item response model (EIRM) only in explaining item responses. In the specified model, called EIRM-RF, predicted values…

This conceptual study explores and proposes strategies for enhancing security and academic integrity within the Open and Distance e-learning (ODeL) context, adhering to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocols. As higher education continues to evolve, the reliance on online assessments has become more…

Artificial intelligence (AI) tools like ChatGPT offer new opportunities to enhance student learning through active recall and self-directed inquiry. This study aimed to determine student perceptions of a classroom assignment designed to develop proficiency in using ChatGPT for these strategies. First-semester Doctor of Pharmacy students in a…

Traditional item analyses such as classical test theory (CTT) use exam-taker responses to assessment items to approximate their difficulty and discrimination. The increased adoption by educational institutions of electronic assessment platforms (EAPs) provides new avenues for assessment analytics by capturing detailed logs of an exam-taker's…

Traditionally, researchers employ human raters for scoring responses to creative thinking tasks. Apart from the associated costs this approach entails two potential risks. First, human raters can be subjective in their scoring behavior (inter-rater-variance). Second, individual raters are prone to inconsistent scoring patterns…

The purpose of this study was to compare calibration and linking methods for placing pretest item parameter estimates on the item pool scale in a 1-3 computerized multistage adaptive testing design in terms of item parameter recovery. Two models were used: embedded-section, in which pretest items were administered within a separate module, and…

Online calibration is a key technology for item calibration in computerized adaptive testing (CAT) and has been widely used in various forms of CAT, including unidimensional CAT, multidimensional CAT (MCAT), CAT with polytomously scored items, and cognitive diagnostic CAT. However, as multidimensional and polytomous assessment data become more…

Computer-based testing (CBT) is becoming an increasingly popular format of assessment in educational settings. If students face a digital divide in terms of access to computers at school and at home, CBT may exacerbate measured student achievement gaps. In this paper, we use the rollout of CBT in South Carolina starting in 2015 to investigate its…

To improve the calibration accuracy and calibration efficiency of cognitive diagnostic computerized adaptive testing (CD-CAT) for new items and, ultimately, contribute to the widespread application of CD-CAT in practice, the current article proposed a Gini-based online calibration method that can simultaneously calibrate the Q-matrix and item…

As universities moved to remotely taught courses during the COVID-19 pandemic, the importance of maintaining academic integrity in online environments intensified. In response, this study explores instructors' perceptions about the role of online proctoring as a tool for their courses with the intent of enhancing the understanding of online…