Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

Computer-based assessment (CBA) is a top-rated tool for conducting assessments, mapping learning outcomes, and selecting new candidates. Research that examines the development and use of CBA is also increasing from year to year, so without bibliometric analysis, it would be quite challenging to keep up with all of these studies. This study aims to…

The current qualitative and quantitative study methods intend to investigate the quality of electronic examinations and the obstacles of changing the examinations' process from the participants' experiences and perspectives. The study generates feedback to enhance the adoption and improvement of the e. examination process. Due to the COVID-19…

Purpose: Fabricated data jeopardize the reliability of large-scale population surveys and reduce the comparability of such efforts by destroying the linkage between data and measurement constructs. Such data result in the loss of comparability across participating countries and, in the case of cyclical surveys, between past and present surveys.…

The challenging of assessing formal and informal online learning at scale includes various issues. Many universities who are now promoting "Massive Online Open Courses" (MOOC), for instance, focus on relatively informal assessment of participant competence, which is not highly "quality assured". This paper reports best…

In computerized adaptive testing, updating item parameter estimates using adaptive testing data is often called online calibration. This study investigated how to evaluate whether the adaptive testing data used for online calibration sufficiently fit the item response model used. Three approaches were investigated, based on a Lagrange multiplier…