Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

Computer-based assessment (CBA) is a top-rated tool for conducting assessments, mapping learning outcomes, and selecting new candidates. Research that examines the development and use of CBA is also increasing from year to year, so without bibliometric analysis, it would be quite challenging to keep up with all of these studies. This study aims to…

Companies purchase computer systems to make their processes more efficient through automation. Some academic medical centers (AMC) have purchased computer systems for their institutional review boards (IRB) to increase efficiency and compliance with regulations. IRB computer systems are expensive to purchase, deploy, and maintain. An AMC should…

Automated assessment is an emerging innovation in educational praxis, however its pedagogical potential is not fully utilised in Australia, particularly regarding automated essay grading. The rationale for this research is that the usage of automated assessment currently lags behind the capacity that the technology provides, thus restricting the…

As the automated scoring of constructed responses reaches operational status, the issue of monitoring the scoring process becomes a primary concern, particularly when the goal is to have automated scoring operate completely unassisted by humans. Using a vignette from the Architectural Registration Examination and data for 326 cases with both human…

Conducted survey in 32 psychiatric facilities to determine the types and sources of information used in care review in order to develop a meaningful minimum data set for quality assurance purposes. Found that the adequacy of medical record information for review and the feasibility of automating it depended on the nature of the review task.…