For assessment professionals who are also automated scoring (AS) professionals, there is no single set of standards of best practice. This paper reviews the assessment and AS literature to identify key standards of best practice and ethical behavior for AS professionals and codifies those standards in a single resource. Having a unified set of AS…

This study tested whether executive functioning (EF)/learning tasks from the CogState computerized test battery show a unitary latent structure. This information is important for the construction of composite measures on these tasks for applied research purposes. Based on earlier factor analytic research, we identified five CogState tasks that…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

Purpose: To build adaptive learning systems for a better learning experience, designers need to identify users' behaviour patterns and provide adaptive learning materials accordingly. This study involved a quasi-experiment and also this paper aims to investigate the accuracy of eye-tracking technology in identifying visualisers and verbalisers and…

Graduates are entering a sociotechnological world, with teaching and assessment needing to reflect that, by shifting from a 'recall-on-paper' to 'do-it-for-real'. With increasing student numbers, it is not feasible to have staff-student ratios and round-the-clock availability required to provide instant feedback and ever-more interactive teaching…

The COVID-19 pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has disrupted normal activities all over the world. Education at all levels has been particularly hard hit, and this has resulted in the suspension of face-to-face discourse, instruction, and student assessment worldwide, with the necessity of social…

Disengaged test taking tends to be most prevalent with low-stakes tests. This has led to questions about the validity of aggregated scores from large-scale international assessments such as PISA and TIMSS, as previous research has found a meaningful correlation between the mean engagement and mean performance of countries. The current study, using…

The Physical Activity Neighborhood Environment Scale (PANES) has been used internationally; however, PANES properties have not been assessed in all geographical contexts. Our objectives were to assess the reliability and validity of an online and paper version of the PANES in Canadian adults. Reliability was estimated using intraclass correlation…

Online learning has grown in popularity, leading to more widespread utilization of online exams. Online exams have started to become a preferred method of assessment in both online and traditional learning environments. They provide various benefits for the learning process and learners when used appropriately within online learning programs. The…

How can state-of-the-art computational linguistic technology reduce the workload and increase the efficiency of language teachers? To address this question, we combine insights from research in second language acquisition and computational linguistics to automatically generate text-based questions to a given text. The questions are designed to…

In the swiftly evolving landscape of education, the fusion of Artificial Intelligence's ingenuity with the dynamic capabilities of chat-bot technology has ignited a transformative paradigm shift. This convergence is not merely a technological integration but a profound reshaping of the fundamental principles of pedagogy, fundamentally redefining…

The recent interests in research in the assessment field have been rapidly shifting from decision-maker-centered assessments to learner-centered assessments (i.e., diagnostic and/or formative assessments). In particular, it is a very important research topic in this field to analyze how these learner-centered assessments are developed more…

The clinical assessment of mental disorders can be a time-consuming and error-prone procedure, consisting of a sequence of diagnostic hypothesis formulation and testing aimed at restricting the set of plausible diagnoses for the patient. In this article, we propose a novel computerized system for the adaptive testing of psychological disorders.…

Exams assessment is one of the most tedious work for university teachers all over the world. Multiple choice theses make exams assessment a little bit easier, but the teacher cannot prepare more than 3-4 variants; in this case, the possibility of students for cheating from one another becomes a risk for "objective assessment outcome." On…

Written instructions seldom need to be read when playing videogames. Instead, gaming often involves early information foraging and expansive exploration behaviors. We use data from the Programme for International Student Assessment (PISA) to explore whether students who regularly play videogames (daily gamers) adopt behaviors that are typical of…