This study explored the impact of the Covid-19 pandemic on the academic quality of a Foundation in Engineering programme. A Course Experience Questionnaire (CEQ) was administered before and during the pandemic to evaluate the six dimensions of academic quality--assessment, workload, teaching, academic environment, standards, and skills…

The affordances of technology-based assessments, like the objectively structured practical examination, have become an integral part of gross anatomy courses. The Department of Anatomy Faculty of Medicine at the University of Warmia and Mazury developed and introduced an application for tablet devices which has been implemented in student…

In this paper, we describe subskills of visual communication based on the skill structure outlined in the Common European Framework of Visual Literacy. We have developed this Framework further through assessing the development of subskills related to visual communication in the "produce" and "respond" domains of CEFR-VC in…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

Unlike the traditional multiple-choice (MC) format, the discrete-option multiple-choice (DOMC) format does not necessarily reveal all answer options to an examinee. The purpose of this study was to determine whether the reduced exposure of item content affects test security. We conducted an experiment in which participants were allowed to view…

Much psychological research depends on participants' diligence in filling out materials such as surveys. However, not all participants are motivated to respond attentively, which leads to unintended issues with data quality, known as careless responding. Our question is: how do different modes of data collection--paper/pencil, computer/web-based,…

With the use of computerized testing, ordinary assessments can capture both answer accuracy and answer response time. For the Canadian Programme for the International Assessment of Adult Competencies (PIAAC) numeracy and literacy subtests, person ability, person speed, question difficulty, question time intensity, fluency (rate), person fluency…

Although educators are using various ways in evaluating students' learning, traditional paper pencil final exams are usually held at the end of the school year to conclude the course. During the school suspension due to the COVID-19 outbreak, this traditional approach is no longer applicable to some schools. In this article, alternative final…

Instructional coaching has been implemented in schools to improve student achievement; however, literature shows a lack of evidence of the efficacy of improving student reading achievement. The problem addressed in this study was that school districts have implemented instructional coaching to improve student reading achievement, but the…

Administering exams in large enrollment courses is challenging and systems in place for accomplishing this task were upended in the spring of 2020 when a sudden transformation to online instruction and testing occurred due to the COVID-19 pandemic. In the following year, when courses remained online, approaches to improve exam security included…

This study tested whether executive functioning (EF)/learning tasks from the CogState computerized test battery show a unitary latent structure. This information is important for the construction of composite measures on these tasks for applied research purposes. Based on earlier factor analytic research, we identified five CogState tasks that…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

Purpose: To build adaptive learning systems for a better learning experience, designers need to identify users' behaviour patterns and provide adaptive learning materials accordingly. This study involved a quasi-experiment and also this paper aims to investigate the accuracy of eye-tracking technology in identifying visualisers and verbalisers and…

Graduates are entering a sociotechnological world, with teaching and assessment needing to reflect that, by shifting from a 'recall-on-paper' to 'do-it-for-real'. With increasing student numbers, it is not feasible to have staff-student ratios and round-the-clock availability required to provide instant feedback and ever-more interactive teaching…

The COVID-19 pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has disrupted normal activities all over the world. Education at all levels has been particularly hard hit, and this has resulted in the suspension of face-to-face discourse, instruction, and student assessment worldwide, with the necessity of social…