With the use of computerized testing, ordinary assessments can capture both answer accuracy and answer response time. For the Canadian Programme for the International Assessment of Adult Competencies (PIAAC) numeracy and literacy subtests, person ability, person speed, question difficulty, question time intensity, fluency (rate), person fluency…

Although educators are using various ways in evaluating students' learning, traditional paper pencil final exams are usually held at the end of the school year to conclude the course. During the school suspension due to the COVID-19 outbreak, this traditional approach is no longer applicable to some schools. In this article, alternative final…

Instructional coaching has been implemented in schools to improve student achievement; however, literature shows a lack of evidence of the efficacy of improving student reading achievement. The problem addressed in this study was that school districts have implemented instructional coaching to improve student reading achievement, but the…

Administering exams in large enrollment courses is challenging and systems in place for accomplishing this task were upended in the spring of 2020 when a sudden transformation to online instruction and testing occurred due to the COVID-19 pandemic. In the following year, when courses remained online, approaches to improve exam security included…

This study tested whether executive functioning (EF)/learning tasks from the CogState computerized test battery show a unitary latent structure. This information is important for the construction of composite measures on these tasks for applied research purposes. Based on earlier factor analytic research, we identified five CogState tasks that…

In this digital ITEMS module, Dr. Sue Lottridge, Amy Burkhardt, and Dr. Michelle Boyer provide an overview of automated scoring. Automated scoring is the use of computer algorithms to score unconstrained open-ended test items by mimicking human scoring. The use of automated scoring is increasing in educational assessment programs because it allows…

Purpose: To build adaptive learning systems for a better learning experience, designers need to identify users' behaviour patterns and provide adaptive learning materials accordingly. This study involved a quasi-experiment and also this paper aims to investigate the accuracy of eye-tracking technology in identifying visualisers and verbalisers and…

Graduates are entering a sociotechnological world, with teaching and assessment needing to reflect that, by shifting from a 'recall-on-paper' to 'do-it-for-real'. With increasing student numbers, it is not feasible to have staff-student ratios and round-the-clock availability required to provide instant feedback and ever-more interactive teaching…

The COVID-19 pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has disrupted normal activities all over the world. Education at all levels has been particularly hard hit, and this has resulted in the suspension of face-to-face discourse, instruction, and student assessment worldwide, with the necessity of social…

Disengaged test taking tends to be most prevalent with low-stakes tests. This has led to questions about the validity of aggregated scores from large-scale international assessments such as PISA and TIMSS, as previous research has found a meaningful correlation between the mean engagement and mean performance of countries. The current study, using…

The Physical Activity Neighborhood Environment Scale (PANES) has been used internationally; however, PANES properties have not been assessed in all geographical contexts. Our objectives were to assess the reliability and validity of an online and paper version of the PANES in Canadian adults. Reliability was estimated using intraclass correlation…

Purpose: The purpose of this study was to verify the equivalence of 2 alternate test forms with nonoverlapping content generated by an item response theory (IRT)--based computer-adaptive test (CAT). The Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996) was utilized as an item bank in a prospective, independent…

Online learning has grown in popularity, leading to more widespread utilization of online exams. Online exams have started to become a preferred method of assessment in both online and traditional learning environments. They provide various benefits for the learning process and learners when used appropriately within online learning programs. The…

How can state-of-the-art computational linguistic technology reduce the workload and increase the efficiency of language teachers? To address this question, we combine insights from research in second language acquisition and computational linguistics to automatically generate text-based questions to a given text. The questions are designed to…

The rapid shift to an online instructional mode necessitated by COVID-19 has been a formidable challenge for most institutions but particularly for those in which online learning was not widely implemented before the pandemic. Assessment has been an additional challenge, coupled with the accreditation requirements that higher educational…