The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

In this Point of Departure, the idea of authentic assessment is examined and troubled by drawing on Derrida's hauntology. The spectres of higher education invite us to reconsider what is 'real' about past, present, and future assessment practices. Such spectres do not lecture or produce a single, definitive interpretation. Rather, these spectres…

Mokken Scale Analysis (MSA) is a nonparametric approach that offers exploratory tools for understanding the nature of item responses while emphasizing invariance requirements. MSA is often discussed as it relates to Rasch measurement theory, which also emphasizes invariance, but uses parametric models. Researchers who have compared and combined…

While traditional assessment models effectively evaluate student learning objectives within the classroom, they often fail to capture the extent to which students practice civic engagement, critical inquiry, and global citizenship following graduation. As educators, we often do not know whether students employ these concepts and embrace these…

Metrics, outcomes, and assessment are important, yet often forgotten, elements of effective leadership programs. This article will provide an overview of metrics, outcomes, and assessment in regard to leadership programs. The article will then provide example programs and practical guidance on using metrics, outcomes, and assessment in leadership…

Assessments in higher education healthcare programmes can be challenging because they not only need to be fair, valid, and transparent, but it is also necessary to gauge safety, practical skill competence, and professionalism. One way to help maximise validity in practical assessments is to utilise 'standard setting' which aims to set a fair 'cut…

Digital literacy skills are essential for success in today's social, academic, and professional environments. This paper introduces a digital literacy framework, outlining key subskills and skill indicators for high school students, grounded in prior research and K-12 educational standards. We examine the implementation of digital literacy…

Advanced practices for summative exam development and post-exam analysis are proven to be effective but aren't always practical, and, even when these are applied to some degree, exams remain inherently imperfect measures of student ability. Instructors may thus deem it necessary to adjust overall exam scores to account for aspects of an exam that…

Sensitivity analyses encompass a broad set of post-analytic techniques that are characterized as measuring the potential impact of any factor that has an effect on some output variables of a model. This research focuses on the utility of the simulated annealing algorithm to automatically identify path configurations and parameter values of omitted…

A systematic review did not show any usability evaluation tool specifically developed for blind people. This paper reports an empirical study, investigating the similarity between usability evaluation tools for people with visual impairment. A total of 87 blind people from both genders, equally distributed, from 18 to 75 years old, with congenital…

This study aimed to assess the methods and outcomes of The Measurement Tool to Assess systematic Reviews (AMSTAR) 2 appraisals in overviews of reviews (overviews) of interventions in the cardiovascular field and identify factors that are associated with these outcomes. MEDLINE, Scopus, and the Cochrane Database of Systematic Reviews were searched…

This study tests a handwriting model for children and youth with Autism Spectrum Disorder (ASD) that displays the relationships between handwriting process and product characteristics, and the predictors of these characteristics. Structural Equation Modelling was used to test the model for children and youth with ASD (n = 50) and typically…

Learning progressions (LPs) are cognitive models that describe the development of scientific knowledge and practices in students. They are constructed based on learning theories and student data. Scholars have advocated for using LPs to align curriculum, instruction, and assessment into a coherent system, and by doing so, promote productive…

Developing immersive learning systems is challenging due to their multidisciplinary nature, involving game design, pedagogical modelling, computer science, and the application domain. The diversity of technologies, practices, and interventions makes it hard to explore solutions systematically. A new methodology called Multimodal Immersive Learning…

The application of network meta-analysis is becoming increasingly widespread, and for a successful implementation, it requires that the direct comparison result and the indirect comparison result should be consistent. Because of this, a proper detection of inconsistency is often a key issue in network meta-analysis as whether the results can be…