Background: Recently human-centred design plays an increasing role in learning analytics, however this approach is mostly lacking in the design and evaluation of Intelligent Tutoring Systems (ITSs). A potential way to incorporate human-centred design principles in ITS development is by adopting a service design approach. Objectives: This article…

Body donation is critical to anatomy study in Australia and New Zealand. Annually, more than 10,000 students, anatomists, researchers, and clinicians access tissue donated by local consented donors through university-based body donation programs. However, little research has been published about their operations. This study sought to examine the…

Evaluators must attend to the destructive forces of racialization and racism to contribute to social transformation. Thus, evaluators are called to center culture, context, equity, and social justice during each step of the evaluation process. Here, we focus on the step(s) in which evaluators define program quality and specify evaluative lines of…

This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

The organizational change framework is a tool for understanding and facilitating organizational change and success, grounded in the principles of design thinking and the foundational leadership and organizational wellness (FLOW) model. This article dives into the components of the organizational change framework--collect the information, connect…

Higher education leaders face growing pressure to demonstrate the return on investment (ROI) of not only their institution but also each academic program offering. With increasing accountability and limited time for meaningful reflection on student learning and development, now is the time to rethink how a quasi-annual academic program review…

The development of the teaching profession is important in developing and preparing young people to face the changes of the future world. This research aims to find out the feasibility a program to enhance the competency of teacher students. The method is the synthesis of information obtained from the study of documents, concept, and theories…

Educators rarely inform function-based behavior plans with results from functional analyses. Barriers to conduct functional analyses in school settings may include lack of resources, time, and training. Trial-based functional analyses (TBFAs) may circumvent some of these barriers because they can be embedded into ongoing classroom routines,…

Background: Adoption of the Whole School, Whole Community, Whole Child (WSCC) model has been slowed by a lack of available tools to support implementation. The Wellness School Assessment Tool (WellSAT) WSCC is an online assessment tool that allows schools to evaluate the alignment of their policies with the WSCC model. This study assesses the…

Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it…

Program alignment with professional standards ensures that students gain competency-based skills that can be transferred to the workplace environment. Employers continue to place a greater value on these skills. Establishing curriculum alignment with professional standards can assist with annual program evaluations, student learning outcomes, and…

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

Evaluators often lament that the general public does not understand what we do. Yet, there is limited empirical research on what the general public does know--and think--about program evaluation. This article seeks to expand our understanding in this domain by capturing views about evaluation from a demographically representative sample of the U.S…

Purpose: The aim of this paper is to explore how the involvement of workplace teams in experimenting with changes in their work practices through short, time-boxed, experiments (STBEs) can support organizational learning. It is explored how staffs' experiences with experimental practices give rise to shared knowledge and how this is supported by…

The purpose of the present experiments was to systematically replicate Step it UP! Game interventions with adults with disabilities. Participants were divided into two competing teams, and the team with the highest step count participated in a prize drawing. Experiment 1 (N = 9) evaluated the efficacy of an extended version of the Step it UP! Game…