This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

The purpose of the present experiments was to systematically replicate Step it UP! Game interventions with adults with disabilities. Participants were divided into two competing teams, and the team with the highest step count participated in a prize drawing. Experiment 1 (N = 9) evaluated the efficacy of an extended version of the Step it UP! Game…

Inconsistent reporting of critical facets of classroom interventions and their related impact evaluations hinders the field's ability to describe and synthesize the existing evidence base. In this essay, we present a set of reporting guidelines intended to steer authors of classroom intervention studies toward providing more systematic reporting…

Background: This study analyzes the use of a text-related question strategy aimed at improving the reading comprehension and reading awareness abilities of a metacognitively trained group of students with reading comprehension difficulties. In an initial Grade 3 primary school students' assessment in the same classroom, some students were…

Engineering instructors play a crucial role in developing a positive culture in their classes. However, few studies have explored integrating teaching pedagogies to convey a culture of care and support students' mental health and well-being (MHWB) in engineering education contexts. It is critical to advance knowledge in this area considering the…

Background: Mentalising and stress regulation pose challenges for adults with mild to borderline intellectual disabilities (MBID), emphasising the importance of an intervention program. The study examined the effectiveness and social validity of the serious game 'You & I' in enhancing mentalising and stress regulation among adults with MBID.…

An extensive number of studies evaluating educational interventions are conducted and disseminated through peer-reviewed articles and conference presentations annually, but there is limited uptake of research among key stakeholders--educators and administrators (henceforth, practitioners; Farley-Ripple et al, 2018; Hollands et al., 2019; Slavin,…

Check-in/check-out (CICO) is a Tier 2 behavioral management system in the School-wide Positive Behavior Support (SWPBS) framework, which is widely used in Western schools. However, this system is not currently used in public schools in mainland China, mainly because of the large class sizes. This study redesigned CICO to facilitate its…

Data on implementation of school-based interventions adds highly valuable information to corresponding evaluation studies. Measuring implementation outcomes, such as fidelity or acceptability, provides information on how to improve current and future implementation processes. Moreover, analyzing intervention outcomes in combination with…

The current study adopted meta-analysis method to determine the effect of school readiness programs on preschool children. The researchers scanned national (i.e., Turkish) and international databases for studies conducted using experimental and quasi-experimental methods which were published between 2008 and 2022 that met this study's inclusion…

The aim of the study is to evaluate the efficiency of using the neuropsychological approach to solve the learning difficulties of schoolchildren. An empirical study summarized the evaluation of the correction program carried out using neuropsychological games and exercises with one hundred students in the second grade of the elementary school. The…

STEM-to-public science communication is recognized as an important skill, but a pedagogical framework for teaching these skills is lacking. Collaborating with safety and science communication experts, an intervention was developed in a health and safety course for chemical engineering students. Students attended three science communication…

Background: With constrained funding and increasing demand, the pressures on health and care services globally continue to grow. Given the challenges faced, it is imperative that services and interventions demonstrate cost-effectiveness, as well as patient/service-user and societal benefits, to maximize impact. Research has started to explore the…

In recent years, countries including the UK and USA have seen advancements in the use of Randomised Controlled Trials in education, progress that has not been mirrored in Ireland. Ireland does not have a strong tradition of using experimental or quasi-experimental evaluation designs for monitoring and evaluation of education policy despite…