The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a…

Pressing social problems and inequities call attention to the need for interventions that target root causes and change systems. A significant challenge facing system change efforts is the lack of systems-based evaluation theory and methods. To address this challenge, we conducted an instrumental case study of evaluation within an exemplary…

Many geoscience education initiatives now involve cross-departmental or multi-institutional programs. However, the geoscientists who lead such programs typically have little experience or training in program design, leadership, or evaluation. In this commentary, we make the case that geoscientists taking on these ambitious leadership roles can…

The use of explicit programme theory to guide evaluation is widely recommended. However, practitioners and other partnering stakeholders often initiate programmes based on implicit theories, leaving researchers to explicate them before commencing evaluation. The current study aimed to apply a systematic method to undertake this process. We…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…

As researchers, decision-makers, and practitioners focus on continuous improvement in education, local-level change is gaining importance. Yet, many local school improvement efforts fail to be fully implemented. Even those that are fully implemented often fail to sustain improvements because the schools are embedded in systems that face multiple…

In recent years, increased focus on the effectiveness and accountability of prevention and intervention programs has led to greater government funding for the implementation and spread of evidence-based health and human service delivery models. In particular, attention has been paid to programs that require significant infrastructure investment…

States, school districts, and schools across the country are increasingly implementing multi-tier systems of support (MTSS) to improve outcomes for all students. Kansas is no exception. The Kansas MTSS is designed to improve outcomes for all students by instituting system-level change across the classroom, school, district, and state. Such…

Alcohol screening and brief intervention (SBI) is recommended for all primary care patients but is underutilized. This project trained 111 residents and faculty in 8 family medicine residencies to conduct SBI and implement SBI protocols in residency clinics, then assessed changes in self-reported importance and confidence in performing SBI and…

Increasingly, schools have been adopting comprehensive, three-tiered response to intervention (RTI) systems to support students in both academics and social behavior. But with each new systems change initiative comes separate teams, data, and training and coaching systems. Given the intensity of resources required to implement and sustain such…

The evidence-based parent training intervention known as Parent Management Training-the Oregon Model (PMTO) is one particularly well-supported treatment approach for addressing child behavioral problems. Yet, there remains a need to further examine how this intervention promotes change. The purpose of this study was to develop a grounded theory…

Review of economics, industrial psychology, financial, and human resource development (HRD) literature was used to develop a systems approach to measuring return on investment in which HRD is a subsystem within the overall organizational system. The approach isolates non-HRD impacts and demonstrates applicability of statistical and mathematical…