The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

We present this brief reflection on key aspects of the 2030 Agenda for Sustainable Development and the implications of the worldwide focus on achieving the sustainable development goals as external observers of the evaluation endeavor around the world. We have conducted and participated in evaluations, but it is not our primary field of work and…

The Region 5 Comprehensive Center (R5CC) developed the Education Agency State of Readiness Assessment Tool to assess the readiness of State education agencies (SEA) to take on capacity-building projects. The indicators are adapted from the NECTAC Technical Assistance Model for Long-Term Systems Change and are based on years of developing and…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Using social constructivist theories of adult learning, the Faculty Pedagogical Development (PD) Programme was designed to offer faculty a unique professional learning experience at one university in Qatar. This study reports on the evaluation of this PD programme that involved 24 participants from different colleges in its first round of…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

Distance learning technology continues to grow and undergo significant changes in higher education settings. Applying strategic planning methods from organizational behavior and operations management can act as a useful guide for the implementation of a sustainable distance learning program. Strong planning can help ensure the distance learning…

Evaluators are becoming increasingly aware that, to provide maximum benefit to the programs they evaluate, they must address the systems within which the programs work. However, evaluation practice is often influenced by beliefs and assumptions that are rooted in an understanding of these systems as stable and predictable. We identify four traps…

The Region 15 Comprehensive Center (R15CC) is federally funded to provide high-impact, customized, and responsive capacity-building technical assistance to state educational agencies (SEAs) in Arizona, California, Nevada, and Utah. In 2022, R15CC established a regional Family and Community Engagement (FACE) Collaborative for SEA leaders in…

Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a…

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and…

Educational developers need to assess the work of their Centres, from program participation and impact to underlying organizational processes. Various frameworks exist, but developers may feel unsure how to get started. We developed a planning model that offers a structured, systematic approach for developing comprehensive assessment systems that…