The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Although teachers' learning has been increasingly recognised as nonlinear and contextually responsive, few studies have extended these understandings to the design and evaluation of professional development. In this case study, we examine nonlinear and contextual manifestations of high school science teachers' professional learning from a complex…

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

The National Academies Global Forum on Innovations in Health Professional Education held a public workshop in November 2023. Speakers explored how health professional educators and providers with health systems science (HSS) training can prepare learners to work together within health systems, resulting in better patient care, improved population…

Although US teenage birth rates substantially decreased over the past two decades, it still remains the highest in the developed world. More innovative, community-wide initiatives are needed to combat the issue. In Oklahoma County, Oklahoma, the Central Oklahoma Teen Pregnancy Prevention Collaboration is utilizing the collective impact model to…

The Region 15 Comprehensive Center (R15CC) is federally funded to provide high-impact, customized, and responsive capacity-building technical assistance to state educational agencies (SEAs) in Arizona, California, Nevada, and Utah. In 2022, R15CC established a regional Family and Community Engagement (FACE) Collaborative for SEA leaders in…

Although many have suggested the use of games to motivate active learning, studies that evaluate the learning outcomes of games with high school students are scarce. Here, we present the evaluation of the board game "Taphonomy: Dead and Fossilized" as an active learning tool to teach fossilization and Earth systems thinking with rising…

This article examines the intersection of service-learning with complex systems theory. It is based on a research project we undertook to explore whether complex systems theory might be useful for better understanding the dynamics of service-learning practice and thus for assisting in the design, running, and evaluation of service-learning…

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and…

In this chapter, the major concepts from program planning in adult education will be applied to health professions education (HPE). Curriculum planning and program planning will be differentiated, and program development and planning will be grounded in a systems thinking approach.

We present this brief reflection on key aspects of the 2030 Agenda for Sustainable Development and the implications of the worldwide focus on achieving the sustainable development goals as external observers of the evaluation endeavor around the world. We have conducted and participated in evaluations, but it is not our primary field of work and…