Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

The Region 15 Comprehensive Center (R15CC) is federally funded to provide high-impact, customized, and responsive capacity-building technical assistance to state educational agencies (SEAs) in Arizona, California, Nevada, and Utah. In 2022, R15CC established a regional Family and Community Engagement (FACE) Collaborative for SEA leaders in…

Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a…

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and…

Educational developers need to assess the work of their Centres, from program participation and impact to underlying organizational processes. Various frameworks exist, but developers may feel unsure how to get started. We developed a planning model that offers a structured, systematic approach for developing comprehensive assessment systems that…

In this article, we reflect on our experience applying a framework for evaluating systems change to an evaluation of a statewide West Virginia alliance funded by the National Science Foundation (NSF) to improve the early persistence of rural, first-generation, and other underrepresented minority science, technology, engineering, and mathematics…

Evaluators frequently confront situations in which local programs struggle to meet the expectations and requirements specified by the external program funder. How can evaluators meaningfully evaluate programs (for both the funder and grantee) in situations in which the external program logic clashes with local complexities? This paper discusses…

Policy evaluation focuses on the assessment of policy-related personal, family, and societal changes or benefits that follow as a result of the interventions, services, and supports provided to those persons to whom the policy is directed. This article describes a systematic approach to policy evaluation based on an evaluation framework and an…

The role of research in transition education has been prominent and influential. Yet too many young people with disabilities are still not experiencing outcomes aligned with their personal aspirations and priorities. Moreover, individuals with disabilities continue to experience barriers to employment, educational, economic, and other challenges…

In this chapter, the major concepts from program planning in adult education will be applied to health professions education (HPE). Curriculum planning and program planning will be differentiated, and program development and planning will be grounded in a systems thinking approach.

The Early Childhood Technical Assistance Center used a rigorous 2-year collaborative process to develop, test, and revise a conceptual framework for high-quality state early intervention (EI) and early childhood special education (ECSE) systems. The framework identifies six critical components of a state system and what constitutes quality in each…

The importance of engaging in high quality program evaluation is a generally accepted principle underscored by external pressure from funders. High quality evaluation necessarily begins with good evaluation planning. This paper outlines Evolutionary Evaluation and specifically the Systems Evaluation Protocol, an approach that emphasizes…

The evaluation of learning and teaching is one central activity through which universities monitor the fitness-for-purpose of their education provision. This paper represents the outcomes of the work carried out by the European University Association (EUA) Learning & Teaching Thematic Peer Group on "Evaluation of learning and…

This article describes a learning partnership between district or county leaders and school leaders to create a system of principal professional learning that came to life in principal learning communities across a district or multiple-district region. For more than a decade, Learning Forward has engaged with district-level leaders as learning…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…