The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and…

Using social constructivist theories of adult learning, the Faculty Pedagogical Development (PD) Programme was designed to offer faculty a unique professional learning experience at one university in Qatar. This study reports on the evaluation of this PD programme that involved 24 participants from different colleges in its first round of…

The System Transformation for Equitable Preschools (STEP Forward with Data) Framework was developed to help preschool systems leaders understand where in the preschool system there may be inequities in how children and families are accessing, being supported by, and experiencing the system. The Framework offers preschool systems leaders a pathway…

Distance learning technology continues to grow and undergo significant changes in higher education settings. Applying strategic planning methods from organizational behavior and operations management can act as a useful guide for the implementation of a sustainable distance learning program. Strong planning can help ensure the distance learning…

Evaluators are becoming increasingly aware that, to provide maximum benefit to the programs they evaluate, they must address the systems within which the programs work. However, evaluation practice is often influenced by beliefs and assumptions that are rooted in an understanding of these systems as stable and predictable. We identify four traps…

Although US teenage birth rates substantially decreased over the past two decades, it still remains the highest in the developed world. More innovative, community-wide initiatives are needed to combat the issue. In Oklahoma County, Oklahoma, the Central Oklahoma Teen Pregnancy Prevention Collaboration is utilizing the collective impact model to…

Although teachers' learning has been increasingly recognised as nonlinear and contextually responsive, few studies have extended these understandings to the design and evaluation of professional development. In this case study, we examine nonlinear and contextual manifestations of high school science teachers' professional learning from a complex…

From the evaluation literature related to research and innovation policy, calls have long been made for improved evaluation processes especially where projects and programmes may be evaluated from a systems perspective. Drawing on the literature of innovation systems and innovation for inclusive development (I4ID) this research proposes a…

Pressing social problems and inequities call attention to the need for interventions that target root causes and change systems. A significant challenge facing system change efforts is the lack of systems-based evaluation theory and methods. To address this challenge, we conducted an instrumental case study of evaluation within an exemplary…

This article examines the intersection of service-learning with complex systems theory. It is based on a research project we undertook to explore whether complex systems theory might be useful for better understanding the dynamics of service-learning practice and thus for assisting in the design, running, and evaluation of service-learning…

Although many have suggested the use of games to motivate active learning, studies that evaluate the learning outcomes of games with high school students are scarce. Here, we present the evaluation of the board game "Taphonomy: Dead and Fossilized" as an active learning tool to teach fossilization and Earth systems thinking with rising…

Project EQuIPD--Engaging Quality Instruction through Professional Development--sought to establish and test for efficacy a professional development model to produce highly qualified teachers in STEM practices for all children, especially for students who are in traditionally underserved schools and districts within the State of Florida. The…

The use of explicit programme theory to guide evaluation is widely recommended. However, practitioners and other partnering stakeholders often initiate programmes based on implicit theories, leaving researchers to explicate them before commencing evaluation. The current study aimed to apply a systematic method to undertake this process. We…

A review of 25 technical assistance models and frameworks was conducted to identify the core elements of technical assistance practices. The focus of analysis was on generally agreed upon technical assistance practices that were considered essential for planning, implementing and evaluating the effectiveness of technical assistance. Results…