The world has experienced rapid changes, leading to pressing issues such as environmental degradation, social inequality, and resource depletion. As a transdisciplinary field, evaluation has emerged as a crucial tool in addressing these challenges and promoting systemic change. However, concerns have been raised regarding the field's capacity to…

This article aims to provide a systemic instrument to evaluate the functioning of higher education systems. Despite systemic instruments have had a strong impact on the management of public policy systems in fields such as health and innovation, higher education has not been widely discussed in applying this type of instrument. Herein lies the…

Evaluators are becoming increasingly aware that, to provide maximum benefit to the programs they evaluate, they must address the systems within which the programs work. However, evaluation practice is often influenced by beliefs and assumptions that are rooted in an understanding of these systems as stable and predictable. We identify four traps…

While evaluation capacity building (ECB) may hold promise for fostering evaluation, little is known about how it is operationalized within a network. This article presents initial findings from a National Science Foundation-funded research project (Complex Adaptive Systems as a Model for Network Evaluations) that used concepts from complex…

Powerful arguments have been made recently to advocate for the introduction of systems thinking in chemistry education to equip graduates to address sustainability challenges. This contribution describes systems thinking activities and an assessment tool that enables meaningful learning in first-year organic chemistry as students engage with the…

Purpose: The purpose of this paper is to evaluate the presence of systems thinking after an educational proposal on climate sustainability based on reflection and video creation. To evaluate this competency, an evaluation rubric was constructed. Design/methodology/approach: This research is a case study with a mixed approach. It was carried out…

In this article, we reflect on our experience applying a framework for evaluating systems change to an evaluation of a statewide West Virginia alliance funded by the National Science Foundation (NSF) to improve the early persistence of rural, first-generation, and other underrepresented minority science, technology, engineering, and mathematics…

The evaluation of teaching quality and practice is increasingly important in higher education and usually done via student surveys (quantitative data) alone. Much less attention is given to teachers' self-evaluations of teaching practice (qualitative data). This emphasis on quantitative over qualitative data can result in incomplete and biased…

Influence diagrams, derived from the mystery method as its learning output, represent an externalization of systems thinking and are, therefore, valid to research; so far they have not been conceptualized in the research literature for teaching systems thinking in education for sustainable development. In this study, 31 of those diagrams are…

Maturity models fill the need for a measure of overall growth in how outcomes assessment is defined and how feedback informs improvement to meet internal and external expectations at individual institutions of higher education. An exploratory qualitative study was conducted to develop an instrument, the Assessment System Maturity Matrix (ASMM), to…

Evaluation is defined by its central task of valuing--the process and product of judging the merit, worth, or significance of a policy or program. However, there are no clear-cut ways to consider values and render value judgments in evaluation practice. There remains contention in the evaluation field about whether and how to make value judgments.…

Evaluators frequently confront situations in which local programs struggle to meet the expectations and requirements specified by the external program funder. How can evaluators meaningfully evaluate programs (for both the funder and grantee) in situations in which the external program logic clashes with local complexities? This paper discusses…

Purpose: This study aims to develop a new entrepreneurial university model that will provide a comprehensive picture and explain how universities can become entrepreneurial by considering several factors, both internal and external. Design/methodology/approach: This research collected data by conducting a survey and elaborates on the judgments of…

Universities are centres of innovation and technology transfer, and they play a particularly strong role in the countries of the Association of Southeast Asian Nations (ASEAN) with developing technology programs. However, there are only a few assessment tools for evaluating a university's innovation ecosystem, and these tools are frequently…

This commentary on the special issue, entitled "Models and Tools for Systems Learning and Instruction," highlights the accomplishments of the papers in this collection. It also points to some avenues for further strengthening research on promoting systems understanding. Collectively, the papers make advances in our understanding of how…