The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

In this article, we develop and evaluate a novel system and computing platform to structure, measure, and improve student development using points. We define student development broadly as the achievement of learning to do, know, live together, and be. The system leverages individual agency, social influences, content generation and sharing,…

The current research sought to explore the utility of the Assessment for Intervention (AFI) model in bridging the gap between assessment and intervention, through the conceptual lens of Bio-Ecological Systems Theory (BEST) and Social Constructivist Theory (SCT). AFI is a five-stage assessment model that aims to provide useful and evidence-based…

The current research study utilized a case study research method to test the theory that the creativity and innovative processes are a complex adaptive system. Through qualitative interviews with renowned creators, the current study categorized the data into eight characteristics of complex adaptive systems: path dependent, systems have a history,…

Background/purpose: The purposes of this research are to develop a reliable and valid assessment tool for measuring systems thinking skills in upper primary students in Thailand and to establish a normative criterion for evaluating their systems thinking abilities based on educational standards. Materials/methods: The study followed a three-phase…

Quality Assessment Frameworks (QAFs) are standardized templates that include pre-defined criteria, open questions, or a combination to assess the quality of evaluations. They support organizations to limit risks associated with poor-quality evaluation. Qualitative research focused on four QAFs shows that five dimensions of quality are assessed…

Although mentoring interventions have helped to advance diversity, equity, and inclusion (DEI) goals within STEM fields, even the most efficacious programs can be undermined without intentional cultivation of the broader mentoring ecosystem. This study examines participants from eight campus teams that engaged in a multi-session process of…

The study of educational effectiveness has become increasingly complex. Alongside methodological advancements in the investigation and measurement of educational effectiveness, meta-analyses conducted by leading researchers have shown that the field has been suffering from a significant lack of theory or from a weak theoretical basis. The present…

This article aims to provide a systemic instrument to evaluate the functioning of higher education systems. Despite systemic instruments have had a strong impact on the management of public policy systems in fields such as health and innovation, higher education has not been widely discussed in applying this type of instrument. Herein lies the…

Evaluators are becoming increasingly aware that, to provide maximum benefit to the programs they evaluate, they must address the systems within which the programs work. However, evaluation practice is often influenced by beliefs and assumptions that are rooted in an understanding of these systems as stable and predictable. We identify four traps…

Purpose: The purpose of this paper is to evaluate the presence of systems thinking after an educational proposal on climate sustainability based on reflection and video creation. To evaluate this competency, an evaluation rubric was constructed. Design/methodology/approach: This research is a case study with a mixed approach. It was carried out…

Influence diagrams, derived from the mystery method as its learning output, represent an externalization of systems thinking and are, therefore, valid to research; so far they have not been conceptualized in the research literature for teaching systems thinking in education for sustainable development. In this study, 31 of those diagrams are…

Maturity models fill the need for a measure of overall growth in how outcomes assessment is defined and how feedback informs improvement to meet internal and external expectations at individual institutions of higher education. An exploratory qualitative study was conducted to develop an instrument, the Assessment System Maturity Matrix (ASMM), to…

Purpose: This study aims to develop a new entrepreneurial university model that will provide a comprehensive picture and explain how universities can become entrepreneurial by considering several factors, both internal and external. Design/methodology/approach: This research collected data by conducting a survey and elaborates on the judgments of…

Universities are centres of innovation and technology transfer, and they play a particularly strong role in the countries of the Association of Southeast Asian Nations (ASEAN) with developing technology programs. However, there are only a few assessment tools for evaluating a university's innovation ecosystem, and these tools are frequently…