Background: Mentoring programs pair non-familial adults with children and adolescents for the purposes of promoting positive youth development. Although these programs are widely popular, evaluations tend to show that mentoring programs have, on average, modest effects on youth outcomes. Some researchers have suggested that mentoring programs…

Researchers and research organizations are under increasing pressure to demonstrate that their work contributes to positive change and helps solve pressing societal challenges. There is a simultaneous trend towards more engaged transdisciplinary research that is complexity-aware and appreciates that change happens through systems transformation,…

Purpose: It has become accepted practice to include an evaluation alongside learning programmes that take place at work, as a means of judging their effectiveness. There is a tendency to focus such evaluations on the relevance of the intervention and the amount of learning achieved by the individual. The aim of this review is to examine existing…

This study examines whether unobserved factors substantially bias education evaluations that rely on the Conditional Independence Assumption. We add 14 new within-study comparisons to the literature, all from primary schools in England. Across these 14 studies, we generate 42 estimates of selection bias using a simple approach to observational…

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This is a design and development carried out to develop a web-based evaluation model in teacher professional programs. The subject of this research were participants in the professional teacher program in 2021. In addition, experts in the field of technology and evaluation are also the subject of this research to assess the feasibility of the…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

In this chapter, we draw on the data collected during our evaluations of six TAACCCT grants to describe the challenges, successes, and transformative effect of adopting a developmental evaluation approach for community college programs.

Inspiring the transformational changes required to address the climate crisis, as well as other global challenges, requires acting boldly and taking risks. New approaches that integrate transformational change thinking and concepts into evaluations, and that further deepen the nexus of evaluation and learning, are urgently needed. In 2017, Climate…

Problem definition in program planning and evaluation is rarely problematized. In this article, I discuss why the lack of problem problematization is itself problematic--in other words, why treating problems as self-evident can pose a risk for evaluation practice. Then, to help avoid such risks, I suggest Carol Bacchi's "What's the Problem…

Higher education institutions are utilizing comprehensive college transition programs (CCTPs) to streamline support, promote retention and success, and address the structural barriers that at-promise students face. Yet, research about the role of CCTPs rarely explores the importance of major and career self-efficacy (MCSE) for these populations,…

The overriding aim of this study was to conduct a side-by-side comparative evaluation of two online suicide prevention gatekeeper-training programs: Question, Persuade, Refer (QPR) and Making Educators Partners in Youth Suicide Prevention (MEP). Specific aims included identifying program components, instructional methods, and technology elements…

Over the past several years, there has been an expansion in the use and awareness of open educational resources (OERs) in postsecondary institutions in the United States. Some states have invested funds to expand the use of OERs across their campuses as an alternative or supplement to traditional course materials that students typically pay for…

The Fuzzy Analytic Hierarchy Process (FAHP) was employed to evaluate and rank language-learning applications based on criteria such as engagement, interactivity, feedback, content quality and usability. A pairwise comparison matrix was constructed, fuzzy logic was applied to convert qualitative judgements into numerical values, and these values…