Purpose: It has become accepted practice to include an evaluation alongside learning programmes that take place at work, as a means of judging their effectiveness. There is a tendency to focus such evaluations on the relevance of the intervention and the amount of learning achieved by the individual. The aim of this review is to examine existing…

This study examines whether unobserved factors substantially bias education evaluations that rely on the Conditional Independence Assumption. We add 14 new within-study comparisons to the literature, all from primary schools in England. Across these 14 studies, we generate 42 estimates of selection bias using a simple approach to observational…

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This is a design and development carried out to develop a web-based evaluation model in teacher professional programs. The subject of this research were participants in the professional teacher program in 2021. In addition, experts in the field of technology and evaluation are also the subject of this research to assess the feasibility of the…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

In this chapter, we draw on the data collected during our evaluations of six TAACCCT grants to describe the challenges, successes, and transformative effect of adopting a developmental evaluation approach for community college programs.

Inspiring the transformational changes required to address the climate crisis, as well as other global challenges, requires acting boldly and taking risks. New approaches that integrate transformational change thinking and concepts into evaluations, and that further deepen the nexus of evaluation and learning, are urgently needed. In 2017, Climate…

Problem definition in program planning and evaluation is rarely problematized. In this article, I discuss why the lack of problem problematization is itself problematic--in other words, why treating problems as self-evident can pose a risk for evaluation practice. Then, to help avoid such risks, I suggest Carol Bacchi's "What's the Problem…

This study investigates the impact of game-based learning (GBL), an increasingly popular educational approach, on the development of self-directed learning (SDL) skills in complex scenarios, particularly in undergraduate logistics education. A key component of the three year study is LOST (Logistics Education Simulator), a serious game platform,…

Clearinghouses set standards of scientific quality to vet existing research to determine how "evidence-based" an intervention is. This paper examines 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently[underlined] they rate the same program, and to probe why their judgments differ. All the…

The National Institutes of Health (NIH) supports 24 IDeA Networks of Biomedical Research Excellence (INBRE) Programs that help develop university-based biomedical research capacity in states that historically receive low levels of extramural grant support. To assess the effectiveness of the Arkansas INBRE in meeting its biomedical research…

As academic librarians become aware of the challenges textbook expenses pose to student success, they have increased efforts to provide free access to required course materials. Librarians at Illinois State University initiated a program to license course-assigned e-books, surveying participating students and faculty regarding their perspectives…

The primary purpose of this study is to validate a student engagement measure for its use in evaluation of a learning assistant (LA) program. A series of psychometric evaluations were made for both the original scale of Higher Education Student Engagement Scale (HESES) and its adapted version designed to be used in gauging the effectiveness of…

The concept and practice of experiential education is rapidly expanding as universities seek to strengthen and integrate high-impact practices under experiential education plans and centers. While this integration has the potential to create synergy across disparate experiential learning offerings and to provide the benefits of experiential…