From my personal point of view, the role of a program evaluator is to gather information about the thoughts and experiences of individuals impacted by the program and to use the findings to inform program improvement. However, participants in the evaluation may be reluctant to share their full thoughts due to factors such as power imbalances and a…

This paper explores using data mining in English teaching assessment in higher education within the 'Internet + Education' era. Traditional assessment methods struggle to meet modern teaching needs. By collecting diverse data like student performance and learning behavior, and employing data mining, a comprehensive assessment model is built. This…

Teacher professional development (PD) is among the most prominent levers used to improve teaching quality. The findings of research studies examining PD interventions are heterogeneous, with meta-analyses indicating mean positive impacts but also the existence of many ineffective programs. "Educational Researcher" has served as a…

Research on Teachers of Color and Indigenous Teachers (TOCIT) has gained traction in recent years in educational scholarship. Yet very few studies have evaluated teacher education programs that prepare TOCIT within the U.S. context or have focused on the promising pedagogical practices used to prepare TOCIT. The challenge of doing program…

This dissertation was a multiple case study research project designed to identify whether the "Men of Merit Program" (MOMP) met its goal of increasing persistence, retention, and graduation rates of African American male students at a Western New York Community College. Earlier statistics reported that other American colleges had shown a…

Is assessment a top-down bureaucratic mandate, an undertaking that seems to have little to do with improving practice, an inauthentic activity that frustrates and disempowers, an afterthought? Or is it a process embraced and enacted together by all stakeholders as a means to learn and grow and enact change in the world? The authors of the…

Background: Mentoring programs pair non-familial adults with children and adolescents for the purposes of promoting positive youth development. Although these programs are widely popular, evaluations tend to show that mentoring programs have, on average, modest effects on youth outcomes. Some researchers have suggested that mentoring programs…

Researchers and research organizations are under increasing pressure to demonstrate that their work contributes to positive change and helps solve pressing societal challenges. There is a simultaneous trend towards more engaged transdisciplinary research that is complexity-aware and appreciates that change happens through systems transformation,…

Purpose: It has become accepted practice to include an evaluation alongside learning programmes that take place at work, as a means of judging their effectiveness. There is a tendency to focus such evaluations on the relevance of the intervention and the amount of learning achieved by the individual. The aim of this review is to examine existing…

This study examines whether unobserved factors substantially bias education evaluations that rely on the Conditional Independence Assumption. We add 14 new within-study comparisons to the literature, all from primary schools in England. Across these 14 studies, we generate 42 estimates of selection bias using a simple approach to observational…

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

Large-scale education interventions aimed at diminishing disparities and generating equitable learning outcomes are often complex, involving multiple components and intended impacts. Evaluating implementation of complex interventions is challenging because of the interactive and emergent nature of intervention components. Methods that build from…

This is a design and development carried out to develop a web-based evaluation model in teacher professional programs. The subject of this research were participants in the professional teacher program in 2021. In addition, experts in the field of technology and evaluation are also the subject of this research to assess the feasibility of the…

This article explains and provides the theoretical foundations for and examples of systematization of experiences as a way to plan and evaluate socially engaged university extension programs.

In this chapter, we draw on the data collected during our evaluations of six TAACCCT grants to describe the challenges, successes, and transformative effect of adopting a developmental evaluation approach for community college programs.