Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Realist evaluation (RE) is a research design increasingly used in program evaluation, that aims to explore and understand the influence of context and underlying mechanisms on intervention or program outcomes. Several methodological challenges, however, are associated with this approach. This article summarizes RE key principles and examines some…

The purpose of this research is to analyze the studies on the Remedial Education Program in Primary Schools using meta-thematic analysis. In this research, qualitative research papers containing the opinions of participants about the Remedial Education Program in Primary Schools (REPPS) were examined by reviewing using Google Scholar and TR Dizin…

This article reflects on the evaluation of an innovative educational arts project at a primary school in Liverpool. Based on an animated film version of Janácek's "Cunning Little Vixen," an opera populated by animals, this child-led project was considered to be a successful endeavour. Yet there remain unanswered questions over how this…

Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

Purpose: The purposes of this paper are to provide a description of AI and to document and compare two applications of AI, one in program evaluation and another in an applied research study. Design/methodology/approach: Focus groups, interviews and observations were used to gather rich qualitative data which was used to detail Appreciative…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

Students in a master's-level graduate course in school counseling program evaluation conducted a qualitative research study to investigate school counselors' experiences with evidence-based program delivery and evaluation. We discuss the study's findings that illuminated themes of challenges faced by school counselors with implications for…

Individuals representing different organizations within the Land-Grant University System (LGUS) were asked to provide their insights on organizational change using a focus group approach. The study focused on three key components to organizational change in the LGUS: what initiates change, the hindrances to change, and what sustains change. Themes…

This chapter makes a case for employing qualitative methodologies in the assessment of student leadership programs. Frameworks for reflective practice are discussed.

Duplicating processes and procedure with anticipation of deviating outcomes is the defining trait of insanity as attributed to a quote by Albert Einstein. It is the antithesis to innovation, which is what is needed in higher education to create impactful changes in the outreach we should be providing to the community. What is important for those…

Background: There is a lack of health promotion programming designed to change the physical activity environment of the group home setting. The Menu-Choice programme assists staff in creating physical activity goals alongside residents with intellectual disabilities and provides strategies to incorporate activity into the group home schedule. The…

Purpose: Novice researchers experience difficulties in analysing qualitative data. To develop the skills necessary for qualitative data analysis, theoretical manuals are often insufficient. Supervisors supporting students in analysing qualitative data stress the need for practical guidance, including exercises and feedback. The purpose of this…