The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program.…

Many children are attending after-school programs for various reasons, such as academic support, recreational play, and social interaction. Accompanied by high parental demands for affordable child-care, after-school program participation has increased significantly. The issue of quality care becomes important as the number of children enrolled in…

Realist evaluation (RE) is a research design increasingly used in program evaluation, that aims to explore and understand the influence of context and underlying mechanisms on intervention or program outcomes. Several methodological challenges, however, are associated with this approach. This article summarizes RE key principles and examines some…

The purpose of this research is to analyze the studies on the Remedial Education Program in Primary Schools using meta-thematic analysis. In this research, qualitative research papers containing the opinions of participants about the Remedial Education Program in Primary Schools (REPPS) were examined by reviewing using Google Scholar and TR Dizin…

Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

Intended to guide scholars who are new to qualitative research, this methods brief focuses mostly on what reviewers look for in manuscripts submitted for publication. The author acknowledges that reviewers' preferences likely reflect their theoretical perspectives, research-oriented coursework, mentors, and research and writing experiences. The…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

Purpose: The purposes of this paper are to provide a description of AI and to document and compare two applications of AI, one in program evaluation and another in an applied research study. Design/methodology/approach: Focus groups, interviews and observations were used to gather rich qualitative data which was used to detail Appreciative…

Attention to mixed methods studies research has increased in recent years, particularly among funding agencies that increasingly require a mixed methods approach for program evaluation. At the same time, researchers operating within large-scale, rapid-turnaround research projects are faced with the reality that collection and analysis of large…

The aim of this study is to examine studies conducted within the Movement to Increase Opportunities and Technology (FATIH) project in order to reveal the current position of the project and to determine further research gaps. A method based on thematic content analysis was used for the study. Academic studies that have been analyzed in research…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This article provides insight into how an adequate approach to selecting methods can establish credible and actionable evidence. The authors offer strategies to effectively support Extension professionals, including program developers and evaluators, in being more deliberate when selecting appropriate qualitative and quantitative methods. In…

Purpose: Participatory extension programmes are widely used to promote change in the agricultural sector, and an important question is how best to measure the effectiveness of such programmes after implementation. This study seeks to understand the current state of practice through a review of ex post evaluations of participatory extension…

This study provides formative evaluation results from a pilot peer mentorship and teaching support program designed, implemented, and evaluated at a school of social work located in a major Midwestern Carnegie research I (RI) university over a 3-year span. Through utilizing an adult learning approach, the Teaching Excellence and Academic…

This article reflects on the evaluation of an innovative educational arts project at a primary school in Liverpool. Based on an animated film version of Janácek's "Cunning Little Vixen," an opera populated by animals, this child-led project was considered to be a successful endeavour. Yet there remain unanswered questions over how this…