This research paper presents an operationalization procedure for measuring fidelity of implementation (FOI) of a school-based crisis prevention program. The implementation literature recommends that program developers specify core components of an intervention that are directly related to a program's theory of change and need to be implemented…

This study examines concepts surrounding the quality of afterschool programs in Japan and related challenges using qualitative and quantitative methods. A content analysis of government guidelines for afterschool programs provided by the Ministry of Health, Labour and Welfare (MHLW) and the Ministry of Education, Culture, Sports, Science and…

Expert intuition is increasingly considered to be a valid form of knowledge, and research has proven its effectiveness in judgment and decision making in various fields. Theorists seem to recognize the contributions of intuition within evaluative practice, but it has never been well-documented. This article presents a study on expert intuition,…

Like many youth development programs, most youth mentoring programs do not have prescribed practices that target specific outcomes. Because the construct of mentoring represents a broad range of potential activities, researchers face a conundrum when making generalizable causal inferences about the effects of this and similar services. On the one…

Including cost-effectiveness data in the evaluation of programs is the next step in the evolution of evidence-based practice. Evidence-based practice is grounded in three complementary elements: best available evidence, professional judgment, and client values and context. To fully apply the cost-effectiveness data, school administrators will have…

Educational developers need to assess the work of their Centres, from program participation and impact to underlying organizational processes. Various frameworks exist, but developers may feel unsure how to get started. We developed a planning model that offers a structured, systematic approach for developing comprehensive assessment systems that…

Journalism programs face many challenges today as they work to prepare students with the knowledge and skills to enter the ever-changing journalism industry. On one hand, programs need to determine whether students are learning the competencies their program designers have identified as essential to the field. On the other, students need to…

This project explored the reliability and utility of transcription in coding qualitative data across two studies in a program evaluation context. The first study tested the method of direct audio coding, or coding audio files without transcripts, using qualitative data software. The presence and frequency of codes applied in direct audio coding…

Positive Behavioral Interventions and Supports (PBIS) is an evidence-based approach to addressing behavior issues in schools. A significant amount of research has been done to identify the critical features of PBIS. More generally, implementation science points to a specific sequence to ensure that PBIS is implemented with fidelity. This fall…

There is growing evidence that out-of-school factors, such as physical and mental health, family support, and social and emotional development, significantly affect student learning (Berliner 2009). To address challenges related to poverty, schools are being charged with serving as a focal point in providing and coordinating support services for…

This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

Texas House Bill 102, effective September 1, 2019, requires Texas public school districts to assign a mentor teacher to each beginning teacher; however, implementation may look different on each campus within a school district (H.B. 102, 2019). Campus principals can enhance district induction and mentoring programs through the onboarding of new…

Background: Progress monitoring is a vital strategy for evaluating skill development of young children receiving disability related services. Few effective progress monitoring tools exist for infants and toddlers, and research is needed to examine feasibility as they become available. Objective: The current study examined the implementation of an…

This paper reports a cross-case analysis of three summer writing programs for youth in the northeast United States, each a longitudinal study in the tradition of design research. Initially, all three programs were most concerned with leveraging cultural and linguistic diversity as a resource for multilingual participants. As the three principal…

This paper describes the "Explorers Virtual Internship" (EVI), which was designed and presented in the 2020-21 school year by the Fred Hutchinson Cancer Research Center. Despite our initial wariness about creating a virtual internship, the shift helped us make valuable innovations to our programming. EVI paired 11 high school interns…