Most program evaluation efforts concentrate on assessments of "program implementation" and "program outcomes." However, another area of programs that has not received sufficient attention in the literature is evaluating the plan of the program. Since the quality of the plan and planning process can influence program…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

A growing body of research demonstrating the benefits of high quality early care and education (ECE) programs for young children, particularly those in families with low incomes, has inspired a strong commitment from both federal and state officials to improve the quality of ECE programs nationwide. Policymakers, administrators, and program and…

The purpose of this study was to conduct a program evaluation case study on the impact of standards-based grading in a North Carolina school district. The implementation procedures and end products of grading reform were assessed using the CIPP model. Data from teacher questionnaires, principal implementation checklists, interviews, and…

The CIPP model has been widely used in the evaluation of vocational education. However, there has been no research that examines the suitability of CIPP in evaluating vocational education. Therefore, this study examined the suitability of CIPP in evaluating vocational education through a literature review. This research was a literature review…

Purpose: Assessment of agricultural advisory services is crucial to improve their quality and effectiveness. Farmer Field Schools (FFS) have been adapted to meet context specific needs in crop or farm management. This article investigates whether the diversity of FFS interventions is reflected in the assessment methods used to evaluate them.…

In recent years, there has been increased attention regarding systems-level implementation to support the sustained use of evidence-based interventions and supports in authentic early childhood settings. With this comes a need to accurately measure implementation fidelity of the critical features within a framework as well as individual practices.…

With social-emotional learning's (SEL) significant impact on academic, emotional, behavioral, social, and lifelong success, it is necessary to ensure its continued adoption, implementation, and effectiveness within schools. While SEL is at its highest levels of awareness and implementation, it still faces significant barriers to effectiveness.…

This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health…

The problem addressed in this study was that online training designers experience barriers when implementing evaluations to assess knowledge transfer after 3-6 months. This qualitative exploratory case study aimed to explore online training designers' experiences and perceptions regarding the barriers faced when working with project stakeholders…

Purpose: This paper evaluates the implementation of a school-based physical activity intervention and discusses how the intervention outcomes can be influenced by the implementation. Design/methodology/approach: In four of the nine lower secondary schools in which the intervention was conducted, the authors examined implementation fidelity,…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

The Hexagon Discussion and Analysis Tool helps organizations evaluate new and existing programs and practices. This tool is designed to be used by a team to ensure diverse perspectives are represented in a discussion of the six contextual fit and feasibility factors. Program indicators assess new or existing programs or practices that will be…

Education officials have long hoped that the statewide academic assessments most students take each year could be used not only for accountability but also to guide instruction. Congress established the Innovative Assessment Demonstration Authority (IADA) program in 2015 to help address this goal, offering up to seven states temporary flexibility…

This appendix volume supplements "Evaluating the Federal Innovative Assessment Demonstration Authority: Early Implementation and Progress of State Efforts to Develop New Statewide Academic Assessments. Evaluation Report. NCEE 2023-004" analyzing the early progress of the first five assessment systems participating in the Innovative…