Power has always been an element of the program evaluation field, however, it has traditionally been attributed a negative connotation. With that in mind, power is seen as a force possessed to some extent by different stakeholders that can be imposed over others, and by which certain views, ideas, and decisions can be adopted. Given that program…

Logic modeling, the process that explicates how programs are constructed and theorized to bring about change, is considered to be standard evaluation practice. However, logic modeling is often experienced as a transactional, jargon-laden, discrete task undertaken to produce a document to comply with the expectations of an external entity, the…

This method note presents Q methodology as a useful tool for evaluators to add to their practice toolbox. Q methodology, which involves both quantitative and qualitative techniques, can help researchers and evaluators systematically understand subjectivity and the communicability of opinions and perspectives. We first provide an overview of Q…

Is assessment a top-down bureaucratic mandate, an undertaking that seems to have little to do with improving practice, an inauthentic activity that frustrates and disempowers, an afterthought? Or is it a process embraced and enacted together by all stakeholders as a means to learn and grow and enact change in the world? The authors of the…

This article presents a new tool called Critical Evaluation Capital (CEC) designed to address issues of equity and social justice in program evaluation. CEC is grounded in the tenants of critical race theory and inspired by Yosso's work on community cultural wealth which raises critical issues of positionality and access. CEC is a system for…

A data party is an engaging way to involve stakeholders in program evaluation. We explain the use of a data party for engaging 4-H program stakeholders (e.g., staff and volunteers) in data interpretation and helping them understand, embrace, and use program evaluation information to make data-driven decisions about their programs. We present two…

Launched in 2011, Sprockets is a network of after-school and summer programs for youth in Saint Paul, MN. A 2006 community-engaged process resulted in a vision for out-of-school time (OST) in Saint Paul that became Sprockets. That process involved the mayor's office, Saint Paul Public Schools, community organizations and activists, local…

The U.S. Department of Education (Department) Office of Inspector General (OIG) annual plan identifies the audits, inspections, and other activities that the OIG intends to undertake to assist the Department in fulfilling its responsibilities to America's citizens and students. The FY 2024 Annual Plan details the assignment areas they plan to…

The State Capacity Assessment (SCA) was developed to assess the impact and presence of efforts to build strong foundations needed to adopt, sustain, and scale effective practices so that they lead to positive outcomes. In use, the SCA assesses the extent to which an agency invests in and aligns system components to support use of best practices,…

The National Academy of Education (NAEd) undertook this consensus report on the evaluation and improvement of teacher preparation programs (TPPs). Specifically, this consensus report aims to (1) identify and disseminate best practices for evaluating and improving TPPs to promote teacher effectiveness and student achievement; (2) provide…

Community-engaged scholars, practitioners, and community partners often find the language of community engagement challenging. Words like "participate," "collaborate," "partner," or "engage" fail to convey who in a community-university partnership has voice and authority in decision-making and responsibility…

Accountability mechanisms and processes have evolved with changes in statute. State Education Agency (SEA) accountability systems may exhibit characteristics of compliance- and/or improvement-focused systems in light of requirements under the "Elementary and Secondary Education Act" (ESEA) and its reauthorizations under the…

Visual representations, such as pathway models, are increasingly being used to both communicate higher education science, technology, engineering, and mathematics (STEM) education program evaluation plans as well as accurately represent complex programs and the systems within which the educational programs reside. However, these representations…

Discussing the topic of special education teacher shortages across the United States has become commonplace. Although more widespread, special education teacher shortages in rural areas have gained less attention. Teachers in these areas face unique challenges such as overcoming geographic barriers to providing high-quality services, the isolation…

The U.S. Department of Education (Department) Office of Inspector General (OIG) annual plan identifies the audits, inspections, and other activities that the OIG intends to undertake to assist the Department in fulfilling its responsibilities to America's citizens and students. The FYs 2025-2026 Annual Plan details the assignment areas OIG plans…