Given decision-makers often prioritize causal research that identifies the impact of treatments on the people they serve, a key question in education research is, "Does it work?". Today, however, researchers are paying increasing attention to successive questions that are equally important from a practical standpoint--not only does it…

Power has always been an element of the program evaluation field, however, it has traditionally been attributed a negative connotation. With that in mind, power is seen as a force possessed to some extent by different stakeholders that can be imposed over others, and by which certain views, ideas, and decisions can be adopted. Given that program…

Over the last decade, the idea of societal impact resulting from publicly funded research has changed from being a relatively fringe concern related to high-technology entrepreneurship and spin-off companies to becoming an increasingly important public policy concern. This has stimulated academic science policy research to investigate the impact…

This paper will highlight the work at Delaware State University, an HBCU, on experiential education projects through a Howard Hughes Medical Institute (HHMI) Inclusive Excellence grant. It focuses on assessing experiential learning curriculum in individual courses as well as evaluating student growth from research and external opportunities. It…

Logic modeling, the process that explicates how programs are constructed and theorized to bring about change, is considered to be standard evaluation practice. However, logic modeling is often experienced as a transactional, jargon-laden, discrete task undertaken to produce a document to comply with the expectations of an external entity, the…

Most program evaluation efforts concentrate on assessments of "program implementation" and "program outcomes." However, another area of programs that has not received sufficient attention in the literature is evaluating the plan of the program. Since the quality of the plan and planning process can influence program…

Evaluation data is needed to demonstrate the impact of 4-H science, technology, engineering, and mathematics (STEM) programming on children and youth. However, collecting evaluation data from cloverbuds (ages 5-7) is particularly challenging given their developmental age. We adapted an observational Cloverbud evaluation tool to measure basic life…

This essay discusses the emergence of the program evaluation dissertation in our doctoral program as the preferred dissertation in practice (DiP) option. We also outline important considerations that must be reviewed with students when considering this approach. Our students are professional educational leaders in the settings where they conduct…

This article highlights the current state of "what we know we do not know" about student leadership development and suggests specific research agendas and program assessment methods. This article includes the practical description of how rigorous methods could be used to address these issues using examples for both researchers and…

Across higher education, educational developers and their supporting campus communities are being called upon to scale up evidence-informed practices, to enhance student experiences, and to document the changes. This article builds on the work of scholars who have taken up this evaluative challenge, by examining varied aspects of the evidencing…

In this article, Julia So discusses the purpose of program assessment, four common missteps of program assessment and reporting, and how to prevent them. The four common missteps of program assessment and reporting she has observed are: (1) unclear or ambiguous program goals; (2) measurement error of program goals and outcomes; (3) incorrect unit…

This article describes a mentorship assessment structure designed to improve doctoral student-research advisor mentoring relationships. We report the experiences of students and advisors as they completed the process to assess the feasibility, utility, and impact of engaging in mentorship assessment.

The authors have researched, designed, and engaged in leadership coaching for many years, from many angles and across many district contexts. They have been struck by how rare it is to see a leadership coaching model that clearly aligns with and supports district priorities. To help change that pattern, the authors have distilled the lessons they…

A recent independent evaluation by WestEd of Learning Forward's What Matters Now Network looked at the ways in which a structured, facilitated network provided support for state-level coalitions working with districts, schools, and educators to improve instruction and make progress toward achieving content standards. The network was facilitated by…

This article provides engineering educators with a comprehensive overview of engineering leadership assessment and evaluation for undergraduate engineering students to help instigate positive change for the future of the field.