Supervised Agricultural Experience (SAE) has been a critical component of School-Based Agricultural Education (SBAE) for decades. Formally called the 'home project', Rufus Stimson developed the concept of SAE in the early 20th century. This work-based learning concept provides students with experiential instruction that strengthens their…

Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…

A data party is an engaging way to involve stakeholders in program evaluation. We explain the use of a data party for engaging 4-H program stakeholders (e.g., staff and volunteers) in data interpretation and helping them understand, embrace, and use program evaluation information to make data-driven decisions about their programs. We present two…

Purpose: A faculty development program (FDP) introduced postsecondary instructors to a module focused on the food-energy-water (FEW) nexus, a socio-hydrologic issue (SHI) and a sustainability challenge. This study aims to examine factors influencing faculty interest in adopting the instructional resources and faculty experience with the FDP,…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

This response aims to critically evaluate the methodology and aims of the meta-analytic review written by Maggin and Johnson (2014). The present authors systematically provide responses for each of the original criticisms and highlight concerns regarding Maggin and Johnson's methodology, while objectively describing the current state of evidence…

In critiquing our paper on "The literacy performance of ex-Reading Recovery students between two and four years following participation in the program: Is this intervention effective for students with early reading difficulties?", Schwartz argues that we have engaged in pursuing political and ideological agendas as part of our ongoing…

Evaluators report effects of education initiatives as standardized effect sizes, a scale that has merits but obscures interpretation of the effects' practical importance. Consequently, educators and policymakers seek more readily interpretable translations of evaluation results. One popular metric is the number of years of learning necessary to…

This paper presents a framework for program assessment and a case study in assessment for a university clothing and textile program in family and consumer sciences. Assessment activities and the process implemented by the Textile and Apparel Studies (TAS) major at Western Michigan University are explained. The process adopts the International…

Shortly after we published "Addressing Flawed Research in Developmental Education" (2012) in the "Journal of Developmental Education," Thomas Bailey, Shanna Smith Jaggars, and Judith Scott- Clayton from the Community College Research Center (CCRC) wrote a response rebutting several of our claims. Though their response corrects…

Implementation fidelity assessment provides a means of measuring the alignment between the planned program and the implemented program. Unfortunately, the implemented program can differ from the planned program, resulting in ambiguous inferences about the planned program's effectiveness (i.e., it is uncertain if poor results are due to an…

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…

Extension educators need simple and accurate evaluation tools for program evaluation. This article explains how to use aspiration as an outcome indicator in Extension evaluation and introduces a practical evaluation tool. Aspiration can be described as the readiness for change. By recording participants' levels of aspiration, we will be able to…

Student feedback collected through program evaluation of secondary education licensure and Master's program clinical experiences prompted us to conduct a collective self-study. We used a reflective framework for analysis and discussion of the shifts students in our courses made as they progressed from observers to practicing teachers. Along with…