The South Carolina Master Naturalist Program provides nature-based education to citizen volunteers who will promote environmental stewardship and is offered at six host sites across the state. We conducted a mixed-methods evaluation (the integration of qualitative and quantitative data) of the South Carolina Master Naturalist Program. Overall, the…

We present a framework to help those working in Extension connect program designs with appropriate evaluation designs to improve evaluation. The framework links four distinct Extension program domains--service, facilitation, content transformation, and transformative education--with three types of evaluation design--preexperimental,…

Photovoice is a technique in which a facilitator guides a participant to produce a photograph and accompanying caption that reflects the participant's unique views regarding a topic. The photovoice process is designed to be used with a wide range of audiences. This article describes ways Extension educators can incorporate photovoice into the…

Elected officials, an audience essential to the relevance and funding of Extension, may lack knowledge of Extension's capacity to engage with them in solving local problems, building consensus, and improving strategic planning or governance. They may not consider that by collaborating with locally knowledgeable Extension professionals, they also…

Logic models have garnered acclaim for their usefulness and disdain for the time required to create good ones. We argue that the orderly, analytical nature of logic models is opposed to many Extension programs, and we explain developmental evaluation, an approach that highlights ongoing development, adaptations, and rapid response. We use our…

A new method for evaluating the influence of Extension programming involves exploring whether Extension clientele differ from others in knowledge and behavior related to a particular topic. Analysis of South Dakota farm survey data allowed for the assessment of potential impacts of Extension through comparison of knowledge and adoption regarding…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

Extension program evaluations often present opportunities to analyze data in multiple ways. This article suggests that program evaluations can involve more sophisticated data analysis approaches than are often used. On the basis of a hypothetical program scenario and corresponding data set, two approaches to testing for evidence of program impact…

Extension educators have been challenged to be cost effective in their educational programming. The cost effectiveness ratio is a versatile evaluation indicator for Extension educators to compare the cost of achieving a unit of outcomes or educating a client in similar educational programs. This article describes the cost effectiveness ratio and…

Return on investment (ROI) is a commonly used metric for organizations concerned with demonstrating the value of their investments; it can be used to determine whether funds spent providing professional development programs for Extension professionals are good investments. This article presents a method for calculating ROI for an onboarding…

The case study addressed in this article illustrates the value of continuous response measurement (CRM) for testing and refining messages produced for distribution to Extension audiences. We used CRM to evaluate the responses of Extension educators and Natural Resources Conservation Service technical service providers to a video describing…

This article presents a method for using mind mapping to assess social learning outcomes in collaborative environmental restoration and participatory natural resource management initiatives. Using mind mapping for preassessment and postassessment can reveal changes in individual and collective thinking about critical social and ecological issues.…

This article presents the analysis of evaluation methods used in a well-designed and comprehensive evaluation effort of a significant Extension program. The evaluation data collection methods were analyzed by questionnaire mode and timing of follow-up surveys. Response rates from the short- and long-term follow-ups and different questionnaire…

A mind mapping approach to evaluation called Ripple Effects Mapping (REM) has been developed and used by a number of Extension faculty across the country recently. This article describes three approaches to REM, as well as key differences and similarities. The authors, each from different land-grant institutions, believe REM is an effective way to…

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…