Safety training programs are a popular method, in industry globally, to increase awareness of risks to employees and employers and plays a critical part in reducing safety incidents. The most frequently used method to assess the effectiveness of the training is to have the participants answer Multiple Choice Question (MCQ) and True/False (T/F)…

We revisit the merits of the retrospective pretest-posttest (RPP) design for repeated-measures research. The underutilized RPP method asks respondents to rate survey items twice during the same posttest measurement occasion from two specific frames of reference: "now" and "then." Individuals first report their current attitudes…

Traditional pre-test (TpT)/post-test (PT) and retrospective pre-test (RpT)/post-test (PT) designs are used to collect data on self-reported measures to assess the magnitude of change that occurs from interventions. If measurement invariance does not exist across the measurement occasions within these research designs, it is inappropriate to…

This study was carried out to determine the effectiveness of the Flipped Classroom Model (FCM) in an educational setting. For this purpose, a multi-complementary approach (MCA) was used including both quantitative (meta-analysis) and qualitative (thematic). MCA consists of three parts, the first of which is the pre-complementary information stage.…

Extension program evaluations often present opportunities to analyze data in multiple ways. This article suggests that program evaluations can involve more sophisticated data analysis approaches than are often used. On the basis of a hypothetical program scenario and corresponding data set, two approaches to testing for evidence of program impact…

Return on investment (ROI) is a commonly used metric for organizations concerned with demonstrating the value of their investments; it can be used to determine whether funds spent providing professional development programs for Extension professionals are good investments. This article presents a method for calculating ROI for an onboarding…

Purpose: While the number of entrepreneurship education programmes offered around the world is on the rise, research into the assessment of entrepreneurship education programmes is still lacking. The purpose of this paper is to take the stance that entrepreneurship education has to focus on a set of transversal competences aimed at teaching…

The case study addressed in this article illustrates the value of continuous response measurement (CRM) for testing and refining messages produced for distribution to Extension audiences. We used CRM to evaluate the responses of Extension educators and Natural Resources Conservation Service technical service providers to a video describing…

Background: Few nutrition interventions in kindergarten classes have been evaluated, and none has been tested for program effectiveness, implementation, and dissemination. Building a Healthy Me (BHM) is a nutrition intervention for kindergarteners that is classroom-based and includes a family component. This study evaluated the public health…

Summarizing theory and results of empirical research, this article serves to illustrate why effects measured with retrospective pretests may be subject to bias and may not always be explained by response shift theory. It presents three contending theories to explain the difference between retrospective and traditional pretest results and considers…

Antoine de Saint-Exupery said, "If you want to build a ship, don't drum up people to collect wood and don't assign them tasks and work, but rather teach them to long for the endless immensity of the sea." This article presents a pedagogical approach for framing a digital-identity-enhancing ePortfolio that maximizes student engagement and…

Extensive graded reading (EGR) was carried out with a cohort of 600 engineering students in a university in northern Japan. Pre-and post-surveys were conducted to discover changes in the general reading habits of students, their attitudes toward the assessment method and how goals changed over the course of study. The first survey was carried out…

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

Community-based education programs must demonstrate effectiveness to various funding sources. The pilot study reported here (funded by CYFAR, NIFA, USDA award #2008-41520-04810) had the goal of determining if state level programs with varied curriculum could use a common evaluation tool to demonstrate efficacy. Results in parenting and youth…

This paper describes a randomised controlled trial conducted with 10 secondary schools in England to evaluate the impact and feasibility of Fresh Start as an intervention to help new entrants with low prior literacy. Fresh Start is a synthetic phonics programme for small groups of pupils, here implemented three times per week over 22 weeks. The…