Many researchers assessing the efficacy of educational programs face challenges due to issues with non-randomization and the likelihood of dependence between nested subjects. The purpose of the study was to demonstrate a rigorous research methodology using a hierarchical propensity score matching method that can be utilized in contexts where…

Science, technology, engineering, and mathematics (STEM) programs in out-of-school time (OST) are designed to supplement school work, ignite student interest, and extend STEM learning. From interactive museum exhibits to summer-long science camps, opportunities for informal student engagement in STEM learning abound. The differences these programs…

Randomized experiments are often seen as the "gold standard" for causal research. Despite the fact that experiments use random assignment to treatment conditions, units are seldom selected into the experiment using probability sampling. Very little research on experimental design has focused on how to make generalizations to well-defined…

Extension has developed a strong evaluation culture across the system for the last 15 years. Yet measures are still limited to the private value of programs, looking at problems in a linear way and at isolated efforts. Across the country, Extension evaluators and administrators need to step up to help answer the "so what?" question about…

This paper shows the results of research activities for building the representative model of the learning process in virtual spaces (e-Learning). The formal basis of the model are supported in the analysis of models of learning assessment in virtual spaces and specifically in Dembo´s teaching learning model, the systemic approach to evaluating…

This article describes how to develop a comprehensive teaching philosophy from articulation through implementation to evaluation. Using literature and teaching-learning experiences, we discuss pragmatic steps for using a teaching philosophy to inform, engage, and evaluate teaching-learning. We promote an integrated teaching philosophy to ensure…

Cluster randomized trials (CRTs), or studies in which intact groups of individuals are randomly assigned to a condition, are becoming more common in the evaluation of educational programs, policies, and practices. The website for the National Center for Education Evaluation and Regional Assistance (NCEE) reveals they have launched over 30…

A logic model is a visual representation of the assumptions and theory of action that underlie the structure of an education program. A program can be a strategy for instruction in a classroom, a training session for a group of teachers, a grade-level curriculum, a building-level intervention, or a district-or statewide initiative. This guide, an…

The Food and Nutrition Service (FNS) identified a need for a comprehensive set of best practices in nutrition education for low-income audiences for the Supplemental Nutrition Assistance Program (SNAP) educational projects, including SNAP-Ed. A comprehensive list of best practices would promote consistency and efficacy in program planning,…

This study illustrates the process of program evaluation using a logic model. Guided by the Transtheoretical Model of Change and a logic model, this study evaluated the effectiveness of a Retirement and Savings Seminar by measuring participant (n = 54) satisfaction, financial knowledge, financial confidence, and financial behavior change compared…

Objective: Public and private stakeholders of substance abuse treatment services require economic cost data to guide program evaluations and funding decisions. Background: Rigorous cost assessments have been conducted for several treatment programs across the United States, but a systematic and comprehensive evaluation of programs in a particular…

The Preschool-Wide Evaluation Tool (PreSET; Steed & Pomerleau, 2012) is published by Paul H. Brookes Publishing Company in Baltimore, MD. The PreSET purports to measure universal and program-wide features of early childhood programs' implementation fidelity of program-wide positive behavior intervention and support (PW-PBIS) and is,…

This chapter discusses assessment and evaluation of multicultural initiatives by exploring two efforts implemented at a small, liberal arts college.

While optimism regarding the treatment of sexual offenders has increased over the past couple of decades, research into the factors that assist offenders in maintaining therapeutic changes remains in the dark. Maintenance programs for offenders, while theoretically appearing to have a solid place in offender rehabilitation, surprisingly have not…

The main thrust of this paper deals with the conceptualization of theory-driven evaluation pertaining to a tutor training programme. Conceptualization of evaluation, in this case, is an integration between a conceptualization model as well as a theoretical framework in the form of activity theory. Existing examples of frameworks of programme…