Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

This paper reviews the use of multiple trials, defined as multiple sites or multiple arms in a single evaluation and replications, in evaluating social programs. After defining key terms, the paper discusses the rationales for conducting multiple trials, which include increasing sample size to increase statistical power; identifying the most…

There is a lively discussion on how to evaluate competence-based higher education in both evaluation and competence research. The instruments used are often limited to course evaluation or specific competences, taking a rather narrow perspective. Furthermore, the instruments often comprise predetermined competences that cannot be adapted to higher…

Although the number of honors programs and colleges has grown dramatically over the last twenty years to over a thousand programs nationally, little has been done to develop consistency of standards in honors. In the interest of seeking consistency, the author designed a research study to provide initial insights into assessable measures that a…

Augmented reality (AR) technologies could enhance learning in several ways. The quality of an AR-based educational platform is a combination of key features that manifests in usability, usefulness, and enjoyment for the learner. In this paper, we present a multidimensional model to measure the quality of an AR-based application as perceived by…

Schools and education systems are being challenged to improve the evaluation of teacher professional development, yet there is a lack of practical tools for doing so. This article describes the development and validation of a new instrument to assess teachers' perceptions of the impact of professional development. This instrument, designed to be…

Objective: The measurement of Family Feedback on Child Welfare Services (FF-CWS) is gaining prominence as an efficacy indicator and is coherent with concerns about family-centered practice and empowerment. The aim of this study was to develop and validate an instrument that would overcome the scarcity of psychometrically sound measures in this…

Given increasing interest in evidence-based policy, there is growing attention to how well the results from rigorous program evaluations may inform policy decisions. However, little attention has been paid to documenting the characteristics of schools or districts that participate in rigorous educational evaluations, and how they compare to…

Evaluations of teacher preparation programs (TPPs) based in part on the performance of program completers have emerged as an education reform strategy in several states and have become central features of the Race to the Top (RTTT) grant competition. The objective of this policy review is to examine how the state of Tennessee measured and reported…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

The PULSE Vision & Change Rubrics, version 1.0, assess life sciences departments' progress toward implementation of the principles of the "Vision and Change report." This paper reports on the development of the rubrics, their validation, and their reliability in measuring departmental change aligned with the "Vision and…

In response to pedagogical challenges in higher education, blended learning has become a prevalent practice in colleges and universities. Flipped learning (FL) represents a newly emerging form of blended learning, where students individually watch online lectures prior to class and then engage in classroom learning activities interacting with…

Introduction: Recent investigations have emphasized the need for university teachers to develop tutorial programs for students at university. Many universities are committed to broadening research on university teaching that will sharpen academic performance and levels of student satisfaction. Tutoring programs improve the development of the…

The project reported here served to assess a curriculum for EFNEP to ensure theory compliance and content validity. Adherence to Adult Learning Theory and Social Cognitive Theory tenets was determined. A curriculum assessment tool was developed and used by five reviewers to assess initial and revised versions of the curriculum. T-tests for…

The authors conducted a meta-analysis and systematic review that examined 23 studies evaluating the effectiveness of child centered play therapy (CCPT) conducted in elementary schools. Meta-analysis results were explored using a random effects model for mean difference and mean gain effect size estimates. Results revealed statistically significant…