Purpose: As new technologies such as immersive and augmented platforms emerge, training approaches are also transforming. The virtual reality (VR) platform provides a completely immersive learning experience for simulated training. Despite increased prevalence of these technologies, the extent literature is lagging behind in terms of evaluating…

Over the past 30 years, mixed methods research has become an increasingly popular tool in the social sciences. Mixed methods research can capture a diverse range of perspectives and levels of complexities not always possible with the use of a single methodological approach. It has been effectively implemented in a range of contexts to explore…

Nine years after reconceptualizing the nature of science for science education using the family resemblance approach (FRA) (Erduran & Dagher, 2014a), the time is ripe for taking stock of what this approach has accomplished, and what future research it can facilitate. This reflective paper aims to accomplish three goals. The first addresses…

Evidence-based programs and grassroots programs are often adapted during implementation. Adaptations are often hidden, ignored, or punished. Although some adaptations stem from lack of organizational capacity, evaluators report other adaptations happen in good faith or are efforts to better fit the local context. Program implementers, facilitators…

In this reflective case, we examine the role and function of collaboration in use-oriented evaluation approaches. Reflecting on our experience evaluating a program that sought to integrate new technologies into K-12 teaching and pre-service teacher education, we found that the desire and pursuit of making evaluation useful can influence why, with…

Background: Mentoring programs pair non-familial adults with children and adolescents for the purposes of promoting positive youth development. Although these programs are widely popular, evaluations tend to show that mentoring programs have, on average, modest effects on youth outcomes. Some researchers have suggested that mentoring programs…

Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

Over 2000 years ago, Aristotle wrote of four distinct causes at play in the world we know. Those causes, the material cause, the formal cause, the efficient cause, and the final cause, were meant to refer to ontological and, by extension, epistemological concerns, and were powerful enough to be seized upon and used in some form by those of very…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Several influential reviews and two meta-reviews have converged on the position that teacher professional development (PD) is more effective when it is sustained, collaborative, subject specific, draws on external expertise, has buy-in from teachers, and is practice based. This consensus view has now been incorporated in government policy and…

Active learning promotes the capacity of problem solving and decision making among learners. Teachers who apply instructional processes toward active participation of learners help their students develop higher order thinking skills. Due to the recent paradigm shift toward adopting competency-based curricula in the education of healthcare…

Meaningfully engaging faculty in assessment presents a continual challenge for general education administrators. Faculty perceptions of assessment--including that assessment serves no purpose other than "checking a box" for accreditation and that it conveys little benefit to the instructor--often hinder instructor engagement. A low-cost…

Social return on investment (SROI), an evaluation method that compares monetized social value generated to costs invested, is in ascendance. Conceptually akin to cost-benefit analysis, it shares some of its challenges; however, these are heightened due to the expressed promise of using SROI to compare programs and inform philanthropic and public…

From the fall of 2017 to the winter of 2020, the Student-Centered Assessment Network (SCAN) aimed to transform high school teaching in Rhode Island. Researchers and teachers worked together to make high school classes more student centered by increasing teachers' use of student-centered formative assessment. Network leaders (the hub) organized…

Analysis of symmetrically predicted endogenous subgroups (ASPES) is an approach to assessing heterogeneity in an ITT effect from a randomized experiment when an intermediate variable (one that is measured after random assignment and before outcomes) is hypothesized to be related to the ITT effect, but is only measured in one group. For example,…