Although program evaluations using rigorous quasi-experimental or experimental designs can inform decisions about whether to continue or terminate a given program, they often have limited ability to reveal the mechanisms by which complex interventions achieve their effects. To illuminate these mechanisms, this paper analyzes novel text data from…

Despite decades of formal work with teachers, little is known about what they gain from professional development at and with historic sites. This article presents the first data-set from a 3-year Institute for Museum and Library Services National Leadership Grant project designed to develop a broad-based assessment for understanding what teachers…

Background: Over the past decade, there has been a shift in science, technology, engineering and math education, especially in engineering, towards a competency-based pedagogy. Competency-based learning (CBL) is an outcome-based, student-centered form of instruction where students progress to more advanced work upon mastering the necessary…

The authors introduce the Preparation in STEM Leadership Program at Rutgers, The State University of New Jersey. This NSF-Funded program and research study creates a centralized training program for peer leaders that includes a battery of assessments to evaluate peer leaders' content knowledge, pedagogical knowledge, communication skills, and…

Evidence from formal evaluation of real-world practice can address gaps in the public health knowledge base and provide information about feasible, relevant strategies for varied settings. Interest in evaluability assessment (EA) as an approach for generating practice-based evidence has grown. EA has been central to several structured assessment…

In recent years, performance management (PM) has become a buzzword in public sector organizations. Well-functioning PM systems rely on valid performance data, but critics point out that conflicting rationale or logic among professional staff in recording information can undermine the quality of the data. Based on a case study of social service…

In Fall 2014 the University of Maryland Libraries launched a textbook reserves program to help relieve the burden of high textbook costs on students. Although its initial performance was lackluster, workflow refinements and expanded promotion greatly improved usage, resulting in a tenfold increase in circulation and expansion of the program. This…

Traditional e-Learning environments are based on static contents considering that all learners are similar, so they are not able to respond to each learner's needs. These systems are less adaptive and once a system that supports a particular strategy has been designed and implemented, it is less likely to change according to student's interactions…

This theoretical development article examines how design methodology currently applied in United States military doctrine can offer insights into the increasingly complex arena of program evaluations of online modes for adult distance education. The article presents key themes that emerge from a multidisciplinary literature review. These themes…

Full and durable implementation of school-based interventions is supported by regular evaluation of fidelity of implementation. Multiple assessments have been developed to evaluate the extent to which schools are applying the core features of school-wide positive behavioral interventions and supports (SWPBIS). The "SWPBIS Tiered Fidelity…

The authors describe social validity assessment of mindfulness education and practices among high school students (N = 84) participating in a 10-week instructional program. The participants rated their satisfaction with and acceptance of several program components, content areas, and outcomes, as well as their engagement in specific mindfulness…

We investigated the impacts of a peer-facilitated instructional intervention in mathematics on progress towards readiness for college among 10th graders who facilitated instruction for 9th graders in algebra classrooms in urban secondary schools. A goal of the intervention is to promote readiness for college by placing middle-performing students…

As 4-H evolves to include a wide breadth of youths' modern interests, innovative educational opportunities and evaluation practices become necessary. Horsemanship and safety-based horse camps were created in response to a statewide challenge to develop competitive 4-H members and retain those members as they approach adolescence. This article…

Building an effective mentoring program for community college faculty is a complex and multifaceted task. There are multiple layers of stakeholders and levels of involvement, which at times makes navigating the mentoring relationships challenging and complicates the decision of what types of information to provide to the faculty as part of their…

This article illustrates an argument-based approach to presenting validity evidence for assessment items intended to measure a complex construct. Our focus is developing a measure of teachers' ability to analyze and respond to students' mathematical thinking for the purpose of program evaluation. Our validity argument consists of claims addressing…