Logic modeling, the process that explicates how programs are constructed and theorized to bring about change, is considered to be standard evaluation practice. However, logic modeling is often experienced as a transactional, jargon-laden, discrete task undertaken to produce a document to comply with the expectations of an external entity, the…

Most program evaluation efforts concentrate on assessments of "program implementation" and "program outcomes." However, another area of programs that has not received sufficient attention in the literature is evaluating the plan of the program. Since the quality of the plan and planning process can influence program…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Over the last few decades, there has been an increase in the number of large federally funded transdisciplinary programs and initiatives. Scholars have identified a need to develop frameworks, methodologies, and tools to evaluate the effectiveness of these large collaborative initiatives, providing precise ways to understand and assess the…

Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal inferences about the effects of an intervention but others have designs that do not permit these types of conclusions. To help policymakers, practitioners, and others make sense of study results, the…

Since its inception in 1990, the Language Testing Research Centre (LTRC) at the University of Melbourne has earned an international reputation for its work in the areas of language assessment and testing as well as program evaluation. The mission of the centre is: (1) to carry out and promote research and development in language testing; (2) to…

The What Works Clearinghouse (WWC) evaluates research studies that look at the effectiveness of education programs, products, practices, and policies, which the WWC calls "interventions." Many studies of education interventions make claims about impacts on students' outcomes. Some studies have designs that enable readers to make causal…

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

The primary focus of this article is ''advocating for the results of a specific evaluation.'' To some extent, all evaluators are advocates, however the author notes, "there is no great mystery in how to use evaluations for advocacy, especially with respect to influencing policy making within federal and state…

Our understanding of programs is enhanced when trained, skilled, and observant evaluators go "into the field"--the real world where programs are conducted--paying attention to what's going on, systematically documenting what they see, and reporting what they learn. The article opens by presenting and illustrating twelve reasons for…

The aim of the article is to describe the assessment model adopted by the SCINTILLA Project, a project in Italy aimed at the online vocational training of young, seriously-disabled subjects and their subsequent work inclusion in smart-work mode. It will thus describe the model worked out for evaluation of the training program conceived for the…

Policymakers are recognizing that Pennsylvania has fallen behind in providing equitable access to high quality early childhood education. Governor Tom Wolf ran on a campaign promise of universal pre-k access and proposed an unprecedented budget increase for early childhood programs in 2016. In Philadelphia, Mayor Jim Kenney has made pre-k a…

Evaluators have written about the need to consider context in conducting evaluations, but most such admonitions are broad. Context is not developed fully. This chapter reviews the evaluation literature on context and discusses the two areas in which context has been more carefully considered by evaluators: the culture of program participants when…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

There is growing interest in the concept of "mechanism" across many areas of the social sciences. In the field of program and policy evaluation, a number of scholars have also emphasized the importance of causal mechanisms for explaining how and why programs work. However, there appears to be some ambiguity about the meaning and uses of…