The Impact Agenda, introduced with Research Excellence Framework 2014 (REF), constituted a revolution in research evaluation in the UK. 'Research impact' (impact of scholarly work outside of academia) became one of three profiles under which research quality is evaluated. This shift in the British evaluation system was followed, and often…

With the push for evidence-informed policy and practice, schools and policy makers are now increasingly encouraged and supported to use and enagage with research evidence. This means that consumers of research will now need to be discerning in judging the quality of research evidence that will inform their decisions. This paper evaluates the…

A synthesis of the state of the literature is discussed in this section of the Evaluation Capacity Building (ECB) forum organized around four critical questions: (1) What is ECB? (2) How can we make it happen? (3) How do we know it is happening? and (4) What is its impact? The authors argue that to move the field of ECB forward we need to envision…

Teacher training programs are increasingly being held under the microscope. Perhaps the most notable of recent calls to reform was the 2009 declaration by U.S. Education Secretary Arne Duncan that "by almost any standard, many if not most of the nation's 1,450 schools, colleges, and departments of education are doing a mediocre job of…

Implementation refers to the process by which an intervention is put into practice. Research studies across multiple disciplines, including education, have consistently demonstrated that interventions are rarely implemented as designed and, crucially, that variability in implementation is related to variability in the achievement of expected…

Today, nearly forty years after writing centers first began to proliferate, it is worthwhile to reflect on the themes that emerge from empirical material surrounding writing center assessments, for reflecting on these themes may help administrators to refine current assessment practices and scholars to redirect their research. The goal of this…

Surveys and benchmarks continue to grow in importance for community colleges in response to several factors. One is the press for accountability, that is, for colleges to report the outcomes of their programs and services to demonstrate their quality and prudent use of resources, primarily to external constituents and governing boards at the state…

This paper investigates the use of new media technologies, in particular wikis, for the compiling and grading of group assessment tasks. Wikis are open web pages that can be viewed and modified by anyone with internet access and are well known for their collaborative nature. Wikis are also transparent, which means that any edit/modification is…

The purpose of this paper is to provide a basis for judging the adequacy of evaluation plans or, as they are commonly called, evaluation designs. The authors assume that using the procedures suggested in this paper to determine the adequacy of evaluation designs in advance of actually conducting evaluations will lead to better evaluation designs,…

Every university and nonprofit in the country is interested in raising more money. Many universities spend millions of dollars to hire experienced staff, build databases, and pay for prospect travel. The question becomes, What is the return on investment? With significant and sometimes drastic budget cuts, university programs are increasingly…

A critical theory lens is used to explore the role of evaluation in youth development, a field aimed at recognizing youth as assets. A theory of change in the field is questioned for its emphasis on individual youth outcomes as programmatic outcome measures. A review of 209 evaluations of 131 programs in the Harvard Family Research Project's…

Increasing numbers of empirical studies and theoretical frameworks for preventing sexual violence are appearing in the research- and practice-based literatures. The consensus of this work is that although important lessons have been learned, the field is still in the early stages of developing and fully researching effective models, particularly…

The objective of this evaluation research was to assess the impact of programs intended to support the enforcement component of a comprehensive youth tobacco control. The research method was a survey of a randomly stratified cluster sample of law enforcement officers. Results of the evaluation showed that the enforcement behaviors of officers were…

I define a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, including comparisons that are relatively unknown in both the literature and practice. I then assess the relative merit, worth, and value of all possible comparisons based on the…

Never before in the history of the teaching profession has there been such a need for comprehensive evaluation of all teacher preparation programs, most especially professional development schools (PDSs). This need is driven not only by the pressures of the age of accountability, but also by the need for the PDS movement to act ethically and…