Organizational evaluation policies describe how evaluation practices should be structured and implemented. As such, they provide key insights into organizational priorities and values regarding evaluation. However, the link between evaluation policies and how evaluation policies translate into concrete practices has seldom been explored until now.…

This article outlines a three-phase, team-based approach used to analyze qualitative data from a nation-wide needs assessment of access to Veteran Health Administration services for rural-dwelling veterans. The method described here was used to develop the trustworthiness of findings from analysis of a large qualitative data set, without the use…

Interest from Congress, executive branch leadership, and various other stakeholders for greater accountability in government continues to gain momentum today with government-wide efforts. However, measuring the impact of research programs has proven particularly difficult. Cause and effect linkages between research findings and changes to…

In this article the authors present the full interview conducted with George Grob in 2011 at the American Evaluation Association (AEA) Conference in Anaheim, CA. George Grob is former Director of the Office of Evaluation and Inspections in the Office of Inspector General. Prior to serving in that Office, he was Director of Planning and Policy…

Eleven years ago, this author became the director of the Idaho State Legislature's Office of Performance Evaluations. As only the second person in that role, he considered the office and its function to be still evolving and because he understood legislative leadership to be interested in seeing evaluation work that could actually…

The primary focus of this article is ''advocating for the results of a specific evaluation.'' To some extent, all evaluators are advocates, however the author notes, "there is no great mystery in how to use evaluations for advocacy, especially with respect to influencing policy making within federal and state…

The National Institutes of Health (NIH) is the largest source of funding for biomedical research in the world. Funding decisions are made largely based on the outcome of a peer review process that is intended to provide a fair, equitable, timely, and unbiased review of the quality, scientific merit, and potential impact of the research. There have…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

In Canada, in-depth evaluations of federal programs are intended to occur every 5 years. As such, evaluation is a periodic retrospective (lag) indicator examining results achieved versus program objectives. In a Canadian context, stand-alone evaluations have proved challenging to implement, time consuming, and not well adapted to annual management…

Organizational evaluation capacity building has been a topic of increasing interest in recent years. However, the actual dimensions of evaluation capacity have not been clearly articulated through empirical research. This study sought to address this gap by identifying the key dimensions of evaluation capacity in Canadian federal government…

The user perspective is an important contextual factor for Supreme Audit Institutions (SAIs). This article provides examples from performance audits in Norway and explores why the user perspective has become important in performance audit practices. It shows that user satisfaction can be employed as a key performance indicator of effectiveness of…

In 1997, American Evaluation Association member George Grob, now retired from the U.S. Department of Health and Human Services (HHS) and currently President of the Center for Public Program Evaluation, made a testimony on Medicare home health care fraud and abuse before the U.S. Senate Special Committee on Aging. The occasion was to announce the…

In recent years, there has been increasing attention to the importance of interagency collaboration for improving community well-being, environmental and public health, and educational outcomes. This article uses a mixed-methods approach including network analysis to examine the changes in interagency collaboration in one site funded by the Safe…

Evaluators sometimes wish for a Fairy Godmother who would make decision makers pay attention to evaluation findings when choosing programs to implement. The U.S. Department of Education came close to creating such a Fairy Godmother when it required school districts to choose drug abuse prevention programs only if their effectiveness was supported…

The laudatory goal of evaluation capacity building is quite timely, given the spotlight on the potential use of program evaluation in the current environment which emphasizes performance reporting and evidence-based policy. A question that quickly comes to mind is: Where do you start? A seemingly reasonable starting point is to assess…