There is a lively discussion on how to evaluate competence-based higher education in both evaluation and competence research. The instruments used are often limited to course evaluation or specific competences, taking a rather narrow perspective. Furthermore, the instruments often comprise predetermined competences that cannot be adapted to higher…

Purpose: In the higher education sector, the evaluation of learning and teaching projects is assuming a role as a quality and accountability indicator. The purpose of this paper is to investigate how learning and teaching project evaluation is approached and critiques alignment between evaluation theory and practice. Design/Methodology/Approach:…

The purpose of this study is to extend the work of Spybrook and Raudenbush (2009) and examine how the research designs and sample sizes changed from the planning phase to the implementation phase in the first wave of studies funded by IES. The authors examine the impact of the changes in terms of the changes in the precision of the study from the…

Schools are held more responsible for evaluating, quality assuring and improving their student assessments. Teachers' lack of understanding of new, competence-based assessments as well as the lack of key stakeholders' involvement, hamper effective and efficient self-evaluations by teachers of innovative, competence-based assessments (CBAs). While…

This article is third in a series of exemplary cases under the two current section editors. The first two cases (Brandon, Smith, Trenholm, & Devaney, 2010; Smith, Brandon, Lawton, & Krohn-Ching, 2010) profiled evaluations that had been designated as exemplary by professional associations. The present case profiles an evaluation organization:…

Lyle F. Bachman is Professor, Department of Applied Linguistics, University of California, Los Angeles. He is a past president of the American Association for Applied Linguistics and of the International Language Testing Association. He has published numerous articles and books in the areas of language testing, program evaluation, and second…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

Evaluation researchers and practitioners acknowledge that involving stakeholders in the planning and implementation of an evaluation increases buy-in, understanding, and use. With the recent increase in multi-site evaluations of large federal programs, evaluators must think differently about how to encourage meaningful collaboration by…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

The purpose of this study was to assess staff and client perspectives on the Internet-based Journey Mapping program evaluation tool. A drug court program was chosen for a case study research design. Six staff and 10 clients participated in interviews and observations, and also responded to a questionnaire. A staff survey provided additional data.…

Charter Theatre is a small professional theatre in Washington, DC. Its mission is to develop and produce new plays. Like other organizations, Charter Theatre wants to be accountable. Its members saw early the need for evaluation--a repeatable process to assure the quality of their work, and have infused their development process with evaluation.…

Background: Research on evaluation use focuses on putting evaluation recommendations into practice. Prior theoretical research proposes varied frameworks for understanding the use (or lack) of program evaluation results. Purpose: Our purpose is to create and test a single, integrated framework for understanding evaluation use. This article relies…

The role of nonprofit human service executive directors in their organizations' program evaluation process is described. Recognizing that the leader's perspective from within the organization is fundamental to building capacity for and utilizing program evaluation, this study examines 42 executive directors to determine how they view program…

This article presents an interview with Michael Patton whose professional evolution has contributed to the way evaluation in the United States is understood and practiced today. Patton is an evaluation and organizational development consultant who spent 18 years at the University of Minnesota (1973-1991), including 5 years as the director of the…

In participatory evaluations of K-12 programs, evaluators develop school faculty's and administrators' evaluation capacity by training them to conduct evaluation tasks and providing consultation while the tasks are conducted. A strong case can be made that the capacity building in these evaluations can be examined using a Vygotskian approach. We…