Interest from Congress, executive branch leadership, and various other stakeholders for greater accountability in government continues to gain momentum today with government-wide efforts. However, measuring the impact of research programs has proven particularly difficult. Cause and effect linkages between research findings and changes to…

This paper provides insights into the evaluation of educational research in order to strengthen research projects and increase the quality of evidence about what works to improve student learning from the lens of science, technology, engineering, and mathematics (STEM) education. In particular, TEAMS hopes this publication will increase the…

Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its…

The paper draws on a series of Australian Research Council (ARC) projects aimed at understanding better the process of doctoral examination. The early phase focussed on the Australian doctorate, which functions without a Viva, while the later phase was concerned with comparing the earlier findings with analysis of the United Kingdom (UK) and New…

In recent years, an increasing number of research projects have been dedicated to competency assessment not only in school and vocational education, but also in higher education (Blömeke, Zlatkin-Troitschanskaia, Kuhn, & Fege, 2013). Compared to competency assessment in schools, competency assessment in higher education still is…

The push for accountability in public schooling has extended to the measurement of teacher performance, accelerated by federal efforts through Race to the Top. Currently, a large number of states and districts across the country are computing measures of teacher performance based on the standardized test scores of their students and using them in…

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for…

This paper gives an overview of research on modelling science competence in German science education. Since the first national German educational standards for physics, chemistry and biology education were released in 2004 research projects dealing with competences have become prominent strands. Most of this research is about the structure of…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

This article examines the importance of context in evaluative inquiry. Following guidelines from real-world and utilization-focused evaluation frameworks, four projects are described to illustrate one foundation's pragmatic approach to evaluation that values collaboration, methodological appropriateness, and utilization. The authors contend that…

Purpose: The paper aims to describe the application of two key service quality frameworks for improving the delivery of postgraduate research supervision. The services quality frameworks are used to identify key areas of overlap between services marketing practice and postgraduate supervision that can be used by the supervisor to improve research…

The model allows for the determination of the severity of the training problems, thus leading naturally to problem priority and in addition a basis for evaluation design. Results from the use of the model, in an operational setting, are presented. (Author)

This article uses the political struggles that have enveloped the research assessment exercises (RAEs) to interpret the UK's current funding council model of governance. Ironically, the apparently widespread improvement in the research performance of British universities, as demonstrated by RAE 2001, has made it more difficult to distribute…

Reviews the state of the art in performance measures and assessment processes in program evaluation before the passage of the Government Performance and Results Act (GPRA), and discusses difficulties in fitting these practices into the GPRA format. Presents a simple logic model for evaluating research programs. (SLD)

Evaluation of the effectiveness of community based storefront drug treatment prevention agencies is generally lacking in the literature. A five step procedure is outlined as a model for evaluation of such agencies. (Author)