This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

Changing health-care climates mean evaluators need to provide findings within shorter time frames, but challenges remain in the creation of rapid research designs capable of delivering quality data to inform decision-making processes. We conducted a review of articles to grapple with these challenges and explore the ways in which rapid evaluations…

The second article in this series on the history of evaluation use has three sections. The first and longest develops a functional definition of the term "use," noting that a thorough definition of evaluation use includes the initial stimulus (i.e., evaluation findings or process), the user, the way people use the information, the aspect…

The relationship between theory and practice, or between theoretical knowledge and practical knowledge, is not a simple one, and rarely is it the case that theory is "applied" to practice. This paper aims to clarify the relationship by briefly discussing the nature of practical problems and the role that theoretical knowledge plays in…

Cost-effectiveness analysis is rarely used in education. When it is used, it often fails to meet methodological standards, especially with regard to cost measurement. Although there are occasional criticisms of these failings, we believe that it is useful to provide a listing of the more common concerns and how they might be addressed. Based upon…

The concept of assessment is one of the most important practices in any education system across the globe. Tracing the concept probably to the time immemorial through the Chinese Imperial Examination System in the fifteenth century, the notion of assessment seems to have proved to be one of the indispensable markers of selection, placement and…

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

The author argues that while outcomes assessment may be an imperfect process, if completed in a systematic and deliberative manner, it can help determine the overall direction, culture, and success of an academic department. Most important, assessment can spark meaningful pedagogical and curricular discussions that can lead to substantive academic…

In the present offering we challenge the presumption that the educational testing of students provides objective information about such students. This presumption largely rests on an empiricist account of science. In light of mounting criticism, however, empiricist foundationalism has given way to a social epistemology. From this standpoint,…

The Programme for International Student Assessment (PISA) was designed by the Organization for Economic Cooperation and Development (OECD) to evaluate the quality, equity, and efficiency of school systems around the world. Specifically, the PISA has assessed 15-year-old students' reading, mathematics, and science literacy on a 3-year cycle, since…

One of the simplest indicators of teaching or course effectiveness is student ratings on one or more global items from the entire rating scale. That approach seems intuitively sound and easy to use. Global items have even been recommended by a few researchers to get a quick-read, at-a-glance summary for summative decisions about faculty. The…

Principals and teachers do not use large-scale assessment results because the lack of distinct and reliable subtests prevents identifying strengths and weaknesses of students and instruction, the results arrive too late to be used, and principals and teachers need assistance to use the results to improve instruction so as to improve student…

The preceding articles in this issue describe a diverse range of projects which had in common the aim of implementing or improving the practice of formative assessment, and thereby to secure some of the benefits attributed to it. This article attempts to set up a framework within which each of the different studies may be located and…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…