Introduction: Evaluation of poorly performing physicians is a worldwide concern for licensing bodies. The College des Medecins du Quebec currently assesses the clinical competence of physicians previously identified with potential clinical competence difficulties through a day-long procedure called the Structured Oral Interview (SOI). Two peer…

Conducting evaluations that are both valid and ethical is imperative for the support and sustainability of programs that address underserved and vulnerable populations. A key component is to have evaluators who are knowledgeable about relevant cultural issues and sensitive to population needs. Hispanics in rural settings are vulnerable for many…

Social network analysis (SNA) is a methodological approach to measuring and mapping relationships. It can be used to study whole networks, all of the ties within a defined group, or connections that individuals have in their personal communities. The resulting graph-based structures illustrate the composition and effectiveness of networks on a…

This problem-based learning project focused on the need to enhance the capacity for leadership of building administrators in order to effectively evaluate teachers. Federal and state guidelines mandate highly qualified teachers in every classroom, and teacher evaluation is an important component to ensure qualified teachers are in the classroom.…

Maintaining standards over time is a much debated topic in the context of national examinations in the UK. This study used a pilot method to compare the demands, over time, of two examination units testing administration. The method involved 15 experts revising a framework of demand types and making paired comparisons of examinations from…

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

Purpose: The article reports on a study of school leader decision making that examined variation in the validity of teacher evaluation ratings in a school district that has implemented a standards-based teacher evaluation system. Research Methods: Applying mixed methods, the study used teacher evaluation ratings and value-added student achievement…

This paper presents a retrospective explanation as to how evaluation culture has been slowly incorporated into politics and public institutions in Spain during the last three decades. Evaluation, quality, and excellence are relevant concepts embedded in the design of current political programs. At this moment in history, it is important to ask,…

Psychological interventions provide linguistic data that are particularly useful for testing mechanisms of action and improving intervention methodologies. For this study, emotional expression in an Internet-based intervention for women with breast cancer (n = 63) was analyzed via rater coding and 2 computerized coding methods (Linguistic Inquiry…

Background: This article reports a study into the double marking of Liberal Studies in Hong Kong. This is now a compulsory subject in Hong Kong's Years 10-12 curriculum which, when first examined in the new Hong Kong Diploma of Secondary Education in 2012, will increase its candidature from its current 3,300 to 80,000. Aims: To examine the…

Think-aloud protocols (TAPs) are frequently used in research on essay rating processes. However, there are very few empirical studies of the completeness of TAP data and the effects of this technique on rater performance (i.e., rating processes and outcomes). This study aims to start to address this research gap. As part of a larger study on rater…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

Recent trends in Human Research Protection Programs (HRPPs) have contributed to the rising emphasis on prospective monitoring of clinical research and education programs. Therefore, internal efforts and resources to monitor investigator compliance and site performance have become an important focus in the conduct of clinical research. Once the…

Evaluators in the HPI field can improve their performance program results with effective evaluation through appreciative inquiry. Appreciative inquiry and evaluation have many similarities, and when combined they add value and effectiveness to the measurement of intervention results. Appreciative inquiry is beneficial in many evaluation contexts:…

In April 2007, more than 60 people--practitioners, advocates, funders, and evaluators--met for 2 days in Pittsburgh, Pennsylvania, to discuss the challenges that arise in evaluating systems change or systems-building initiatives and to suggest approaches to resolving those challenges. The symposium was convened by the partners of BUILD, a…