Whenever evaluations are done, there are antinomies of interests both within and between stakeholders. To account for such antinomies, taxonomy has been developed which will be presented and discussed using the peer review processes in university evaluations as example. The taxonomy contains four dimensions: a) seven values domains are…

This brief describes a new wave of state legislation, which emphasizes individual principal accountability as part of a broader educator talent-management strategy. The brief provides a snapshot of new state-level policy on principal evaluation and describes reasons for policy change as represented in state policy language and trends in policy…

The creative process is a multifaceted and dynamic path of thinking required to execute a project in design-based disciplines. The goal of this research was to test a model outlining the creative design process by investigating student experiences in a design project assignment. The study used an exploratory design to collect data from student…

This paper reports on an ongoing programme to develop new academic journal reviewers through mentoring. It analyses data from correspondence between experienced reviewer/mentors and new reviewer/mentees at an online journal. With the overlying objective of improving internal review quality, the mentoring programme has been initiated to raise…

Composition assessment scholars have exhibited uneasiness with the language of norming grounded in distaste for the psychometric assumption that achievement of consensus in a communal assessment setting is desirable even at the cost of individual pedagogical values. Responding to the problems of a "reliability" defined by homogenous agreement,…

Collaboration is a widely utilized strategy for addressing complex social issues and for facilitating organizational innovation and performance. Evaluators are uniquely positioned to empirically examine the development and effects of interagency and interprofessional collaboration. In this article, the authors present the Collaboration Evaluation…

This paper reviews a series of Greek myths put forward as cultural narratives that could be used as metaphors or interpretative similes for explanatory and evaluative purposes in educational research and evaluation. These myths have been used in educational research literature, and most of them were found by carrying out an exhaustive search of…

One of the challenges of developmental psychopathology is to determine whether identifiable pathways to developmental disorders exist in the first months or years of life. Early identification of such disorders poses a similar challenge for clinical services. Using data from a large contemporary birth cohort, we examined whether psychopathology at…

Adolescent sexual maturation is staged using Tanner criteria assessed by clinicians, parents, or adolescents. The physiology of sexual maturation is driven by gonadal hormones. We investigate Tanner stage progression as a function of increasing gonadal hormone concentration and compare performances of different raters. Fifty-six boys (mean age,…

This paper describes the profile of verbal response modes utilised in the expert application of Short-Term Dynamic Psychotherapy (STDP). One hundred and fifteen randomly selected segments from six treatments of STDP were analysed. Trained raters used a verbal response mode coding system to examine the individual speaking turns of an expert…

Rhode Island is committed to ensuring that all educators receive fair, accurate, and meaningful educator evaluations that provide information that can help all support professionals improve and refine their practice. This document describes the process and basic requirements for the Rhode Island Model Support Professional Evaluation and Support…

Background: Although there has been considerable research into the reliability of marking for the Key Stage 3 (KS3) National Curriculum tests (NCTs) and public examinations such as the General Certificate of Secondary Education examinations (GCSEs) in England, little is understood about the level of reliability of marking of the Key Stage 2 (KS2)…

Joseph S. Wholey is Professor Emeritus in the University of Southern California's (USC) School of Public Policy, Planning, and Development. He received his BA from Catholic University, Phi Beta Kappa and his MA in mathematics and PhD in philosophy from Harvard University. His work focuses on the use of strategic planning, performance measurement,…

Relevance helps identify to what extent a review's content pertains to that of the submission. Relevance metric helps distinguish generic or vague reviews from the useful ones. Relevance of a review to a submission can be determined by identifying semantic and syntactic similarities between them. Our work introduces the use of a word-order graph…

This paper reviews a selected sample of 24 doctoral dissertations in language assessment (broadly defined), completed between 2006 and 2011 in Canadian universities. These dissertations fall into five thematic categories: 1) reliability, validity and factors affecting test performance; 2) washback (impact) and ethics; 3) raters, rating and rating…