Evaluators have opportunities to advance equity within evaluations, yet little research has examined whether and how evaluators center equity in evaluation practice. This paper explores whether and how evaluators in New England address inequities and advance equity throughout evaluation phases. The study uses a complementarity, sequential mixed…

This article introduces a set of evidence-based principles to guide evaluation practice in contexts where evaluation knowledge is collaboratively produced by evaluators and stakeholders. The data from this study evolved in four phases: two pilot phases exploring the desirability of developing a set of principles; an online questionnaire survey…

This study investigated the elicited imitation task (EIT) as a tool for measuring linguistic proficiency in a second/foreign (L2) language, focusing on French. Nonnative French speakers (n = 94) and native French speakers (n = 6) completed an EIT that included 50 sentences varying in length and complexity. Three raters evaluated productions on…

Objective: Work Place-Based Assessments (WPBAs) were introduced into psychiatry along with the new curriculum in 2005. The Royal College of Psychiatrists decided to pilot several WPBAs to ascertain their suitability. Method: Eight types of assessments (Case-Based Discussion, Assessment of Clinical Expertise, Mini-Assessed Clinical Encounter,…

This study used think-aloud protocols to compare essay-rating processes across holistic and analytic rating scales in the context of China's College English Test Band 6 (CET-6). A group of 9 experienced CET-6 raters scored the same batch of 10 CET-6 essays produced in an operational CET-6 administration twice, using both the CET-6 holistic…

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

Despite increasing interest in the integration of evaluative inquiry into organizational functions and culture, the availability of empirical research addressing organizational capacity building to do and use evaluation is limited. This exploratory descriptive survey of internal evaluators in Canada asked about evaluation capacity building in the…

Developing and using a design for teacher portfolio assessment is a complex process including several components: the domain to be assessed (the teacher competences), the content standards or criteria, the portfolio format, the completion of the format (by teachers) with content, and the scoring of the portfolios (by raters). For a portfolio…

This report is a product of an European Association for Quality Assurance in Higher Education (ENQA) Workshop "Assessing educational quality: Knowledge production and the role of experts" hosted by the Norwegian Agency for Quality Assurance in Education (NOKUT) in Oslo in February, 2008. The workshop gathered representatives from higher…

The Nigerian Government and other stakeholders invest heavily in Education. The Education system should therefore be held accountable to be sure that value is being given to justify the financial investments and the period of time spent schooling. This is only possible through the process of quality control of the Education system and it is…

How is the quality of teaching portfolios being assessed in summative assessment contexts? This question is of special importance in the growing debate on standards and criteria in assessment. In our study we looked for contexts in which portfolios are used for summative assessment purposes and gauge the issues raised by assessors with respect to…

Describes a structured set of procedures for critical script appraisal of nontheatrical scripts by carefully selected evaluators. An overview of the procedure, script reviewer qualities, the questionnaire's structure and objectives, and discussion of a sequence-by-sequence evaluation, script annotations, reviewer comments, and report preparation…

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

A checklist of characteristics of effective mail questionnaires was developed that reflects some degree of consensus among experts in survey research and that can serve as a guide to novices designing a questionnaire. Journal and book sources of information about mail questionnaires were reviewed to yield 83 items in 7 categories that comprised…

This research study examined the relationship between resume variables and an overall employment rating. The ratings were given by 136 superintendents or assistant superintendents evaluating four hypothetical secondary school principalship candidates' resumes. A clear relationship between the candidate resume variables and the overall employment…