Drawing on 95 text histories from a longitudinal project on writing for publication in 4 national contexts, this article analyses the language ideologies enacted in referees' and editors' comments on articles submitted for publication in English-medium "international" journals. It considers how orientations to "English,"…

This study is an attempt to classify raters according to their weighting patterns and explore systematic differences between rater types in the rating process. In the context of an EFL speaking test, 126 raters were classified into three types--form-oriented, balanced, and content-oriented--through cluster analyses of their weighting patterns…

Randomized controlled trials are the gold standard in research but may not fully explain or predict outcome variations in community-based interventions. Demonstrating efficacy of externally driven programs in well-controlled environments may not translate to community-based implementation where resources and priorities vary. A bottom-up evaluation…

Despite the acknowledged importance of assessment in education, there has been minimal research into the preparation of preservice teachers for the important role of involving preservice teachers in marking, grading, moderating and providing feedback on student work. This article reports on a pilot project in which preservice teachers participated…

The scoring of constructed responses may introduce construct-irrelevant factors to a test score and affect its validity and fairness. Fatigue is one of the factors that could negatively affect human performance in general, yet little is known about its effects on a human rater's scoring quality on constructed responses. In this study, we compared…

This study investigated the application of "WriteToLearn" on Chinese undergraduate English majors' essays in terms of its scoring ability and the accuracy of its error feedback. Participants were 163 second-year English majors from a university located in Sichuan province who wrote 326 essays from two writing prompts. Each paper was…

While the research literature on second language (L2) fluency is replete with descriptions of fluency and its influence with regard to English as an additional language, little is known about what fluency features influence judgments of fluency in L2 French. This study reports the results of an investigation that analyzed the relationship between…

This study investigated L2 leaners' preferences between native-speaking teachers (NST) and non-native-speaking teachers (NNST) as their English pronunciation teacher, and examined the participants' accentedness and comprehensibility in L2-English pronunciation after being taught by a NST and a NNST. The participants were 30 undergraduates who were…

Evaluator training field experiences seek to reinforce applicable content knowledge and promote applied skills. For students, even a small-scale field experience focusing on limited components of a larger evaluation process can seem particularly challenging. Students often do not recognize the relevance of established evaluation resources capable…

Although some argue that distinctions between "evaluation" and "development evaluation" are increasingly superfluous, it is important to recognize that some distinctions still matter. The severe vulnerabilities and power asymmetries inherent in most developing country systems and societies make the task of evaluation…

This article provides an introduction to geographic information systems (GIS) and how the technology can be used to enhance evaluation practice. As a tool, GIS enables evaluators to incorporate contextual features (such as accessibility of program sites or community health needs) into evaluation designs and highlights the interactions between…

American post-secondary education faces unprecedented challenges in the dynamic 21st century environment. An appreciation of the higher education accreditation process, as a quality control mechanism, therefore may be seen as a significant priority. When American higher education is viewed systemically, the perceptions of quality held and…

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

Over the last decade, teacher evaluation has moved onto center stage in efforts to strengthen schooling. In this article, we address the question of whether focusing on this administrative process is likely to accomplish what reformers hope. We answer that question by examining the available evidence, both direct and indirect. We deepen the…

This paper reports on the effects of a graduate course on teaching and learning on graduate teaching assistants' conceptions of teaching and on the teaching philosophy statements that arose from those conceptions. Effects are interpreted from three perspectives: 1) course facilitators' reports of their perceptions of course participants'…