This essay engages questions of evaluator role and indigenous peoples participation in evaluation within colonial and decolonization contexts. Specifically, I critique the Western emphasis on cultural competence and contrast the utility of "mainstream" evaluation approaches alongside three indigenous inquiry models (Te Kotahitanga,…

Weaknesses in the nature of rater judgments are generally considered to compromise the utility of workplace-based assessment (WBA). In order to gain insight into the underpinnings of rater behaviours, we investigated how raters form impressions of and make judgments on trainee performance. Using theoretical frameworks of social cognition and…

The present article addresses the issue of second language accuracy developmental trajectories and shows how they can be captured via an error-tagged version of an English as a Foreign Language (EFL) learner corpus. The data used in this study were extracted from the International Corpus of Learner English (Granger et al., 2009) and consist of a…

Researchers have expressed concern about "implementation" fidelity in intervention research but have not extended that concern to "assessment" fidelity, or the extent to which pre-/posttests are administered and interpreted as intended. When studying reading interventions, data gathering heavily influences the identification of…

If Christian schools desire students to achieve higher-level thinking, then the textbooks that teachers use should reflect such thinking. Using Risner's (1987) methodology, raters classified questions from two Christian publishers' fifth grade reading textbooks based on the revised Bloom's taxonomy (Anderson et al., 2001). The questions in the A…

This paper considers how to establish the minimum required level of professionally relevant oral communication ability in the medium of English for health practitioners with English as an additional language (EAL) to gain admission to practice in jurisdictions where English is the dominant language. A theoretical concern is the construct of…

This study sought to examine the development of paragraph writing skills of 116 English as a second language university students over the course of 12 weeks and the relationship between the linguistic features of students' written texts as measured by Coh-Metrix--a computational system for estimating textual features such as cohesion and…

The analysis of raters' comments on pragmatic assessment of L2 learners is among new and understudied concepts in second language studies. To shed light on this issue, the present investigation targeted important variables such as raters' criteria and rating patterns by analyzing the interlanguage pragmatic assessment process of the Iranian…

We investigated the effects of expressive and unexpressive conducting on secondary school band members' and experts' audio evaluations of band performance expressivity. A conductor, who demonstrated either expressive or unexpressive conducting techniques, led both an eighth-grade and a high school band in four separate "run-throughs" of…

This study examined the reliability and validity of the Classroom Assessment Scoring System-Secondary (CLASS-S) in Finnish classrooms. Trained observers coded classroom interactions based on video recordings of 46 Grade 6 classrooms (450 cycles). Concurrent associations were investigated with respect to teacher self-ratings (e.g., efficacy beliefs…

The main objective of this article is to demonstrate with the help of learner corpus data the practical relevance of the phraseological dimension of language for writing assessment in higher education. Phraseological competence is now widely recognized as an important part of fluent and idiomatic language use, but its development has not received…

The Consensual Assessment Technique (CAT) is a common creativity assessment. According to this technique, the best judges of creativity are qualified experts. Yet what does it mean to be an expert in a domain? What level of expertise is needed to rate creativity? This article reviews the literature on novice, expert, and quasi-expert creativity…

We explore how a local rating scale can be based on the Common European Framework CEF-proficiency scales. As part of the scale validation (Alderson, 1991; Lumley, 2002), we examine which adaptations are needed to turn CEF-proficiency descriptors into a rating scale for a local context, and to establish a practicable method to revise the initial…

The use of technology in the evaluation of higher education programs is a mainstay. Physical evidence rooms, face-to-face interviews, and reviewing of documentation on site have become obsolete. Relying on the heavy use of technology in the evaluation process has allowed what some believe to be a more cohesive, streamlined approach to the…

Recent studies suggest that the quality of reflective practice being achieved in educational settings is inadequate. Our study aims to determine the level of reflection present in written student reflections in a nonprofessional undergraduate course. We also seek to explore student and instructor perspectives on the value of reflective practices.…