Automated essay scoring tools are often criticized on the basis of construct validity. Specifically, it has been argued that computational scoring algorithms may be unaligned to higher-level indicators of quality writing, such as writers' demonstrated knowledge and understanding of the essay topics. In this paper, we consider how and whether the…

This article reports on an investigation of the role raters' language background plays in raters' assessment of test takers' speaking ability. Specifically, this article examines differences between American and Indian raters in their scores and scoring processes when rating Indian test takers' responses to the Test of English as a Foreign…

This publication provides a quality framework to provide a structure for external review of Modern Apprenticeship off-the-job training.? The indicators in this framework are arranged under three key principles, addressing five questions which Education Scotland is adopting for evaluation purposes. These are underpinned by a wider principle on the…

Our objective was to investigate the impact of the Science Writing Heuristic (SWH) on undergraduates' ability to express logical conclusions and include appropriate evidence in formal writing assignments. Students in three laboratory sections were randomly allocated to the SWH treatment ("n"?=?51 students) with another three sections…

Purpose: This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency training in a health care setting. It furthermore investigates if and how different levels of assessor expertise influence feedback characteristics.…

For over 20 years, researchers and evaluators worldwide have criticised the traditional formula of family learning courses for their narrow vision, and have emphasised their potential to provide a bridge between home and school experiences, building on resources that parents already have, but which are unknown or unacknowledged. This article…

Racial minority evaluators increase the democratic capacity and potential of institutions to the extent that they draw on their experiences and those of other marginalized communities. Their reflection on these experiences helps to disclose institutional power dynamics that are often veiled in neutrality. Of course, this depends on sound…

The benefits of providing early intervention services (including multidisciplinary therapy and family support) for children with physical disabilities and their families are widely acknowledged. Evidence, however, of their efficacy is not well documented. Furthermore, many studies fail to adequately describe the programs being evaluated and how…

English language learning (ELL) websites and digital resources have been recognized as an important source of linguistic and cultural knowledge for English as a foreign language (EFL) learners to explore. The up-to-date information carried by authentic materials is invaluable for learners to develop an understanding of the target language/culture.…

Rhode Island educators believe that implementing a fair, accurate, and meaningful educator evaluation and support system will help improve teaching, learning, and school leadership. The primary purpose of the Rhode Island Model Building Administrator Evaluation and Support System (Rhode Island Model) is to help all building administrators improve.…

Evaluation is an important tool to develop and retain skilled employees. It should be used to recognize employees that are performing well, to identify areas for growth and to provide employees with clear, explicit feedback about their performance. An agreed upon appraisal system lets employees know what is expected, what is recognized and…

Previous research has argued that fundamental frequency is a critical component of phonetic accommodation. We tested this hypothesis in an auditory naming task with two conditions. Participants in an Unfiltered Condition completed an auditory naming task with a single male model talker. A second group of participants was assigned to a Filtered…

In the absence of photographic or DNA evidence, a credible eyewitness, or perpetrator confession, forensic evaluators in cases of alleged child sexual abuse must rely on psychosocial or "soft" evidence, often requiring substantial professional judgment for case determination. This article offers a three-part rebuttal to Herman's (2009) argument…

This study investigates the potential for linguistic microfeatures related to length, complexity, cohesion, relevance, topic, and rhetorical style to predict L2 writing proficiency. Computational indices were calculated by two automated text analysis tools (Coh- Metrix and the Writing Assessment Tool) and used to predict human essay ratings in a…

This policy analysis project focused on state-level education policy which lacks evaluator training as well as on requirements for research-based best practices. Due to federal mandates and funding as well as accountability to all stakeholders, states are adopting more rigorous evaluation systems. These high-stakes evaluation systems are putting…