The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…

Previous research that explores the effect of ethnicity in the perception of speaker accentedness and personality traits often finds that Asian appearance contributes to a more accented and less competent impression. Importantly, most of the work done to date employed only Caucasian first language-speaking listeners; moreover, ethnicity and gender…

The investigators sought to determine whether education evaluators, mainly school psychologists, complied with federal, state, and professional practice guidelines when assessing English learning (EL) school-aged children suspected of a learning disability in three northern California school districts. In accordance with the Individuals with…

In the process of measuring and assessing high-level cognitive skills, interference of rater errors in measurements brings about a constant concern and low objectivity. The main purpose of this study was to investigate the impact of rater training on rater errors in the process of assessing individual performance. The study was conducted with a…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

The use of translation and interpreting (T&I) in the language learning classroom is commonplace, serving various pedagogical and assessment purposes. Previous utilization of T&I exercises is driven largely by their potential to enhance language learning, whereas the latest trend has begun to underscore T&I as a crucial skill to be…

This study investigates the effect of explicit teaching of segmentals vs. prosody on the quality of interpreting by Farsi-to-English interpreter trainees. Participants were native speakers of Farsi and BA students of English translation and interpreting in Iran, who were assigned to one of three groups. No differences in English language skills…

The quality of sign language interpreting (SLI) is a gripping construct among practitioners, educators and researchers, calling for reliable and valid assessment. There has been a diverse array of methods in the extant literature to measure SLI quality, ranging from traditional error analysis to recent rubric scoring. In this study, we want to…

Rater subjectivity has long been an intriguing topic. The use of discussion as a resolution method is a practical way to reduce this subjectivity. However, the efficacy of discussion depends on whether different raters get equally engaged in it or one rater tends to dominate others. This study investigated whether and how rater dominance occurs in…

As a form of aptitude testing for interpreting, recall across languages has long been considered as a valid means of assessing candidates' linguistic, cognitive and communicative abilities. However, most of the existing research on this topic is only derived from the consensus among or the professional experience of interpreting researchers,…

This study took a dynamic approach to second language (L2) comprehensibility, examining how listeners construct comprehensibility profiles for L2 Spanish speakers during the listening task and what features enhance or diminish comprehensibility. Listeners were 24 native Spanish speakers who evaluated 2-5 minute audio clips recorded by three…

This literature review attempts to survey representative studies within the context of L2 speaking assessment that have contributed to the conceptualization of rater cognition. Two types of studies are looked at: 1) studies that examine "how" raters differ (and sometimes agree) in their cognitive processes and rating behaviors, in terms…

This study was designed to determine how well existing analytic rating scales functioned in the assessment of low- to mid-proficiency Japanese university students' interactive English speaking ability when engaged in small group discussions. Many-facet Rasch measurement (MFRM) was employed to evaluate the quality of adapted rating scales for…

In the light of continuous change of global perspectives, current educational contexts have been evolving to cover the necessary 21st century skills that the individuals must acquire. Two of the 4Cs (creativity, critical thinking, collaboration and communication) of the 21st century educational trends; creativity and creative thinking are the key…

The implementation of the European Union's Erasmus Plus (E+) Program has resulted in the possibility of joint initiatives across-borders led by teachers of English as a Foreign Language (EFL), who can bring classroom practice closer to education as a key area for employability and prepare students for work and communication in multicultural and…