It is widely believed that human rating performance is influenced by an array of different factors. Among these, rater-related variables such as experience, language background, perceptions, and attitudes have been mentioned. One of the important rater-related factors is the way the raters interact with the rating scales. In particular, how raters…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

Self-perception, which mediates between knowledge and behavior, increasingly plays an important role in the determination of the ability to comprehend and respond to information on the Internet. Teachers need to gain insights about how EFL readers feel about themselves as readers in the Internet-based learning environment. There is a critical need…

This paper explores the approaches and strategies used by secondary school learners of different languages in England completing Asset Languages reading tasks at levels A1 and A2 of the Common European Framework of Reference (CEFR). Assessments across languages at the same level of proficiency were designed to a common specification and at…

Think-aloud protocols (TAPs) are frequently used in research on essay rating processes. However, there are very few empirical studies of the completeness of TAP data and the effects of this technique on rater performance (i.e., rating processes and outcomes). This study aims to start to address this research gap. As part of a larger study on rater…