Publication Date
| In 2025 | 1 |
| Since 2024 | 1 |
| Since 2021 (last 5 years) | 2 |
| Since 2016 (last 10 years) | 3 |
| Since 2006 (last 20 years) | 6 |
Descriptor
| Decision Making | 6 |
| English (Second Language) | 6 |
| Evaluators | 6 |
| Language Teachers | 6 |
| Second Language Instruction | 6 |
| Second Language Learning | 6 |
| Rating Scales | 4 |
| Essays | 3 |
| Foreign Countries | 3 |
| Oral Language | 3 |
| Scores | 3 |
| More ▼ | |
Author
| Barkaoui, Khaled | 1 |
| Davis, Lawrence Edward | 1 |
| Hsieh, Ching-Ni | 1 |
| Razi, Salim | 1 |
| Sahan, Özgür | 1 |
| Wu, Xuefeng | 1 |
| Yuichiro Yokouchi | 1 |
Publication Type
| Journal Articles | 4 |
| Reports - Research | 3 |
| Dissertations/Theses -… | 2 |
| Tests/Questionnaires | 1 |
Education Level
| Higher Education | 5 |
| Postsecondary Education | 3 |
Audience
Laws, Policies, & Programs
Assessments and Surveys
| Test of English as a Foreign… | 1 |
What Works Clearinghouse Rating
Peer reviewed
Direct linkYuichiro Yokouchi – Language Testing in Asia, 2025
The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…
Descriptors: Scoring Rubrics, Second Language Learning, Second Language Instruction, Language Teachers
Download full textWu, Xuefeng – English Language Teaching, 2022
Rating scales for writing assessment are critical in that they determine directly the quality and fairness of such performance tests. However, in many EFL contexts, rating scales are made, to certain extent, based on the intuition of teachers who strongly need a feasible and scientific route to guide their construction of rating scales. This study…
Descriptors: Writing Evaluation, Rating Scales, Second Language Learning, Second Language Instruction
Sahan, Özgür; Razi, Salim – Language Testing, 2020
This study examines the decision-making behaviors of raters with varying levels of experience while assessing EFL essays of distinct qualities. The data were collected from 28 raters with varying levels of rating experience and working at the English language departments of different universities in Turkey. Using a 10-point analytic rubric, each…
Descriptors: Decision Making, Essays, Writing Evaluation, Evaluators
Davis, Lawrence Edward – ProQuest LLC, 2012
Speaking performance tests typically employ raters to produce scores; accordingly, variability in raters' scoring decisions has important consequences for test reliability and validity. One such source of variability is the rater's level of expertise in scoring. Therefore, it is important to understand how raters' performance is influenced by…
Descriptors: Evaluators, Expertise, Scores, Second Language Learning
Barkaoui, Khaled – Language Testing, 2011
Think-aloud protocols (TAPs) are frequently used in research on essay rating processes. However, there are very few empirical studies of the completeness of TAP data and the effects of this technique on rater performance (i.e., rating processes and outcomes). This study aims to start to address this research gap. As part of a larger study on rater…
Descriptors: Protocol Analysis, Rating Scales, Essays, English (Second Language)
Hsieh, Ching-Ni – ProQuest LLC, 2011
Second language (L2) oral performance assessment always involves raters' subjective judgments and is thus subject to rater variability. The variability due to rater characteristics has important consequential impacts on decision-making processes, particularly in high-stakes testing situations (Bachman, Lynch, & Mason, 1995; A. Brown, 1995;…
Descriptors: Undergraduate Students, Phonology, Teaching Assistants, Foreign Students
