This study aims to examine whether differences exist in the factors influencing the difficulty of scoring English summaries and determining scores based on the raters' attributes, and to collect candid opinions, considerations, and tentative suggestions for future improvements to the analytic rubric of summary writing for English learners. In this…

The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously,…

This large-scale study used a survey to collect data on K-12 world language program leadership and instructional practices in Massachusetts public schools, investigating associations between the presence of a program leader or primary evaluator who is a world language specialist and instructional practices, curriculum, and assessment. The study…

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students' writing using prompts and pre-defined rubrics compared to human raters.…

This systematic review examines 22 studies (2024-2025) on the use of generative AI, primarily ChatGPT, for providing feedback in English writing instruction for language learners. It identifies the types of feedback AI offers, its effectiveness relative to teacher and peer feedback, and perceptions from students and teachers. Findings show AI…

John Read is about to retire as Professor in Applied Language Studies at the University of Auckland. He previously taught applied linguistics, Teaching English to Speakers of Other Languages (TESOL) and English for Academic Purposes (EAP) at Victoria University of Wellington, the SEAMEO Regional Language Centre, the University of Texas El Paso,…

Rating scales for writing assessment are critical in that they determine directly the quality and fairness of such performance tests. However, in many EFL contexts, rating scales are made, to certain extent, based on the intuition of teachers who strongly need a feasible and scientific route to guide their construction of rating scales. This study…

Recent technology advancements have increased the prospects for automated spoken language technology to provide feedback on speaking performance. In this study we examined user perceptions of using an automated feedback system for preparing for the TOEFL iBT® test. Test takers and language teachers evaluated three types of machine-generated…

Through Many-Facet Rasch analysis, this study explores the rating differences between 1 computer automatic rater and 5 expert teacher raters on scoring 119 students in a computerized English listening-speaking test. Results indicate that both automatic and the teacher raters demonstrate good inter-rater reliability, though the automatic rater…

In this paper we report on a project in which we developed tools to support the classroom assessment of learners' interactional competence (IC) and provided learning oriented feedback in the context of preparation for a high-stakes face-to-face speaking test. Six trained examiners provided stimulated verbal reports (n = 72) on 12 paired…

Recent investigations into language assessment literacy (LAL) suggest that stakeholder groups might differ in interests, needs, and expectations in assessment practice, resulting in different LAL profiles. This qualitative study furthers this line of research by examining the effect of contextual and experiential factors on the LAL profiles and…

Researchers have found numerous differences in the approaches raters take to the complex task of essay rating including differences when rating native (L1) and non-native (L2) English writing. Yet less is known about raters' reading practices while scoring those essays. This small-scale study uses eye-tracking technology and reflective protocols…

The concept of the "native speaker" (NS) remains a constant interest in the field of language pedagogy due to the need the field has for models, goals and norms (Davies, 2003, p. 1). On the other hand, some other researchers such as Byram (1997) in his model of intercultural competence (ICC) and Cook (2012) in his model of…

The rapid increase of English-medium instruction (EMI) programs across Europe has raised concerns regarding the oral competencies of nonnative English speaking lecturers and the implications for the quality of teaching. Consequently, lecturers' English proficiency is under scrutiny and universities are implementing internal assessment procedures.…

Teacher beliefs are an important area of inquiry because research has found that these beliefs are often diverse (Breen et al., 2001) and strongly impact classroom practices (Borg, 1998, 2003; Burns, 1992; Farrell & Bennis, 2013). Therefore, uninformed teacher beliefs could be to the detriment of the L2 learner. Despite the fact that knowledge…