This study delves into writing scores in both tests, aiming to uncover the reasons behind score differences. Through comprehensive comparative analysis, this research explores scoring patterns, criteria, and score distributions in IELTS and PTE writing sections. It investigates sources of score variation, including task design, rating criteria,…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

The introduction of the CEFR was welcomed by researchers and practitioners in language education, given its potential for increasing transparency of test results and the meaningfulness of test scores. In this paper, I reflect on Glenn Fulcher's (2004, 2016) critical take on the use of the CEFR in the context of mapping (linking or aligning) test…

The quality of writing in a second language (L2) is one of the indicators of the level of proficiency for many college students to be eligible for departmental studies. Although certain software programs, such as Intelligent Essay Assessor or IntelliMetric, have been introduced to evaluate second-language writing quality, an overall assessment of…

This mixed methods study compared IELTS examiners' scores when assessing spoken performances under live and two 'non-live' testing conditions using audio and video recordings. Six IELTS examiners assessed 36 test-takers' performances under the live, audio, and video rating conditions. Scores in the three rating modes were calibrated using the…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

Testing organizations are faced with increasing demand to provide subscores in addition to the total test score. However, psychometricians argue that most subscores do not have added value to be worth reporting. To have added value, subscores need to meet a number of criteria: they should be reliable, distinctive, and distinct from each other and…

The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation…

The improvement of the quality of foreign language education is necessary to achieve subject-learning outcomes for the development of graduates' pertinent communication strategies in foreign language communication in various social situations. The research purpose is to develop the communicative strategies (CS) in foreign language (FL)…

This paper explores how Chinese academics, working in the field of English as Foreign Language Education in universities in China, conceptualise research quality. The paper uses a phenomenological approach and four qualitative methods (survey, interview, focus groups and document analysis) to investigate what a sample of these scholars perceive as…

This study examined the oral language skills of grade-two anglophone children enrolled in French Immersion and English-stream programs. The study had two objectives: (1) to compare performance between the groups on measures of receptive vocabulary, narrative comprehension, and narrative production (i.e., structure and language) in English; and (2)…

Evaluation is of paramount significance in the teaching and learning process. So is true with translation teaching and learning. This study uses in-depth interview to qualitatively examine in which ways the student translators and the professional trans-editor, two important stakeholders in the learning process, evaluate the work of translation.…

This literature review attempts to survey representative studies within the context of L2 speaking assessment that have contributed to the conceptualization of rater cognition. Two types of studies are looked at: 1) studies that examine "how" raters differ (and sometimes agree) in their cognitive processes and rating behaviors, in terms…

This study aimed at comparing two types of IELTS writing task 1 namely, bar charts and tables of Iranian test takers in terms of four IELTS writing assessment criteria including task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study also sought to identify test takers' strengths and weaknesses in the…