Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

The aim of this experiment was to investigate how glossing influences second language (L2) reading comprehension in relation to text difficulty and the two local and global meaning representations. Fifty-eight undergraduate students were asked to read three easy, moderate, and difficult texts and, following each passage, answer twenty…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

It is widely believed that human rating performance is influenced by an array of different factors. Among these, rater-related variables such as experience, language background, perceptions, and attitudes have been mentioned. One of the important rater-related factors is the way the raters interact with the rating scales. In particular, how raters…

This paper investigates what matters to medical domain experts when setting standards on a language for specific purposes (LSP) English proficiency test: the Occupational English Test's (OET) writing sub-test. The study explores what standard-setting participants value when making performance judgements about test candidates' writing responses,…

This study aims to investigate English as a foreign language (EFL) learners' use of context information under various noise conditions. The participants were seven Japanese undergraduate students. A noise test adopted from the Speech-Perception-in-Noise (SPIN) test (Kalikow et al., 1977) was used. Four signal-to-noise ratio (SNR) conditions (SNR =…

Educational societies encountered rapid development in all fields of knowledge, assisted by the invention of new technologies and development of linguistic systems. Over time, researchers contribute to design well known instructional models such as traditional-based and inquiry-based models. However, the previous literature investigations showed…

The paper reports on trends in language testing taking place over the years and aim at critical perspectives of testing and promoting inclusion, equity and justice. It begins with critical theories by Messick, Foucault and Bourdieu, leading to critical language testing (CLT) which focused on consequences and uses of tests. Given the power of tests…

The present experiment was composed of both qualitative and quantitative methods and aimed at investigating Reading Metacognitive Strategy Awareness (RMSA) and use by the aid of three inventory techniques including a questionnaire, a think-aloud protocol, and a Computerized RMSA System. The computerized system was specifically designed and…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

The goal of this study was to assess the relationships between computational approaches to analyzing constructed responses made during reading and individual differences in the foundational skills of reading in college readers. We also explored if these relationships were consistent across texts and samples collected at different institutions and…

The present study reports reading strategies of Arabic L1 EFL college-level learners at three reading ability levels: high, medium, and low. Thirty students were asked to take the reading section of the TOFEL to determine their reading abilities. Then two participants from each level were selected randomly to go through the think-aloud protocol…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Listen-to-summarize cloze (LSC) tasks are not rare in high-stakes language tests; however, we know little about what test-takers do during the tasks. In our study, we examined 16 students' think-aloud protocols (TAPs) which were recorded while they were completing two LSC tasks. The analysis of the 16 TAPs indicated iterative cognitive processes…