Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

The aim of this experiment was to investigate how glossing influences second language (L2) reading comprehension in relation to text difficulty and the two local and global meaning representations. Fifty-eight undergraduate students were asked to read three easy, moderate, and difficult texts and, following each passage, answer twenty…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

It is widely believed that human rating performance is influenced by an array of different factors. Among these, rater-related variables such as experience, language background, perceptions, and attitudes have been mentioned. One of the important rater-related factors is the way the raters interact with the rating scales. In particular, how raters…

This paper investigates what matters to medical domain experts when setting standards on a language for specific purposes (LSP) English proficiency test: the Occupational English Test's (OET) writing sub-test. The study explores what standard-setting participants value when making performance judgements about test candidates' writing responses,…

This study aims to investigate English as a foreign language (EFL) learners' use of context information under various noise conditions. The participants were seven Japanese undergraduate students. A noise test adopted from the Speech-Perception-in-Noise (SPIN) test (Kalikow et al., 1977) was used. Four signal-to-noise ratio (SNR) conditions (SNR =…

The present experiment was composed of both qualitative and quantitative methods and aimed at investigating Reading Metacognitive Strategy Awareness (RMSA) and use by the aid of three inventory techniques including a questionnaire, a think-aloud protocol, and a Computerized RMSA System. The computerized system was specifically designed and…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

The present study reports reading strategies of Arabic L1 EFL college-level learners at three reading ability levels: high, medium, and low. Thirty students were asked to take the reading section of the TOFEL to determine their reading abilities. Then two participants from each level were selected randomly to go through the think-aloud protocol…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

This article examines the test-taking strategies of high- and low-scoring Chinese-speaking participants when they answer English multiple-choice reading comprehension questions. Thirty-two participants took a TOEIC reading test, provided think-aloud protocols, and joined a post-task interview. The data come primarily from qualitative analysis and…

Background: Research studies (e.g., Phakiti, Language Testing 25(2):237-272, 2008a; Phakiti, Language Assessment Quarterly 5(1): 20-42, 2008b; Purpura, Learner strategy use and performance on language tests: a structural equation modeling approach, 1999) conducted on the construct validation of Bachman and Palmer's (1996) strategic competencehas…

This study aims to investigate patterns of variation in the interplay of L2 language ability and general reading comprehension skills in L2 reading, by comparing item-level effects of test-takers' results on L1 and L2 reading comprehension tests. The material comes from more than 500,000 people tested on L1 (Swedish) and L2 (English) in the…

Corpora are well-known for the affordance to make linguistic regularities salient. Since the coinage of the term 'data-driven learning' (DDL) in the 1990s, much has been done to investigate the effects of DDL on learning vocabulary, most notably lexico-grammatical patterns. However, less researched is how learners construct vocabulary knowledge…