The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

Listen-to-summarize cloze (LSC) tasks are not rare in high-stakes language tests; however, we know little about what test-takers do during the tasks. In our study, we examined 16 students' think-aloud protocols (TAPs) which were recorded while they were completing two LSC tasks. The analysis of the 16 TAPs indicated iterative cognitive processes…

Background: Research studies (e.g., Phakiti, Language Testing 25(2):237-272, 2008a; Phakiti, Language Assessment Quarterly 5(1): 20-42, 2008b; Purpura, Learner strategy use and performance on language tests: a structural equation modeling approach, 1999) conducted on the construct validation of Bachman and Palmer's (1996) strategic competencehas…

The literature on C-test and Cloze test in a second language provides us with few accounts of the real mental processes that test-takers are involved in, which in fact indicate the real nature of what these tests measure. However, the literature leaves researchers with little attention to the cognitive processes involved in X-Tests. Therefore, the…

In this article we present results of a Differential Item Functioning (DIF) study using Shealy and Stout's (1993) multidimensionality-based DIF analysis framework. In this framework, differences in test score distributions across different groups of examinees may be a result of multidimensionality if secondary dimensions (not the primary dimension…

This paper analyses how two multicompetent speakers engage with protocolling, i.e. verbalising their thoughts, while writing in two languages different from their first. The study explores how procedure- and language-related episodes of awareness affect both the writing process itself and the written product. The research draws on current issues…

The use of verbal report procedures as a research tool for gaining insight into the language learning process is discussed. Specifically, having second language students complete think-aloud protocols when they take cloze tests can provide useful information about what is being measured and how it has been learned. Use of such introspective…