This article compares two methods for detecting local item dependence (LID): residual correlation examination and Rasch testlet modeling (RTM), in a commonly used 3:6 matching format and an extended matching test (EMT) format. The two formats are hypothesized to facilitate different levels of item dependency due to differences in the number of…

Despite the vast research on test anxiety and test performance since the 1950s, studies on how students' English test anxiety affects their English proficiency test performance in the context of second- and foreign language learning remain few. Therefore, using a quantitative research design, this study explored students' English test anxiety and…

A growing number of studies have focused on uncovering linguistic and cognitive skills predictive of reading comprehension. Vocabulary knowledge (VK) and morphological awareness (MA) are two important linguistic variables for reading comprehension. In contrast, working memory (WM) is an essential cognitive variable for reading comprehension. The…

English-medium universities often accept scores from various English language proficiency (ELP) tests as evidence of ELP from non-English background students. This practice raises the question of how these tests compare in terms of their ability to predict academic achievement. This longitudinal study addresses this question by examining the…

This study investigated to what extent the scores of two English tests are correlated to each other, namely, the English test of the "Common Test for University Admissions" (Common Test, henceforth) in Japan and the "TOEIC Bridge", a commercially available English test developed by "Educational Testing Service" (ETS)…

Research has postulated a link between teachers' beliefs and agentic decisions. This study sought to investigate 215 Iranian EFL preservice teachers' conceptions of assessment, assessment agency, and the interrelationship between these two constructs. Using structural equation modeling, the results revealed that collaboration and reflection…

Based on theories on vocabulary knowledge, grammar knowledge, and reading comprehension subcomponents, ten attributes/subskills were defined for 50 items from relevant subtests of TEM4 (Band Four of Test for English Majors in China). Cognitive diagnosis was conducted on the TEM4 data of the randomly sampled 2285 examinees (roughly at the B2 level)…

In second language (L2) vocabulary studies there is continuing interest in tests of depth of vocabulary knowledge, measuring various aspects of word knowledge other than just the form--meaning link that is the focus of breadth (or size) tests. This study aimed to explore new formats that could be used as diagnostic tools for assessing depth of…

This study applied expectancy-value theory (EVT) to examine the impact of diagnostic language assessment (DLA) on the learning activities of a group of Chinese learners of English as a foreign language (EFL). A model of test impact on learning was conceptualized by integrating EVT and DLA theories. Structural equation modeling (SEM) was performed…

The purpose of this study was to investigate the role of breadth and depth of vocabulary knowledge in reading comprehension at Debre Markos University. A quantitative approach was taken to gather and analyze the data. Out of 235 students learning at the college, 61 samples were taken randomly. To investigate their knowledge of vocabulary breadth,…

This is one of the first studies of the mismatch between students' test scores and teachers' estimations of those scores in low- and middle-income countries. Prior studies in high-income countries have found strong correlations between these metrics. We leverage data on actual and estimated scores in math and language from India and Bangladesh and…

This evaluation report examines extensive reading (ER) speed and words read by students at a Japanese university using a digital ER platform called Xreading and compares them to standardized test reading performance using the International English Language Testing System (IELTS). The study focuses on first- and second-year students who…

This article outlines the development of a 16-item instrument for measuring language learner's foreign language self-efficacy (SE) concerning their speaking and listening skills through repeated administrations to groups of Japanese tertiary students. Responses were analysed through the Rasch model, which allows researchers to investigate…

Cloze tests are commonly used in language testing as a quick measure of overall language ability or reading comprehension. A problem for the analysis of cloze tests with item response theory models is that cloze test items are locally dependent. This leads to the violation of the conditional or local independence assumption of IRT models. In this…

This study investigated how input frequency (i.e., type frequency and token frequency) and proficiency levels enhanced the perception of English nominal suffixes by first language (L1) Thai learners. Based on the Usage-based Account (Tomasello, 2003), it was hypothesized that input frequency, i.e., token frequency (frequency of derived forms…