While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

Although the IELTS speaking test assesses English verbal-communication competence accurately and reliably, its traditional, retroactive scoring framework stops short of providing detailed diagnostic information about individual test-takers' specific domains of proficiency or deficiency. This study employed a cognitive diagnostic assessment (CDA)…

Despite extensive research on assessing collocational knowledge, valid measures of academic collocations remain elusive. With the present study, we employ an argument-based approach to validate two Academic Collocation Tests (ACTs) that assess the ability to recognize and produce academic collocations (i.e., two-word units such as "key…

Research has postulated a link between teachers' beliefs and agentic decisions. This study sought to investigate 215 Iranian EFL preservice teachers' conceptions of assessment, assessment agency, and the interrelationship between these two constructs. Using structural equation modeling, the results revealed that collaboration and reflection…

This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

Language learning activities involving time-pressured repetition of similar content have been shown to facilitate improvements in fluency. However, concerns have been voiced about whether these gains might be offset by reduced levels of grammatical accuracy. This descriptive study tracked the oral proficiency of 32 Japanese university students…

The measurement of test-taking strategies and practices, mostly studied through qualitative methods, has been an important aspect of language testing and assessment research. The current study examines the test-taking strategies of International English Language Testing System (IELTS) test-takers and reports the process of designing and validating…

Research in validity suggests that stakeholders' interpretation and use of test results should be an aspect of validity. Claims about the meaningfulness of test score interpretations and consequences of test use should be backed by evidence that stakeholders understand the definition of the construct assessed and the score report information. The…

This study investigated the relationship between changes in language learning beliefs and English proficiency among 41 Korean university students who participated in a short-term English program. Participants' beliefs were assessed using the Beliefs About Language Learning Inventory (BALLI), and their proficiency was measured using the Test of…

The current paper intends to exploit the Many Facet Rasch Model to investigate and compare the impact of situations (items) and raters on test takers' performance on the Written Discourse Completion Test (WDCT) and Discourse Self-Assessment Tests (DSAT). In this study, the participants were 110 English as a Foreign Language (EFL) students at…

This study applied expectancy-value theory (EVT) to examine the impact of diagnostic language assessment (DLA) on the learning activities of a group of Chinese learners of English as a foreign language (EFL). A model of test impact on learning was conceptualized by integrating EVT and DLA theories. Structural equation modeling (SEM) was performed…

In the field of second language assessment, there is limited empirical research on the alignment of different language proficiency standards. This study aims to establish level correspondences for overall language proficiency between China's Standards of English Language Ability (CSE) and the Common European Framework of Reference for Languages…

This study used Latent Growth Curve Modeling (LGCM) to examine the overtime patterns of the score and test-taking strategy changes in an international high-stakes standardized proficiency test. To this end, the test records of 178 Iranian IELTS repeaters were analyzed, using close- and open-ended questionnaires to measure test scores as a function…

This article outlines the development of a 16-item instrument for measuring language learner's foreign language self-efficacy (SE) concerning their speaking and listening skills through repeated administrations to groups of Japanese tertiary students. Responses were analysed through the Rasch model, which allows researchers to investigate…

Cognitive diagnostic assessment (CDA) intends to identify learners' strengths and weaknesses in latent cognitive attributes to provide personalized remedial instructions. Previous CDA studies on English as a Foreign Language (EFL)/English as a Second Language (ESL) writing have adopted dichotomous cognitive diagnostic models (CDMs) to analyze data…