While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a…

This mixed methods study compared IELTS examiners' scores when assessing spoken performances under live and two 'non-live' testing conditions using audio and video recordings. Six IELTS examiners assessed 36 test-takers' performances under the live, audio, and video rating conditions. Scores in the three rating modes were calibrated using the…

The COVID-19 pandemic led to rapid innovation among language assessment developers who had to adapt their testing processes to address various restrictions from governments and institutions. This overview introduces some of the challenges and opportunities test developers grappled with during this period as well as introduces the six commentaries…

The effects of question or task complexity on second language speaking have traditionally been investigated using complexity, accuracy, and fluency measures. Response processes in speaking tests, however, may manifest in other ways, such as through nonverbal behavior. Eye behavior, in the form of averted gaze or blinking frequency, has been found…

Linking one's contribution to those of others' is a salient feature demonstrating interactional competence in paired/group speaking assessments. While such responses are to be constructed spontaneously while engaging in real-time interaction, the amount and nature of pre-task preparation in paired/group speaking assessments may have an influence…

In the present study, I examined the effects of rater characteristics, in particular, raters' familiarity with a foreign accent, on the assessment of second language (L2) pronunciation. Forty-three native English-speaking teachers were divided into three groups according to their reported types of familiarity with Korean accents: heritage,…

This article provides an overview and evaluation of the uses--actual and potential--of automatic speech recognition (ASR) and spoken dialogue systems (SDS), related technologies that can be applied to second language speaking assessment, given particular definitions of the construct. Both technologies have only gradually moved in the direction of…

The purpose of diagnostic language assessment is to identify learner strengths and weaknesses so that subsequent learning activity can be planned according to learner needs, a purpose which aligns with pedagogical recommendations to individualize instruction. Indeed, the extent to which diagnostic assessment can inform the selection of…

This article considers the construct of fluency in second language assessment and how it might be informed by research in applied linguistics. It briefly describes the way fluency is conceptualized in four language tests, as embodied in their respective assessment criteria, to show where the field is at present. The article then takes into account…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…

Adopting Linacre's guidelines for evaluating rating scale effectiveness, we examined whether and how a six-point rating scale functioned differently across raters, speech acts, and second language (L2) proficiency levels. We developed a 12-item Computerized Oral Discourse Completion Task (CODCT) for assessing the production of requests, refusals,…

The Ministry of Education in Taiwan encourages universities to adopt English ability as an exit requirement for graduates. Nearly 65% of universities use the General English Proficiency Test (GEPT) or other compatible standardized tests as an exit test for university graduates. However, it remains unclear what level of vocabulary knowledge a…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…

An assumption underlying speaking tests is that scores reflect the ability to produce online, non-rehearsed speech. Speech produced in testing situations may, however, be less spontaneous if extensive test preparation takes place, resulting in memorized or rehearsed responses. If raters detect these patterns, they may conceptualize speech as…