Communication in the real world often entails the interpretation, evaluation, and integration of content from different sources. However, it appears that the ability to integrate content into discourse has not been explicitly scored for in existing studies. This study operationalizes content integration in the analytic scoring of a…

The number of internationally mobile students pursuing higher education increases each year, with 8 million students expected to study abroad globally by 2025 (Farrugia, 2014). Many English-dominant universities require international applicants to provide standardized test scores as evidence of English proficiency. Accordingly, millions of…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…

This study has two research purposes related to L2 writing development. The first aim of this study is to explore how L2 learners receiving intensive ESL instruction develop their writing proficiency (writing quality from an analytic rubric) across two writing tasks (narrative and argumentative writing) over one semester. Limiting its focus to…

This study investigates the relationship between performances on the speaking component of the TOEFL iBTTM with performances on academic oral assessment tasks. For the academic tasks, we recorded and transcribed the performances of five local and five high-achieving international undergraduate students on oral assessment tasks in core first-year…

This article reports on a study of foreign students' success in higher education in Norway and focuses specifically on the relation between academic success and students' proficiency level of Norwegian as measured by a CEFR-based university entrance test. This study is distinguished from prior studies because it sets out to investigate not only…

The current study examined the effects of text-based relational (i.e., cohesion), propositional-specific (i.e., lexical), and syntactic features in a source text on subsequent integration of the source text in spoken responses. It further investigated the effects of word integration on human ratings of speaking performance while taking into…

This article addresses the suitability of the CEFR as the basis for decisions about the readiness of individuals to engage in academic writing tasks in undergraduate university courses, and as a guide to progress. The CEFR offers potentially relevant general scales and subscales, but also more specific subscales for writing in the academic…

Few prior studies have examined degree of fidelity between raters' assessments of oral performances and objectively observable prosodic indices of accentedness. Prosodic indices of accentedness quantify trait-relevant variance, whereas rater background variables represent trait-irrelevant variance. The present study, therefore, investigated the…

This study examined the construct validity of the TOEFL iBT Speaking subsection for the purposes of international teaching assistant (ITA) certification, a purpose for which it was not specifically designed. The factor structure of the new TOEFL was compared with that of another language performance test in use at a major American research…

In recent years there has been growing theoretical interest in exploring the relationship between the interpretation and use of high-stakes proficiency test scores. In these discussions, the role of institutional test users (or test score consumers) has received only limited attention. This may be due, at least in part, to the lack of consensus in…