In response to calls for an assessment tool that provides a separate performance dimension from the linguistic quality-oriented measures of complexity, accuracy, and fluency (CAF) and guided by systemic functional linguistic (SFL) theories, this study introduces a set of fine-grained objective measures of communication/content/function…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

This article examines youth assessment of the quality and success of languages provision. The discussion draws on data collected from students and graduates of Victoria's 16 secondary Turkish programs in large-scale surveys (n=858) and follow-up interviews (n=177). Surveys revealed that upper secondary Turkish classrooms serve predominantly…

Comprehensibility, a major concept in second language (L2) pronunciation research that denotes listeners' perceptions of how easily they understand L2 speech, is central to interlocutors' communicative success in real-world contexts. Although comprehensibility has been modeled in several L2 oral proficiency scales--for example, the Test of English…

This study provides specific evidence regarding the extent to which quantitative measures, common sense notional measures, and comprehensive measures adequately characterize spontaneous, although engaged, speech. As such, the study contributes to the growing body of literature describing the current limits of automatic systems for evaluating…

This study compared the amount of the second language (L2) use and linguistic gains made by students in three short-term language immersion programs: (1) traditional study abroad, (2) service-oriented study abroad, and (3) foreign language (FL) housing. These were chosen because they represent three distinct program types, providing students with…

Clinical and imaging studies suggest that the cerebellum is involved in language tasks, but the extent to which slowed language production in cerebellar patients contributes to their poor performance on these tasks is not clear. We explored this relationship in 18 patients with cerebellar degeneration and 16 healthy controls who completed measures…

This work reports on the construction of a rated database of spontaneous speech produced by second language (L2) learners of English. Spontaneous speech was collected from 28 L2 speakers representing six language backgrounds and five different proficiency levels. Speech was elicited using formats similar to that of the TOEFL iBT and the Speaking…

The study reported in this paper is an investigation of the nature of speaking proficiency in English as a second language in the context of a larger project to develop a rating scale for a new international test of English for Academic Purposes, TOEFL iBT (Brown et al. 2005). We report on a large-scale study of the relationship between detailed…

It is proposed that a speech-dynamic analysis of oral fluency phenomena serves best to highlight the nondiscrete nature of the sound stream and to capture English syllable structure. Some current concepts and practices in oral testing are criticized, and previously neglected evidence concerning temporal variables in speech, automatic speech…

Techniques for assessing test validity and reliability are applied to an analysis of an unpublished test, in order to familiarize test users in local bilingual programs with the technical evidence that should be available for instruments of potential use in placing limited English-speaking students. The instrument studied, the Language Assignment…

Context of learning, such as whether a learner studies a second language (L2) in a formal classroom--"at home" or abroad--may be a key factor in developing grammatical and lexical abilities. Yet, little empirical data is available comparing the effects of study abroad (SA) and formal instruction "at home" (AH) experiences on…