Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

The current study examined the degree to which collocation use (i.e., meaningful co-occurrences of multiple words) is related to first language (L1) raters' intuitive judgments of second language (L2) speech. Speech samples from a picture description task performed by 85 Japanese learners of English with varied L2 proficiency profiles were…

Assessing language skills in an integrative form has drawn the attention of assessment experts in recent years. While some research data exists on integrative listening/reading-to-write assessment, there is comparatively little research literature on listening-to-speak integrated assessment. Also, little attention has been devoted to the role of…

Factors that affect comprehension of accented English (e.g., Harding, 2011) have been well studied, but little research examines how listeners' proficiency affects their sensitivity to second language (L2) accent. The current study investigated the effect of test takers' English proficiency on their comprehension ratings and ability to correctly…

In the present study, I examined the effects of rater characteristics, in particular, raters' familiarity with a foreign accent, on the assessment of second language (L2) pronunciation. Forty-three native English-speaking teachers were divided into three groups according to their reported types of familiarity with Korean accents: heritage,…

A large data set of L1 psycholinguistic norms (Balota "et al." 2007) was used to assess spoken L2 English lexical proficiency in cross-sectional and longitudinal learner corpora. Behavioral norms included lexical decision and word naming latencies (i.e. reaction times) and accuracies for 40,481 English words. A frequency measure was…

Many studies that have investigated the educational value of online machine translation (MT) in second language (L2) writing generally report significant improvements after MT use, but no study as of yet has comprehensively analyzed the effectiveness of MT use in terms of various measures in syntactic complexity, accuracy, lexical complexity, and…

The purpose of this case study is twofold: it (1) explores multilingual raters' judgements regarding the accentedness and comprehensibility of second language speech and (2) examines how the raters' language backgrounds influence their judgements. In this study, six multilingual Singaporean raters judged the accentedness and comprehensibility of…

This study compares the language proficiency gains of two groups of students taking a business English course module in a bilingual university in Catalonia (Spain). Whereas one of these groups followed a 'translanguaging' or 'plurilingual' pedagogy, the other followed a strictly monolingual approach. Participants were 54 mostly Catalan/Spanish…

There is emerging evidence that collocation use plays a primary role in determining various dimensions of L2 oral proficiency assessment and development. The current study presents the results of three experiments which examined the relationship between the degree of association in collocation use (operationalized as t scores and mutual…

The speech of second language learners is often influenced by phonetic patterns of their first language. This can make them difficult to understand, but sometimes for listeners of the same first language to a lesser extent than for native listeners. The present study investigates listeners' awareness of the accent by asking whether accented speech…

The importance of functional adequacy as an essential component of L2 proficiency has been observed by several authors (Pallotti, 2009; De Jong, Steinel, Florijn, Schoonen, & Hulstijn, 2012a, b). The rationale underlying the present study is that the assessment of writing proficiency in L2 is not fully possible without taking into account the…

The effects of repeated oral reading and timed reading on L2 oral reading fluency were examined among Japanese university students (N = 50) over 12 weeks. Three quasi-experimental groups were used in the study. Group 1 practiced two types of reading: Repeated oral reading with chunking practice and timed reading. Group 2 did timed reading only.…

The present study aimed at investigating the effect of using collaborative translation tasks (CTTs) for teaching figurative language. The study also sought to explore the perceptions of the learners toward the efficacy of CTTs for learning figurative language through conducting interviews. The participants of the study included 60 English as a…

Rater variation in performance assessment can impact test-takers' scores and compromise assessments' fairness and validity (Crooks, Kane, & Cohen, 1996). Rater variation can also undermine a test's validity and fairness; therefore, it is important to investigate raters' scoring patterns in order to inform rater training. Substantial work has…