Complexity, accuracy, and fluency (CAF) as measures of language proficiency have been used extensively in assessing second language production in English language studies related to task-based language teaching. The present review adds the following critical elements to the existing body of literature: (i) Provides synthesis and critical analysis…

There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with…

We tested the utility of two standardized measures of receptive skills in American Sign Language (ASL) in hearing adults who are novice signers: the ASL Comprehension Test (ASL-CT; Hauser, P. C., Paludneviciene, R., Riddle, W., Kurz, K. B., Emmorey, K., & Contreras, J. (2016). American Sign Language Comprehension Test: A tool for sign language…

This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

Rater training is essential in ensuring the quality of constructed response scoring. Most of the current knowledge about rater training comes from experimental contexts with an emphasis on short-term effects. Few sources are available for empirical evidence on whether and how raters become more accurate as they gain scoring experiences or what…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

In language performance tests, raters are important as their scoring decisions determine which aspects of performance the scores represent; however, raters are considered as one of the potential sources contributing to unwanted variability in scores (Davis, 2012). Although a great number of studies have been conducted to unpack how rater…

Discourse competence is an essential component of communicative competence and central to the mastery of academic writing. This article reports a three-tiered diagnostic assessment of two English as a foreign language (EFL) student writers' discourse competence in terms of textual features, composing strategies, and knowledge about academic…

We investigated how grapheme familiarity and grapheme-phoneme correspondence (GPC) congruence affect adult learners' ability to make use of orthographic input (OI) during phono-lexical acquisition. Native English speakers, with no Russian experience (naïve) or learners of Russian, heard auditory forms, saw pictured meanings, and saw written input…

The purpose of this study is to investigate the constraints on implementing task-based language teaching (TBLT) and strategies that make TBLT feasible with novice second language (L2) learners in college. When the researcher (a bilingual teacher) struggled to implement tasks into traditional English courses with almost 210 novice undergraduates…

Second language (L2) learners can assess their oral skills with some accuracy. A question is whether learners can reliably use self-assessment to track their language gains over time. During the spring of two subsequent years, 80 university L2 Chinese learners completed an oral skills self-assessment based on the NCSSFL-ACTFL Can-Do Statements…

As a result of the fact that judgments of non-native speech are closely tied to social biases, oral proficiency ratings are susceptible to error because of rater background and social attitudes. In the present study we seek first to estimate the variance attributable to rater background and attitudinal variables on novice raters' assessments of L2…

Experience with a second language (L2) has been shown to facilitate learning of a third or subsequent language (L3) (Sanz 2000). However, little is known about how much L2 experience is needed before benefits for L3 development emerge, or about whether effects depend on type of L3 instruction. We report two experiments investigating initial…

The study abroad (SA) context is often assumed to foster pragmatic development in a second language (L2), yet previous scholarship confirms that pragmatic norms are culturally-shaped and often remain imperceptible to uninstructed SA students (Bataller, 2010; Cohen & Shively, 2007; Shively, 2010). Because pragmatics is not traditionally taught…