With recent technological advances, researchers have begun to explore the potential use of spoken dialog systems (SDSs) for L2 oral communication assessment. While several studies support the feasibility of building these systems for various types of oral tasks, research on the construct validity of SDS-delivered tasks is still limited. Thus, this…

This study examined the effect of rater training on promoting inter-rater reliability in oral language assessment. It also investigated whether rater training and the consideration of the examinees' expectations by the examiners have any effect on test-takers' perceptions of being fairly evaluated. To this end, four raters scored 31 Iranian…

Conversation analysis (CA) has exerted influence both on second language (L2) classroom pedagogy (e.g., Barraja-Rohan A, Pritchard R, Beyond talk: a course in communication and conversation skills for intermediate adult learners of English. Western Metropolitan Institute of TAFE, Melbourne, 1997; Wong J, Waring HZ, Conversation analysis and second…

The effects of question or task complexity on second language speaking have traditionally been investigated using complexity, accuracy, and fluency measures. Response processes in speaking tests, however, may manifest in other ways, such as through nonverbal behavior. Eye behavior, in the form of averted gaze or blinking frequency, has been found…

The present study was executed with the purpose of validating ELT Certificate Lesson Observation and Report Task (ELTC-LORT), which was developed by China Language Assessment to certify China's EFL teachers by performance-based testing. The ELT Certificate has high-stakes considering its impacts on candidates' recruitment, ELT in China and quality…

One of the major issues in SLA is developing language tests that could produce good measures of implicit knowledge. This study examines the validity of an English Elicited Imitation (EI) test as a measure of L2 implicit grammatical knowledge. Forty freshman university students in Turkey took a set of language tests: an EI test, two storytelling…

The purpose of diagnostic language assessment is to identify learner strengths and weaknesses so that subsequent learning activity can be planned according to learner needs, a purpose which aligns with pedagogical recommendations to individualize instruction. Indeed, the extent to which diagnostic assessment can inform the selection of…

The present study investigates the effects of the Kagan cooperative learning (CL) model on the English oral communication ability of Bhutanese students. A quasi-experimental design was employed using two classes: the control group (n=22) and experimental group (n=23). The participants of this study were forty-five students of Tsheyang Higher…

Whereas previous research revealed the interactional variability occurring in oral assessments, demonstrating how it could undermine test validity (e.g., A. Brown, 2003), little has been published regarding how language programs can mine and analyze video recordings of in-house oral placement tests for validation purposes. Addressing this need,…

Criterion referenced tests of second language speaking performance are administered in different institutions using different procedures. The present study reports raters' practices of second language speaking tests, in particular the correspondence between test-takers' grades when assessed individually and in groups. Data derived from…

Oral Proficiency Interviews (OPIs) are widely used to measure speaking ability in a second or foreign language. The Michigan English Language Assessment Battery (MELAB) Speaking Test is an OPI used for academic and professional purposes around the world. However, little research on this or other OPIs has quantitatively compared test takers' speech…

The present trend in developing and using semi-direct speaking tests has been supported by test developers and researchers' claim of their increased practicality, higher reliability and concurrent validity with test scores in direct oral proficiency interviews. However, it is universally agreed within the language testing and assessment community…

This article presents evidence for a validity argument on the ACTFL Assessment of Performance Toward Proficiency in Languages (AAPPL) tests (Interpersonal Listening/Speaking, Presentational Writing, Interpretive Listening, and Interpretive Reading) by summarizing an analysis of the 2014 test data from examinations administered in three languages…

While studies have been done to rate the validity and reliability of the Oral Proficiency Interview (OPI) and Oral Proficiency Interview-Computer (OPIc) independently, a limited amount of research has analyzed the interexam reliability of these tests, and studies have yet to be conducted comparing the results of Spanish language learners who take…

This study determines the fine-grained bottom-up linguistic features involved in successful second language (L2) English academic group oral tutorial discussion through the use of a spoken learner corpus composed of more than 20 hrs of L2 production. Student performances were graded by teacher-raters using a can-do rating scale, which assessed…