Automatic Speech Scoring (ASS) has increasingly become a useful tool in oral proficiency testing for Second Language (L2) learners. However, limited studies investigate the alignment of ASS indices with the Complexity, Accuracy, and Fluency (CAF)--the three dimensions in evaluating L2 speakers' oral proficiency, and the subsequent impact indices…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

This paper reports an approximate replication of Matsuda and Gobel (2004) for the psychometric validation of the Foreign Language Reading Anxiety Scale (FLRAS). Their study examined the structural aspects of the FLRAS developed by Saito, Horwitz, and Garza (1999). The results showed that the FLRAS measured three different subcomponents of foreign…

This study compared holistic and analytic marking methods for their effects on parameter estimation (of examinees, raters, and items) and rater cognition in assessing speech act production in L2 Chinese. Seventy American learners of Chinese completed an oral Discourse Completion Test assessing requests and refusals. Four first-language (L1)…

The factors that influence rater scoring have been a subject of great interest to researchers in second language assessment. However, the research on the impact of test-takers' speech profiles (e.g., a jagged or a flat profile reflecting analytic subscores) on raters' scoring behaviors remains to be seen. To investigate the role of speech profiles…

The use of translation and interpreting (T&I) in the language learning classroom is commonplace, serving various pedagogical and assessment purposes. Previous utilization of T&I exercises is driven largely by their potential to enhance language learning, whereas the latest trend has begun to underscore T&I as a crucial skill to be…

This study searched for open-source semantic similarity tools and evaluated their effectiveness in automated content scoring of fact-based essays written by English-as-a-Foreign-Language (EFL) learners. Fifty writing samples under a fact-based writing task from an academic English course in a Japanese university were collected and a gold standard…

Background: A strong interest in researching World Englishes (WE) in relation to language assessment has become an emerging theme in language assessment studies over the past two decades. While research on WE has highlighted the status, function, and legitimacy of varieties of English language, it remains unclear how raters respond to the results…

The elicited imitation task (EIT), in which language learners listen to a series of spoken sentences and repeat each one verbatim, is a commonly used measure of language proficiency in second language acquisition research. The "TOEFL® Essentials"™ test includes an EIT as a holistic measure of speaking proficiency, referred to as the…

The use of corpora and corpus linguistic methods in language testing research is increasing at an accelerated pace. The growing body of language testing research that uses corpus linguistic data is a testament to their utility in test development and validation. Although there are many reasons to be optimistic about the future of using corpus data…

This study aims to find out the student responses in enhancing new vocabulary through subtitled English Movies. And the research question is what are students' responses in enhancing new vocabulary through subtitled English movies? To achieve this objective, the study employed a quantitative method. The data were obtained from the questionnaire.…

Demand for second-language (L2) Chinese education for kindergarteners has grown rapidly, but little is known about these kindergarteners' L2 skills, with existing studies focusing on school-age populations and alphabetic languages. Accordingly, we developed a six-subtest Chinese character acquisition assessment to measure L2 kindergarteners'…

Coventry University Institution Wide Language Programme (IWLP) offers beginners language learning modules to approximately 3,000 students. Each module is taught over 11 weeks for a total of one hour and 40 minutes and two of the weeks are used for in class tests, so tutors generally agree that students need to practise their skills outside the…

This study aims to explore preservice language teachers' views on the use of peer and selfassessment techniques and also to investigate whether there is a correlation between peer/selfscoring and teacher scoring. In data collection, both qualitative and quantitative research approaches were utilized. SPSS was used to analyze quantitative data and…

Bilingualism is a multi-faceted experience and bilinguals differ in how they use their languages in daily life. Therefore, assessments of bilingualism that consider the role of (social) context are needed when describing bilinguals. In this study, we evaluated how (reliably) the Language and Social Background Questionnaire (LSBQ; Anderson et al.…