Despite consistent calls for authentic stimuli in listening tests for better construct representation, unscripted texts have been rarely adopted in high-stakes listening tests due to perceived inefficiency. This study details how a local academic listening test was developed using authentic unscripted audio-visual texts from the local target…

While there is growing research identifying the academic and nonacademic challenges to the wellbeing of Chinese international students, there is little discussion about the differences in and challenges of the assessment they experience. This gap appears to come from a tacit assumption that assessment is universal worldwide, or that students will…

Language assessment is increasingly computermediated. This development presents opportunities with new task formats and equally a need for renewed scrutiny of established conventions. Recent recommendations to increase integrated skills assessment in lecture comprehension tests is premised on empirical research that demonstrates enhanced construct…

Research has suggested the important role of vocabulary knowledge in second language (L2) speaking proficiency. However, earlier studies tended to disregard the congruence in test format between assessing vocabulary knowledge and speaking skills with the former predominantly measured in written format. The current study measured vocabulary…

Nonverbal behavior is essential in human interaction (Gullberg, de Bot, & Volterra, 2008; McNeill, 1992, 2005). For second language speakers, nonverbal features can be helpful for successful and efficient communication (e.g., Dahl & Ludvigsen, 2014). However, due to the complexity of nonverbal features, language testing institutions have…

The present article gives an overview of several studies on the predictive validity of the C-test. In the first part of the article, we discuss the construct validity of this test format. Only if the underlying construct of this test is understood, can a justification for high predictive validity be made. In the second part, we discuss several…

This study investigates whether re-thinking the separation of lexis and grammar in language testing could lead to more valid inferences about proficiency across modes. As argued by Römer, typical scoring rubrics ignore important information about proficiency encoded at the lexis-grammar interface, in particular how the co-selection of lexical and…

College and university admissions officers are the gatekeepers who decide which individuals may join the "country club" of higher education. As such, the decisions they make have a significant impact on the lives of individuals, especially those who are willing to travel across the globe and risk living in an unfamiliar country in order…

This study offers evidence of the impact of language background on the performance of students enrolled in an accounting study unit. It aims to quantify the effects of language background on performance in essay questions, compared to calculation questions requiring an application of procedures. Marks were collected from 2850 students. The results…

In this study we investigated the potential for a shared-first-language (shared-L1) effect on second language (L2) listening test scores using differential item functioning (DIF) analyses. We did this in order to understand how accented speech may influence performance at the item level, while controlling for key variables including listening…

Evaluation on the foreign student's competence of Indonesian language is required to assess their achievement. This research aimed to identify the difficulty level of test instrument, analyze the difference of foreign students' competence for Indonesian language and to analyze the correlation of students' competence over various objective test…

This article compares second language test-takers' performance on an academic listening test in an audio-only mode versus an audio-video mode. A new method of classifying video-based visuals was developed and piloted, which used L2 expert opinions to place the video on a continuum from being content-deficient (not helpful for answering…