Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

This study investigated the effects of two different planning time conditions (i.e., operational [20 s] and extended length [90 s]) for the lecture listening-into-speaking tasks of the "TOEFL iBT"® test for candidates at different proficiency levels. Seventy international students based in universities and language schools in the United…

Many international students in American universities are required to take writing courses in English as a second language (ESL) before participating in a mainstream first-year composition (FYC) course. Given that the goal of ESL writing course is to prepare students for FYC course, the connection between ESL and FYC courses is significant. This…

This paper describes the development and evaluation of Interaction Competence Elicitor (ICE), a spoken dialog system (SDS) for the delivery of a paired oral discussion task in the context of language assessment. The purpose of ICE is to sustain a topic-specific conversation with a test taker in order to elicit discourse that can be later judged to…

Various examinations are administered at universities across the US as a means of assessing bilingual/multilingual international teaching assistants' (ITAs') proficiency in spoken English before they are permitted to teach. While such exams are taken by students in a range of academic disciplines, recent research suggests that communicative…

Even though there are books that guide students in preparing for TOEFL exams, the literature on TOEFL test preparation courses at the university level is sparse (Huang, 2018). The current study aimed to fill the research gap by investigating the impact of TOEFL ITP assessment on teachers' TOEFL course content and teaching methods. Five different…

Prosody communicates pragmatic meaning far beyond that which is evident at the surface level of an utterance and can pose challenges to learners' pragmatic comprehension. The current study investigated how second language (L2) English learners made decisions about speaker intent when communicated through prosody. Seventeen English L2 learners took…

Effective test preparation for high-stakes English language tests is crucial for candidates whose futures depend on attaining a particular score. An increasing number of studies have investigated the role of test preparation; however, these studies have been exclusively conducted in individual contexts and countries around the world. This study…

Metacognition is regarded as a retrospective skill promoting learners' learning performance, deep thinking, and academic well-being. Stimulated Recall (SR) is regarded as a reliable approach to inspiring learners' metacognition in the classroom. However, the outbreak of COVID-19, causing widespread class suspension, may impair the effect of SR on…

With the growing prevalence of Web 2.0 technologies and use of online resources in their classrooms, language learners have increasing exposure to online texts. In this study we attempted to understand how university level second language (L2) readers construct meaning when reading online. We investigated L2 readers' information-seeking strategies…

In keeping with the trend to elicit multiple stakeholder responses to operational tests as part of test validation, this exploratory mixed methods study examines test-taker accounts of an Internet-based (i.e., computer-administered) test in the high-stakes context of proficiency testing for university admission. In 2013, as language testing…

This study compares the language learner and test-taking strategies used by Chinese-speaking graduate students when confronted with familiar versus unfamiliar topics in an English multiple-choice format reading comprehension test. Thirty-six participants at a large mid-western university performed three tasks: A content knowledge vocabulary…

Researchers debate whether listening tasks should be supported by visuals. Most empirical research in this area has been conducted on the effects of visual support on listening comprehension tasks employing multiple-choice questions. The present study seeks to expand this research by investigating the effects of video listening passages (vs.…

"Literacy Strategies: Variations on a Theme" presents pedagogical variations on Robert Marzano's Six Steps to Better Vocabulary Instruction to enhance the acquisition of TOEFL [Test of English as a Foreign Language] vocabulary words by international student instrumentalists. Strategies to integrate proprioceptive [spatial body awareness]…