As diagnostic classification models become more widely used in large-scale operational assessments, we must give consideration to the methods for estimating and reporting reliability. Researchers must explore alternatives to traditional reliability methods that are consistent with the design, scoring, and reporting levels of diagnostic assessment…

This article reports a study that involved simulated job interviews with 27 high-proficiency English-as-an-additional-language (EAL) candidates and nine professional interviewers and that evaluated three conditions: a control group and two experimental groups (one receiving only personalized, training-focused feedback on interview skills…

Accomplishing a communication task in the real world requires the ability not only to do the task per se but also to manage aspects of the context in which it occurs. For this reason, simulations of target language use contexts have been incorporated into the design of communicative language tests as a way of enhancing the authenticity of…

The computerized adaptive tests (CAT) apply an adaptive process in which the items are tailored to individuals' ability scores. The multidimensional CAT (MCAT) designs differ in terms of different item selection, ability estimation, and termination methods being used. This study aims at investigating the performance of the MCAT designs used to…

The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a…

The all-encompassing term "Medical Spanish" references the Spanish used by healthcare professionals. Medical Spanish courses have gained traction as the Spanish-speaking population in the U.S. continues to grow. Consequently, demand for courses in Medical Spanish and other areas of Spanish for Specific Purposes (SSP), a subfield of…

The purpose of this pilot study was to examine TeachLivE simulation used by speech--language pathology graduate students (SLP GSs) to practice questioning strategies with English learners (ELs) at various language proficiency levels. Using a communities of practice theoretical framework, data were collected through an assignment in a core…

This study presents a quantitative analysis of pre-emptive strategies used by first language speakers in talk addressed to second language speakers with moderate proficiency. The strategies identified in the conversations are reformulation, simplification, left-dislocation, and decomposition. The data come from simulated emergency calls in which…

Research examining test taker fluency in simulated and face-to-face oral proficiency interview performances has primarily focused on quantitative spoken utterance fluency data alone, with further qualitative investigation of test taker processing fluency's effect being neglected. This study compared four test takers' spoken utterance and…

Individual differences (IDs) play an important role in the second language learning process and explain the varied experiences of the L2 learner. The two major IDs, language aptitude and motivation, can be primary factors in one's ultimate proficiency. While language aptitude is largely fixed, motivation is malleable and can aid in overcoming…

Leadership education seeks to develop leadership knowledge and skills for a universal student body. Challenges arise in English-speaking classes when student populations are comprised entirely of nonnative speakers. Activities accommodating multimodal concepts of learning may better facilitate knowledge acquisition and provide context in light of…

The vast development of digital technology and the widespread use of social network platforms have reshaped how we live in the world. For L2 learners to maximally utilize their language proficiency to function effectively as members of modern society, they need not only the necessary L2 knowledge, skills, and abilities (KSAs) but also essential…

An assumption underlying speaking tests is that scores reflect the ability to produce online, non-rehearsed speech. Speech produced in testing situations may, however, be less spontaneous if extensive test preparation takes place, resulting in memorized or rehearsed responses. If raters detect these patterns, they may conceptualize speech as…

Recent CALL technology reviews cover a plethora of technologies available to language learners to improve a variety of skills, including speaking. However, few technology-enhanced self-access tools are available for pragmatic development, especially in oral modality. Recognizing the benefits of structured practice for second language development,…

The aim of the study was to investigate how raters come to their decisions when judging spoken vocabulary. Segmental rating was introduced to quantify raters' decision-making process. It is hoped that this simulated study brings fresh insight to future methodological considerations with spoken data. Twenty trainee raters assessed five Chinese…