The present study aimed to validate a 70-item Korean bilingual version of the Vocabulary Size Test (VST) using Rasch modeling. The goal was to assess the applicability of this Korean version of the VST for Korean learners of English in an English as a foreign language (EFL) context by examining validity evidence based on Messick's framework.…

Measuring learning outcomes on core skills is key to building evidence on which teaching and learning interventions are most effective, and ultimately informing policy that prioritises these skills, amongst early learners. However, developing national or systems-level assessments pose considerable challenges, including implementing an effective…

The increasing use of computer-based mode in language testing raises concern over its similarities with and differences from paper-based format. The present study aimed to delineate discrepancies between TOEFL PBT and CBT. For that objective, a quantitative method was employed to probe into scores equivalence, the performance of male-female…

Drawing on Glenn Fulcher's extensive work in performance-based language assessment of speaking, this paper explores the assessment of L2 speaking ability in local language testing contexts. For that purpose, I review Fulcher's influential work that highlights the relationship between the speaking construct, the task, the performance, and the…

This study examined the use of a popular Automatic Speech Recognition (ASR), Google Voice Typing (GVT), to automatically assess English as second language pronunciation. It aimed to answer the following question: What is the relationship between GVT-rated scores and human-rated scores? To answer this question, we compared audio recordings of 56…

The International English Language Testing System (IELTS) standardized English language proficiency (ELP) exam is widely accepted proof of ELP at Canadian universities. The majority of Canadian universities set very similar IELTS cut scores for admission; however, these differ from the IELTS-recommended minimum cut scores. The use of the IELTS…

Although the speaking section of the "TOEFL iBT"® test is used by many universities to determine if international teaching assistants (ITAs) have the oral proficiency necessary to be classroom instructors, relatively few studies have investigated the validity of using TOEFL iBT scores for ITA screening. The primary purpose of this study…

The fuzziness of assessing second language speaking performance raises two difficulties in scoring speaking performance: "indistinction between adjacent levels" and "overlap between scales". To address these two problems, this article proposes a new approach, "confidence scoring", to deal with such fuzziness, leading to "confidence" scores between…

This study employed Bachman and Palmer's (2010) Assessment Use Argument framework to investigate to what extent the use of a second language oral test as an exit test in a Hong Kong university can be justified. It also aimed to help test developers of this oral test identify the most critical areas in the current test design that might need…

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for…

Although the primary use of the speaking section of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT Speaking test) is to inform admissions decisions at English medium universities, it may also be useful as an initial screening measure for international teaching assistants (ITAs). This study provides criterion-related…

Recent workplace literacy initiatives for limited-English-proficient (LEP) employees in Illinois have resulted in employer interest in the measurement of adult English-as-a-Second-Language (ESL) achievement, particularly in the area of reading comprehension. Employers are requesting that evidence of a language minority employee's reading ability…

Limited-English-speaking students (N=198), taking college admissions tests, were studied in terms of reading, writing, and listening test scores and their university performance (grade point average, dropped classes, etc.). Results indicate that the English language test scores are not always related to the students' academic achievement. (CB)

A project to develop and validate a tape-based alternative to the interview-based speaking proficiency test is described. The objective was to produce an economically more viable test for less commonly taught languages, closely modeled on and readily interpretable in terms of the American Council on the Teaching of Foreign Languages/Interagency…

This handbook resulted from a project to develop a tape-based alternative test of language proficiency in less commonly taught languages. The objective was to produce a test that is modeled on and readily interpretable by the American Council on the Teaching of Foreign Languages/Interagency Language Roundtable (ACTFL/ILR) proficiency guidelines…