While several test concordance tables have been published, the research underpinning such tables has rarely been examined in detail. This study aimed to survey the publically available studies or documentation underpinning the test concordance tables of the providers of four major international language tests, all accepted by the Australian…

This article explores the issue of identifying guessers -- with a specific focus on multiple-choice tests. Guessing has long been considered a problem due to the fact that it compromises validity. A test taker scoring higher than they should through guessing does not provide a picture of their actual ability. After an initial description of issues…

Purpose: The aim of this study was to examine the concurrent validity of the Fluharty Preschool Speech and Language Screening Test--Second Edition (Fluharty-2; Fluharty, 2001) for mass screenings of language at age 3 years. Method: Participants were sixty-two 3-year-old children, 31 who had failed and 31 who had passed the Fluharty-2. Performance…

The topic of physical and chemical changes is one of the basic and essential issues of both the lowersecondary school science curriculum and the upper-secondary school chemistry curriculum in many countries. The focus of the present study is to investigate the students' cognitive structures on the topic of physical and chemical changes at…

The high-stakes College English Test (CET), developed, administered, and reformed over the last 20 years, has received great attention in the aspect of washback on teaching and learning from previous research. Very few studies explored its consequences in the workplace domain--being used as a screening lever. This research aimed to 1) compare…

Extensive oral tasks or monologues of different types (e.g., presentations, storytelling) are often used as second language acquisition tasks in the fields of language learning and language testing. Pre-task planning time is a common provision to test-takers who may use different strategies to prepare their response. High-stakes tests, such as the…

Conversation analysis (CA) has exerted influence both on second language (L2) classroom pedagogy (e.g., Barraja-Rohan A, Pritchard R, Beyond talk: a course in communication and conversation skills for intermediate adult learners of English. Western Metropolitan Institute of TAFE, Melbourne, 1997; Wong J, Waring HZ, Conversation analysis and second…

This mixed methods study examined holistic, analytic, and part marking models (MMs) in terms of their measurement properties and impact on candidate CEFR classifications in a semi-direct online speaking test. Speaking performances of 240 candidates were first marked holistically and by part (phase 1). On the basis of phase 1 findings--which…

Research on assessing English as a foreign language (EFL) development has been growing recently. However, empirical evidence from longitudinal analyses based on substantial samples is still needed. In such settings, tests for measuring language development must meet high standards of test quality such as validity, reliability, and objectivity, as…

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated…

Research examining test taker fluency in simulated and face-to-face oral proficiency interview performances has primarily focused on quantitative spoken utterance fluency data alone, with further qualitative investigation of test taker processing fluency's effect being neglected. This study compared four test takers' spoken utterance and…

The purpose of this article is to present qualitative and quantitative tools to assist teachers and authors of examination materials in their preliminary assessment of text complexity/difficulty according to the Common European Framework of Reference for Languages. The qualitative scales were compiled specially for this study, based on previous…

The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns…

This study investigates the comparability of three parallel translation tasks selected from a College English Test Band-6 (CET-6) and explores the major linguistic features contributing to translation difficulty. Data obtained from the participants' subjective rating, eye-tracking, and performance evaluation were triangulated to measure the…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…