All educational testing is intended to have consequences, which are assumed to be beneficial, but tests may also have unintended, negative consequences (Messick, 1989). The issue is particularly important in the case of large-scale standardized tests, such as Australia's "National Assessment Program--Literacy and Numeracy" (NAPLAN), the…

The overarching aim of the study is to explore the extent to which test takers' performances on monologic speaking tasks provide information about their interactional competence. This is an important concern from a test use perspective, as stakeholders tend to consider test scores as providing comprehensive information about all aspects of L2…

Objects that sit between intersecting social worlds, such as Language for Specific Purposes (LSP) tests, are "boundary objects"--dynamic, historically derived mechanisms which maintain coherence between worlds (Star & Griesemer, 1989). They emerge initially from sociopolitical mandates, such as the need to ensure a safe and efficient…

This paper examines the uptake of Rasch measurement in language testing through a consideration of research published in language testing research journals in the period 1984 to 2009. Following the publication of the first papers on this topic, exploring the potential of the simple Rasch model for the analysis of dichotomous language test data, a…

One measure of the impact of a high-stakes test is the attitudes that test takers hold towards it. It has been suggested that positive attitudes produce beneficial effects while real or anticipated negative experiences can result in the development of attitudes that erode confidence and potentially impact negatively on performance. This study…

This study identifies a unique context for exploring lay understandings of language testing and, by extension, for characterizing the nature of language assessment literacy among non-practitioners, stemming from data in an inquiry into the registration processes and support for overseas trained doctors by the Australian House of Representatives…

The Assessment of Language Competence (ALC) certificates is an annual, international testing program developed by the Australian Council for Educational Research to test the listening and reading comprehension skills of lower to middle year levels of secondary school. The tests are developed for three levels in French, German, Italian and…

The assessment of oral language is now quite commonly done in pairs or groups, and there is a growing body of research which investigates the related issues (e.g. May, 2007). Writing generally tends to be thought of as an individual activity, although a small number of studies have documented the advantages of collaboration in writing in the…

An extensive adaptation exercise was undertaken by the Australian Council for Educational Research (ACER) when it was decided to modify the 1998 version of the American "SIGI Plus" (System for Interactive Guidance, plus more) for Australian conditions. Although the same language was involved, there are substantial differences in…

Presents principles behind the construction of English-as-Second-Language (ESL) standards for schools, drawing on examples of ESL standards developed in Australia, England, Wales, and the United States. Examines how differences in purposes in these standards--planning, professional understanding, and reporting--influence how ESL standards might…

Illustrates some of the issues that have arisen in the implementation of outcomes-based systems of assessment and reporting. Two examples from school and adult immigrant education in Australia are provided that demonstrate some of the political and technical problems involved in implementation in both high- and low-stakes contexts. Outlines ways…

Investigates potential problems with training native speaker interlocutors to carry out a series of oral interactions with a candidate for overseas employment with the Australian government. Findings reveal the effects of interlocutor variables and audiotape quality on ratings. Evaluates the overall feasibility of the procedure and examines…

Reports on a patient of Japanese background with suspected dementia in an English-speaking geriatric unit. The subject was tested in Japanese using tasks such as naming, story recall, and processing by semantic category. Results demonstrate the potential contribution of information from language-based tasks in the person's preferred language to…

Explores theoretical and practical issues surrounding authenticity in course-based assessment, drawing on data from a university-level Japanese language course in Australia. Examines a teaching and assessment activity based around interviewing native speakers outside the classroom, which was designed to optimize authenticity. (Author/VWL)