This simulation study considered the effects on statistical measures of test dimensionality that result from systematic sampling variation in both a single- and a double-trait assessment model. Results suggest that there are distinct psychological and psychometric states of test dimensionality, and that psychometric unidimensionality may be…

Investigates potential presence of a topic effect for the Canadian Academic English Language (CAEL) Assessment using the mechanism of choice. Sought to determine whether test-takers given a choice of topic perform significantly differently from test-takers not given a choice. English-as-a-Second-Language university applicants were assigned one of…

Outlines an agenda for a dialogue that focuses on the relation between acquired language proficiencies (verbal abilities) and non-verbal abilities. Shows the relevance of this to language testing, framing the problem within a general theory of signs and deriving certain testable hypotheses concerning it. (Author/VWL)

Investigates how skilled and less skilled readers answered a gap-filling test in order to examine whether such tests can measure text-level processing ability. Japanese learners of English completed a gap-filling test while thinking aloud about their test-taking processes. Results showed both skilled and less-skilled readers used text-level…

An extensive adaptation exercise was undertaken by the Australian Council for Educational Research (ACER) when it was decided to modify the 1998 version of the American "SIGI Plus" (System for Interactive Guidance, plus more) for Australian conditions. Although the same language was involved, there are substantial differences in…

Describes ways that language test design can be computerized, and illustrates some test construction methods derived from the field of operations research. (CB)

Describes the strong power of tests and the fact that tests lead to far-reaching and high stakes decisions and consequences about individuals and groups. Proposes a number of assessment strategies that are based on democratic principles. (Author/VWL)

The present study provides an overview of the impact of standardized EFL tests on EFL education in Korea. To achieve this goal, the paper (1) presents the status quo of EFL testing in the Korean context, (2) explores the nature of the EFL tests prevalent in the EFL testing market, and (3) investigates the overwhelming washback effects of EFL tests…

Speech act theory-based, second language pragmatics testing (SLPT) poses problems for validation due to a lack of correspondence with empirical conversational data. Since conversation analysis (CA) provides a richer and more accurate account of language behavior, it may be preferred as a basis for SLPT development. However, applying CA methodology…

Discusses problems encountered with the cloze test and describes the development and use of an alternate test, the C-Test. The C-Test consists of a number of short tests. Beginning in the second sentence, the second half of every second word is deleted until the required number of mutilations is reached. (SED)

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

Reviews assumptions underlying approaches to research into speaking task difficulty and questions the view that test scores always vary with task conditions or discourse variation. Offers a new approach to defining task difficulty in terms of the interaction between pragmatic task features and first language cultural background. Results of a study…

Based on the observation that scale-level methods are sometimes exclusively used to investigate measurement invariance for test translation, describes results of a simulation study investigating whether item-level differential item functioning (DIF) manifests itself in scale-level analyses such as single and multigroup factor analyses and per…

Discusses the Test for Creative Thinking--Drawing Production (TCT-DP), a creativity test suitable for most age and ability groups. Explores the possibility of implementing TCT-DP among kindergarten children in Korea. Results from a TCT-DP field study on 1366 Korean preschool children are comparable to those found in previously reported German…

Discusses steps taken to attain cultural relevance and appropriateness in the reading literacy construct, and in the stimulus materials and items that operationalize it. Explains the influence of multilingual considerations on the development of the reading literacy assessment instrument and notes psychometric procedures used to maximize the…