Describes a study of multiple-choice and open-ended questions, each presented in the native language and in the second language, on the same second language text. Different methods resulted in different scores. Some methods were found to be more difficult than others and to have a greater effect on students of low-level proficiency. (SED)

Investigates potential problems with training native speaker interlocutors to carry out a series of oral interactions with a candidate for overseas employment with the Australian government. Findings reveal the effects of interlocutor variables and audiotape quality on ratings. Evaluates the overall feasibility of the procedure and examines…

Reports on an exploratory study that investigated the comparability of listening assessment tasks used to assess and report learning outcomes of adult English-as-a-Second-Language learners in Australia. Focused on the effects of task characteristics and task conditions on learners' performance in competency-based listening assessment tasks that…

This article reports the results of using a three-layer back propagation artificial neural network to predict item difficulty in a reading comprehension test. Three classes of variables were examined: text structure, propositional analysis, and cognitive demand. Results demonstrate that the networks can consistently predict item difficulty. (JL)

Reactions of Spanish and Italian teenagers to test items on English language ability placement tests were examined. C-tests were the most negatively rated, apparently because of the perceived difficulty of this type of test. No significant differences were observed between genders or between language groups. (Author/JL)

Describes a working model used to determine the target language use in a language for specific purpose test project: the Listening Summary Translation Exam in Taiwanese (LSTE/T). The purpose of the LSTE/T was to evaluate the summary translation ability of applicants who want to work as linguists in law enforcement agencies in the United States.…

Using FACETS, investigates how judgments of trained teacher raters are biased toward certain types of candidates and certain criteria in assessing Japanese second language writing. Explores the potential for using a modified version of a rating scale for norm-referenced decisions about Japanese second language writing ability. (Author/VWL)

This study examined the multiple true-false (MTF) test format in second language testing by comparing multiple-choice (MCQ) and multiple true-false (MTF) test formats in two language areas of general English: vocabulary and reading. Two counter-balanced experimental designs--one for each language area--were examined in terms of the number of MCQ…

Discusses an alternative framework for handling language testing and proposes some tentative hypotheses concerning principles of language testing. Suggests that taking account of both interlanguage domain engagement and contextualization in testing research, production, and interpretation allows for a richer conceptualization of the language…

Presents approaches to test development analysis, reliability, and validity based on criterion-referenced measurement principles and compares them with norm-referenced approaches in terms of the types of decisions that result from either approach. This is done by using data from an English-as-a-second-language achievement testing project at the…

This study looked at whether prior learning of a lecture topic enhanced performance on the lecture subtests of a content-based listening test. Data was analyzed from 11 lecture subtests from the Test of Listening for Academic Purposes. (JL)

Explores the nature of formative assessment in a primary language learning context. The research is from nine inner city schools where an early years intervention project is being carried out to address problems of low levels of achievement in English, with specific reference to the language support of learners for whom English is an additional…

Suggests that any model of washback must include insights from the theory of educational innovation to help explain why tests do not always have the desired or feared effect. Key concepts in educational innovation are reviewed, showing how these concepts are manifested in a case study in washback and outlining how they are being applied in recent…

FACETS many-facet Rasch analysis software was utilized to look at two consecutive administrations of a large-scale second language oral assessment in the form of a peer group discussion task with Japanese English-major university students. Results are discussed. (Author/VWL)

A conceptualization of test theory is discussed that addresses issues of weight and coverage of evidence for statements framed in recent educational/psychological paradigms. Implications for language assessment built around the American Council on the Teaching of Foreign Languages' guidelines are considered. (26 references) (Author/CK)