A reliable index of lexical diversity (LD) has remained stubbornly elusive for over 60 years. Meanwhile, researchers in fields as varied as "stylistics," "neuropathology," "language acquisition," and even "forensics" continue to use flawed LD indices--often ignorant that their results are questionable and in…

Pragmatic proficiency has been incorporated in the EFL teaching and testing syllabi in China, but the corresponding tests still focus on linguistic competence. The gap between the teaching and testing is mainly due to the lack of generally accepted measures of communicative abilities such as pragmatic competence. This study developed a…

In this article, I describe a practical application of the Roussos and Stout (1996) multidimensional analysis framework for interpreting group performance differences on an ESL reading proficiency test. Although a variety of statistical methods have been developed for flagging test items that function differentially for equal ability examinees…

The use of online rater self-training is growing in popularity and has obvious practical benefits, facilitating access to training materials and rating samples and allowing raters to reorient themselves to the rating scale and self monitor their behaviour at their own convenience. However there has thus far been little research into rater…

Performance on the Yes/No test (Huibregtse et al., 2002) was assessed as a predictor of scores on the Vocabulary Levels Test (VLT), a standard test of receptive second language (L2) vocabulary knowledge (Nation, 1990). The use of identical items on both tests allowed a direct comparison of test performance, with alternative methods for scoring the…

A multitask speaking measure consisting of both integrated and independent tasks is expected to be an important component of a new version of the TOEFL test. This study considered two critical issues concerning score dependability of the new speaking measure: How much would the score dependability be impacted by (1) combining scores on different…

Considers the extent to which a testing task can be made authentic so that it constitutes an example of normal and natural language behavior on the part of both examiner and candidate. Also considers the effects on test validity and the correct interpretation of test results if a test cannot be made authentic. (SED)

Describes a study which submitted data from a multiple-choice English as a second language reading comprehension test to classical test theory item analysis and latent trait measurement. The purpose was to identify weak items and to compare the number of weak items indicated by the two different approaches. (SED)

Discusses the three main approaches to defining language knowledge and use: (1) the structural approach, (2) the functional approach, and (3) the general proficiency approach. Asserts that each approach has specific consequences for language testing and that no one approach can claim to be the only way of representing that knowledge. (Author/SED)

Presents the design and validation of an English-as-a-Second-Language (ESL) test for a commercial publisher. (Author/VWL)

Explored the relative impact of the test-developer on the performance of test takers using multiple-choice reading comprehension tests that had no specifications. Six passages each with three different sets of multiple-choice items constructed by three groups of individuals were trialled on 335 Iranian English-as-a-Foreign-Language (EFL) learners.…

Investigated the impact of performance conditions on perceptions of task difficulty in a test of spoken language, in light of the cognitive complexity framework proposed by Skehan (1998). Candidates performed narrative tasks whose characteristics and the conditions under which they were performed were manipulated, and the impact of these on task…

Analyzed Francophone university students' (N=182) performance on eight English-As-a-Second-Language cloze tests (in terms of cloze-taking ability, language knowledge, content domain, and knowledge of contextual constraints). Results revealed that cloze performance was dependent on language factors and nonlinguistic-specific knowledge related to…

Discusses the development of an interview test of English proficiency in the 0 to 1+ range on the Australian Second Language Proficiency Rating Scale. Items were written toward 29 specified objectives using specially developed algorithms. A sample set of algorithms used in one of the tests and 23 references are appended. (Author/LMO)

Discusses the question of aptitude from within an information-processing perspective, examines how aptitude is conceptualized in this framework, and discusses one possible component of L2 aptitude: working memory. (56 references) (Author/CK)