This book describes how ESOL tests and test users have changed greatly in the past few decades. Some widely used ESOL tests have been revised, with a number of new tests incorporating advances in computer technology. In addition, many more ESOL practitioners than in the past are responsible for selecting and using tests. The authors introduce…

There are a variety of situations in which low-stakes achievement tests--which are defined as those having few or no consequences for examinee performance--are used in applied measurement. A problem inherent in such testing is that we often cannot assume that all examinees give their best effort to their test, which suggests that the test scores…

This paper considers differences in modes of test administration, addressing three questions: (1) Do examinees respond to items in the same way across administration modes and computer interface variations? (2) What are some of the factors that can contribute to modal effects? and (3) Can item parameters calibrated from paper and pencil…

This report describes the development and testing of a computerized early literacy diagnostic assessment for students in prekindergarten to grade 3 that can measure skills across a variety of preliteracy and reading domains. The STAR Early Literacy assessment was developed by a team of more than 50 people, including literacy experts,…

A model for constrained computerized adaptive testing is proposed in which the information in the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing…

The Kidtalk Interactive Diagnostic Test of Aptitude for Language Knowledge (KIDTALK) is an assessment instrument designed for identifying children with specific language impairments not associated with limited English proficiency. It is based on three principles: (1) a language disorder can be identified by testing an individual's potential for…

A simulation study of methods of assessing differential item functioning (DIF) in computer-adaptive tests (CATs) was conducted by Zwick, Thayer, and Wingersky (in press, 1993). Results showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. DIF methods were also investigated for nonadaptive…

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

This article explores whether or not it is possible for computers to be effectively used to analyze textual information. Computerization of human linguistic analysis would be enormously useful, because it would relieve many highly skilled linguistics professionals (researchers and teachers) from having to spend enormous amounts of time on the…

In computerized adaptive testing (CAT), new or experimental items are frequently administered alongside operational tests to gather the pretest data needed to replenish and replace item pools. The two basic strategies used to combine pretest and operational items are embedding and appending. Variable-length CATs are preferred because of the…

The comparability of computerized and paper-and-pencil tests was examined from cognitive perspective, using verbal protocols rather than psychometric methods, as the primary mode of inquiry. Reading comprehension items from the Graduate Record Examinations were completed by 48 college juniors and seniors, half of whom took the computerized test…

The Web-based standard setting (WBSS) system described in Harvey and Way (1999) provides an online, Internet-based alternative for testing programs that use onsite judgmental standard setting studies to set their cut scores. Standard setting studies using the WBSS system were compared to similar onsite studies of two exams in the College-Level…

This book profiles how computer-assisted assessment can help both staff and students by drawing on the experience and expertise of practitioners, in the United Kingdom and internationally, who are already using computer-assisted assessment. The publication is organized into three main sections--"Pragmatics and Practicalities of CAA,""Using CAA for…

Discussed the predictive index developed from the Barclay Classroom Climate Inventory which aids in identifying both gifted children and those in need of remedial help. Elementary school students (N=64) selected for a gifted program were studied. Results showed gifted children can be discriminated with reasonable accuracy. (JAC)

The criticism that language materials often test rather than teach is discussed. Exam testing is distinguished from continuous monitoring, a necessary function that well-constructed computer assisted language instruction may perform well. It is argued that computer tests also teach, and can handle much of the remedial instruction otherwise…