A brief overview of item response theory is provided, and a 186-item bibliography of books and articles on the subject dating from 1953 to June 1989 is presented. The overview includes a definition of the theory, a discussion of its development and application, and comparisons with classical test theory. All publications in the bibliography were…

This paper reviews 18 microcomputer software item banks on an individual basis. Software Programs reviewed are AIMS (Academic Instructional Measurement System); CREATE-A-TEST; Exam Builder; Exams and Examiner; MicroCAT; Multiple Choice Files; P.D.Q. Builder; Quiz Rite; Teacher Create Series (5 programs); TAP (Testing Authoring Program); TestBank…

Different formats for four types of research items were studied for ease of computer data entry. The types were: (1) numeric response items; (2) individual multiple choice items; (3) multiple choice items with the same response items; and (4) card column indicator placement. Each of the 13 experienced staff members of a major university's Data…

The purpose of the investigation was to obtain some relationships among (1) test lengths, (2) shape of domain-score distributions, (3) advancement scores, and (4) several criterion-referenced test score reliability and validity indices. The study was conducted using computer simulation methods. The values of variables under study were set to be…

The function and structure of a data base system called RIBYT (Review It Before You Test) is described. RIBYT simultaneously controls and associates questions in question pools for many courses of instruction. The data base stores questions created by both faculty and students and is used for formal testing and student self-assessment. The…

The initial development of a testlet-based algebra test was previously reported (Wainer and Lewis, 1990). This account provides the details of this excursion into the use of hierarchical testlets and validity-based scoring. A pretest of two 15-item hierarchical testlets was carried out in which examinees' performance on a 4-item subset of each…

Three critical procedural skills in emergency medicine were evaluated using three assessment modalities--written, computer, and animal model. The effects of computer practice and previous procedure experience on skill competence were also examined in an experimental sequential assessment design. Subjects were six medical students, six residents,…

Several methodological problems (particularly the assumed bipolarity of scales, instructions regarding use of the midpoint, and concept-scale interaction) which may contribute to a lack of precision in the semantic differential technique were investigated. Results generally supported the use of the semantic differential. (Author/JKS)

Describes the purpose, construction, use, maintenance, and improvement of a basic physics examination file by the U.S. Air Force Academy. Includes nine sample objectives, two multiple-choice items, and an example of computer item analysis. (SK)

Three study cohorts involving 199 gifted fifth graders, 190 gifted sixth graders, and 683 typical sixth graders were used to construct, validate, and pilot a computerized adaptive math test for placing fifth graders in a middle school mathematics gifted program. Results suggest the adaptive test has potential for talent identification. (Author/CR)

The Learning Outcome Testing Program of the West Virginia Department of Education is designed to provide public school teachers/administrators with test questions matching learning outcomes. The approach, software selection, results of pilot tests with teachers in 13 sites, and development of test items for item banks are described. (SLD)

Shares some lessons learned from performance-based assessment in the health professions, using four performance-based assessment methods as examples: (1) written clinical simulations (patient-management problems); (2) computer-based clinical simulations; (3) oral examinations; and (4) standardized patients (live simulations). (SLD)

Describes the workings of computerized adaptive testing (CAT). Focuses on the key concept of information and then discusses two important components of a CAT system: the calibrated item bank and the testing algorithm. Describes a CAT that was designed for making placement decisions on the basis of two typical test administrations and notes the…

Over the last 20 years, writing about technology (and more recently about its use in assessment systems) has been a joyful experience, in part because the author was usually right about how fast and how unexpected technology progress would be made. In this article, the author suggests to rethink assessment systems from design perspectives and the…

This article describes the translation goals, challenges, strategies, and solutions employed in the development of a computer-based, self administered, psychiatric diagnostic instrument, the Diagnostic Interview Schedule for the Deaf (D-DIS-IV) in American Sign Language (ASL) with English captions. The article analyzes the impact of the…