This review of research on assessment of second-language listening abilities looks at some testing issues and challenges (assessing higher-level skills, confounding of skills, assessing listening in oral interaction, authenticity), discusses assessment methods and techniques (test administration, item formats), and considers potential applications…

Many credentialing agencies today are either administering their examinations by computer or are likely to be doing so in the coming years. Unfortunately, although several promising computer-based test designs are available, little is known about how well they function in examination settings. The goal of this study was to compare fixed-length…

This article sets out a practitioner's perspective on the International Test Commission (ITC) guidelines. After setting the scene and describing the testing environment in which the need for the Guidelines on Computer-Based and Internet-Delivered Testing (ITC, 2005) is established, the article goes on to identify specific issues of relevance to…

In a mathematical examination on paper, partial credit is normally awarded for an answer that is not correct, but, nevertheless, contains some of the correct working. Assessment on computer normally marks an incorrect answer wrong and awards no marks. This can lead to discrepancies between marks awarded for the same examination given in the two…

Four experiments required participants to keep track of the locations of (i.e., update) 1, 2, 3, 4, 6, 8, 10, or 15 target objects after rotating. Across all conditions, updating was unaffected by set size. Although some traditional set size effects (i.e., a linear increase of latency with memory load) were observed under some conditions, these…

A previously developed method of automatically selecting items for inclusion in a test subject to constraints on item content and statistical properties is applied to real data. Two tests are first assembled by experts in test construction who normally assemble such tests on a routine basis. Using the same pool of items and constraints articulated…

This paper discusses a variety of development strategies and issues involved in the development of electronic performance support systems (EPSS) for professionals. The topics of front-end analysis, development, and evaluation are explored in the context of a case study involving the development of an EPSS to support teachers in the use of…

Projects to develop an automated item banking and test development system have been undertaken on several occasions at the Air Force Human Resources Laboratory (AFHRL) throughout the past 10 years. Such a system permits the construction of tests in far less time and with a higher degree of accuracy than earlier test construction procedures. This…

This study examined the constructs of a study skill--highlighting--to determine whether the constructs for highlighting in a paper mode would be the same as highlighting in a computer mode. Constructs are defined as the underlying processes that are elicited in an experimental setting and that provide a basis for explaining the relations among the…

The method for questionnaire construction described in this paper makes it convenient to generate as many different forms for a questionnaire as there are respondents. The method is based on using the computer to produce the questionnaire forms themselves. In this way the items or subgroups of items of the questionnaire may be randomly ordered or…

This document is a guide to counseling software. It presents overviews on the state of development of counseling and human services software in five major topic areas including personal counseling, career counseling, academic advising, testing and administration. It provides factual and up-to-date descriptions of over 500 counseling-relevant…

Describes a computer-managed instructional system used to formulate, print, and evaluate true-false questions for testing purposes. The design of the system and its application in medical and nuclear engineering courses in two Spanish institutions of higher learning are detailed. (RAO)

A set of computer programs, which performs necessary item analysis and related procedures for developing new scales for the Minnesota Multiphasic Personality Inventory, is described. (Author/JKS)

Discusses ways of designing software to minimize the problems associated with translating the users interface from English into a foreign language. The Examiner, a test development and delivery system that was translated from English into Dutch, is used as an example, and both its design and its implementation are described. (LRW)

The author suggests that trainers charged with converting to computer-based training begin with a pilot program. He covers potential problems and how to address them. (CH)