This paper suggests several item selection criteria for adaptive testing that are all based on the use of the true posterior. Some of the ability estimators produced by these criteria are discussed and empirically criticized. (SLD)

This survey of recent developments in language testing offers a broad view of the field by focusing on significant developments that have occurred in the last half decade, including theoretical developments, practical developments, and recent resources. (Author/VWL)

Provides a broad overview of computerized testing issues with an emphasis on computer-adaptive testing (CAT). A survey of the potential benefits and drawbacks of CAT are given, the process of CAT development is described; and some L2 instruments developed to assess various language skills are summarized. (Author/VWL)

Examines the components required to assess student problem solving in technology environments. Discusses the purposes of testing, provides an example demonstrating the difference between retention and transfer, defines and analyzes problem solving, and explores techniques and standards for measuring the quality of student understanding. Contains…

Studied the cross-mode equivalence of paper-and-pencil and computer-based clerical tests with 141 undergraduates. Found no differences across modes for the two types of tests. Differences can be minimized when speeded computerized tests follow the same administration and response procedures as the paper format. (SLD)

Compared results from computer-adaptive and self-adaptive tests under conditions in which item review was and was not permitted for 379 college students. Results suggest that, when given the opportunity, most examinees will change answers, but usually only to a small portion of items, resulting in some benefit to the test taker. (SLD)

Examined the effect of taking open-ended tests on computers and on paper for students with different levels of computer skill using items from the Massachusetts Comprehensive Assessment System and the National Assessment of Educational Progress for 287 middle school students. Results suggest a large effect of mode of administration on student…

A simulation study was conducted to investigate the application of expected a posteriori (EAP) trait estimation in computerized adaptive tests (CAT) based on the partial credit model and compare it with maximum likelihood estimation (MLE). Results show the conditions under which EAP and MLE provide relatively accurate estimation in CAT. (SLD)

Investigated the functioning of a new computer-delivered graphical modeling (GM) response type for use in a graduate admissions assessment using two GM tests differing in item features randomly spiraled among participants. Results show GM scores to be reliable and moderately related to the quantitative section of the Graduate Record Examinations.…

The experience of a county government illustrates factors to consider in implementing online employment testing for job candidates: (1) selection of the appropriate Internet-based test; (2) passwords, timing, security, and technical difficulties; and (3) provisions for applicants who lack Internet access. (SK)

Gives an overview of new technologies--Internet, World Wide Web, and multimedia--including their problems and limitations. Presents implications for career assessment. (SK)

Conducted a simulation study of differential item functioning (DIF) to compare the power and Type I error rates for two conditions: using an examinee's ability estimate as the conditioning variable with the CATSIB program and either using the regression correction from CATSIB or not. Discusses implications of findings for DIF detection. (SLD)

Many credentialing agencies today are either administering their examinations by computer or are likely to be doing so in the coming years. Unfortunately, although several promising computer-based test designs are available, little is known about how well they function in examination settings. The goal of this study was to compare fixed-length…

When we think about assessment using digital technologies, we often assume this means the introduction of computer-based tests. There are, however, other ways of using assessment for learning in which technology can play a useful and important role. This paper will discuss an innovative project, eVIVA, which uses mobile phones and the Internet to…

This article sets out a practitioner's perspective on the International Test Commission (ITC) guidelines. After setting the scene and describing the testing environment in which the need for the Guidelines on Computer-Based and Internet-Delivered Testing (ITC, 2005) is established, the article goes on to identify specific issues of relevance to…