In this study, data from an operational computerized adaptive test (CAT) were examined in order to gather information concerning item response times in a CAT environment. The CAT under study included multiple-choice items measuring verbal, quantitative, and analytical reasoning. The analyses included the fitting of regression models describing the…

The Sympson and Hetter (SH; J. Sympson and R. Hetter; 1985; 1997) method is a method of probabilistic item exposure control in computerized adaptive testing. Setting its control parameters to admissible values requires an iterative process of computer simulations that has been found to be time consuming, particularly if the parameters have to be…

Item-exposure control in computerized adaptive testing is implemented by imposing item-ineligibility constraints on the assembly process of the shadow tests. The method resembles J. Sympson and R. Hetter's (1985) method of item-exposure control in that the decisions to impose the constraints are probabilistic. However, the method does not require…

Maximum likelihood and Bayesian estimates of proficiency, typically used in adaptive testing, use item weights that depend on test taker proficiency to estimate test taker proficiency. In this study, several methods were explored through computer simulation using fixed item weights, which depend mainly on the items difficulty. The simpler scores…

A two-stage design provides a way of roughly adapting item difficulty to test-taker ability. All test takers take a parallel stage-one test, and based on their scores, they are routed to tests of different difficulty levels in the second stage. This design provides some of the benefits of standard computer adaptive testing (CAT), such as increased…

In the context of examining the feasibility and advisability of computerizing the Law School Admission Test (LSAT), a review of current literature was conducted with the following goals: (1) determining the skills that are most important in good legal reasoning according to the literature; (2) determining the extent to which existing LSAT item…

A model for constrained computerized adaptive testing is proposed in which the information on the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing…

Computerized adaptive tests (CATs) are efficient because of their optimal item selection procedures that target maximally informative items at each estimated ability level. However, operational administration of these optimal CATs results in a relatively small subset of items given to examinees too often, while another portion of the item pool is…

The purpose of this study (1,313 college student participants) was to examine the differences in paper-based and Web-based administrations of a commonly used assessment instrument, the Force Concept Inventory (FCI) (D. Hestenes, M. Wells, and G. Swackhamer, 1992). Results demonstrated no appreciable difference on FCI scores or FCI items based on…

CATSIB is a differential item functioning (DIF) assessment methodology for computerized adaptive test (CAT) data. Kernel smoothing (KS) is a technique for nonparametric estimation of item response functions. In this study an attempt has been made to develop a more efficient DIF procedure for CAT data, KS-CATSIB, by combining CATSIB with kernel…

To measure workplace skills more realistically for certification purposes, two computer-delivered performance examinations, termed "Live Application" exams, were developed to test job-related competencies in a specific software product, Lotus Notes. As in the real world, success on examination tasks was determined by the examinee's final…

Because scores on high-stakes tests influence many decisions, tests need to be secure. Decisions based on scores affected by preknowledge of items are unacceptable. New methods are needed to detect the new cheating strategies used for computer-administered tests because item pools are typically used over time, providing the potential opportunity…

Describes the Examination Question System, a computer-assisted testing system developed by and used at the University of Mississippi School of Health Related Professions. Individual programs within the system are described and ordering information is included. (JJD)

"Spelling Bee" is a computer program (Applesoft Basic), suitable for grades K-3, consisting of several "modes" and 11 units of spelling words. "Modes" include Demonstration (teacher preview of lessons), Learning Management (test preparation), Tutorial (student practice), and Drill (spelling test, which can be designed to meet individual student…

Discusses computer testing and test generation programs, focusing on generating printed tests with the computer and advantages of interactive computer testing over paper/pencil tests (providing that sufficient computer equipment is available to make it feasible). (JN)