A client of American College Testing, Inc. (ACT) decided to implement a computer-based testing program to replace their paper-pencil format for professional certification. This paper reports on the results of the developed test after 1 year's use, especially as the results relate to test security issues. ACT research shows that a variable length…

New items are being calibrated for the next generation of the computerized adaptive (CAT) version of the Armed Services Vocational Aptitude Battery (ASVAB) (Forms 5 and 6). The requirements that the items be "good" three-parameter logistic (3-PL) model items and typically "like" items in the previous CAT-ASVAB tests have…

This study examined the effectiveness of the Sympson and Hetter conditional procedure (SHC), a modification of the Sympson and Hetter (1985) algorithm, in controlling the exposure rates of items in a computerized adaptive testing (CAT) environment. The properties of the procedure were compared with those of the Davey and Parshall (1995) and the…

Item selection methods in computerized adaptive testing (CAT) can yield extremely skewed item exposure distribution in which items with high "a" values may be over-exposed while those with low "a" values may never be selected. H. Chang and Z. Ying (1999) proposed the a-stratified design (ASTR) that attempts to equalize item…

A study was conducted to investigate whether augmenting the calibration of items using computerized adaptive test (CAT) data matrices produced estimates that were unbiased and improved the stability of existing item parameter estimates. Item parameter estimates from four pools of items constructed for operational use were used in the study to…

Outside of large-scale testing programs, the computerized adaptive test (CAT) has thus far had only limited impact on measurement practice. In smaller-scale testing contexts, limited data are often available, which precludes the establishment of calibrated item pools for use by traditional (i.e., item response theory (IRT) based) CATs. This paper…

A study was conducted to extend the sequential probability ratio testing (SPRT) procedure with the polytomous model under some practical constraints in computerized classification testing (CCT), such as methods to control item exposure rate, and to study the effects of other variables, including item information algorithms, test difficulties, item…

In June 2004, in conjunction with the Council of Chief State School Officers' (CCSSO) 34th national conference on large-scale assessment, the Institute for the Advancement of Emerging Technologies in Education (IAETE) at AEL hosted a daylong symposium to discuss critical policy issues related to technology-supported assessments. Held in Boston,…

Describes an interactive testing program which uses a sequential text file containing test items. Once the file is created the program does the administration and grading of the test. The complete Applesoft program listing is included. (JN)

Describes confidence testing methods (confidence weighting, probabilistic marking, multiple alternative selection) as alternative to computer-based, multiple choice tests and explains potential benefits (increased reliability, improved examinee evaluation of alternatives, extended diagnostic information and remediation prescriptions, happier…

Discusses how to design a large exam question file for any discipline and how to use this file to extract examinations. (MLH)

Discusses advantages and limitations of online exams, describes available software tools for creating computer-based tests (CGI, JavaScript, commercial programs, course authoring tools), and offers suggestions for implementation. (JOW)

Syntactic processing was explored in nine individuals who stutter (IWS). Grammaticality judgments and event-related brain potentials (ERPs) were obtained while participants read sentences, half containing verb-agreement violations, via computer or paper. Judgment accuracy of IWS for the online task, but not offline, was lower, especially for more…

Studied three stratification designs for computerized adaptive testing in conjunction with three well-developed content balancing methods. Simulation study results show substantial differences in item overlap rate and pool utilization among different methods. Recommends an optimal combination of stratification design and content balancing method.…

Explored procedures to detect test takers using item preknowledge in computerized adaptive testing and suggested a Bayesian posterior log odds ratio index for this purpose. Simulation results support the use of the odds ratio index. (SLD)