Compared the impact of computer-assisted psychological assessment on respondents to traditional psychometric administration procedure. Findings indicated no difference between administration methods on respondents' self-reported anxiety, electromyograph monitored stress, or task satisfaction. Moreover, computer-assisted assessment was more…

Two college of education experts present a system which trains university students to administer and interpret standardized tests such as the Wechsler Intelligence Scale for Children-Revised (WISC-R), thus easing time demands upon their instructors. (JN)

Suggestions for software design in computer managed testing (CMT) cover instructions to testees, their physical format, provision of practice items, and time limit information; test item presentation, physical format, discussion of task demands, review capabilities, and rate of presentation; pedagogically helpful utilities; typefonts; vocabulary;…

This article describes some of the programming improvements made to a computer-based instructional support system after it was operating as had been envisioned during its design. Changes were made to accommodate differences between the original objectives and what users discovered they really wished to do. (Author/BD)

Imposing time limits on tests can serve a range of important functions. Time limits are essential, for example, if speed of performance is an integral component of what is being measured, as would be the case when testing such skills as how quickly someone can type. Limiting testing time also helps contain expenses associated with test…

Test security has often been a problem in computerized adaptive testing (CAT) because the traditional wisdom of item selection overly exposes high discrimination items. The a-stratified (STR) design advocated by H. Chang and his collaborators, which uses items of less discrimination in earlier stages of testing, has been shown to be very…

In the a-stratified method, a popular and efficient item exposure control strategy proposed by H. Chang (H. Chang and Z. Ying, 1999; K. Hau and H. Chang, 2001) for computerized adaptive testing (CAT), the item pool and item selection process has usually been divided into four strata and the corresponding four stages. In a series of simulation…

A client of American College Testing, Inc. (ACT) decided to implement a computer-based testing program to replace their paper-pencil format for professional certification. This paper reports on the results of the developed test after 1 year's use, especially as the results relate to test security issues. ACT research shows that a variable length…

New items are being calibrated for the next generation of the computerized adaptive (CAT) version of the Armed Services Vocational Aptitude Battery (ASVAB) (Forms 5 and 6). The requirements that the items be "good" three-parameter logistic (3-PL) model items and typically "like" items in the previous CAT-ASVAB tests have…

This study examined the effectiveness of the Sympson and Hetter conditional procedure (SHC), a modification of the Sympson and Hetter (1985) algorithm, in controlling the exposure rates of items in a computerized adaptive testing (CAT) environment. The properties of the procedure were compared with those of the Davey and Parshall (1995) and the…

Item selection methods in computerized adaptive testing (CAT) can yield extremely skewed item exposure distribution in which items with high "a" values may be over-exposed while those with low "a" values may never be selected. H. Chang and Z. Ying (1999) proposed the a-stratified design (ASTR) that attempts to equalize item…

A study was conducted to investigate whether augmenting the calibration of items using computerized adaptive test (CAT) data matrices produced estimates that were unbiased and improved the stability of existing item parameter estimates. Item parameter estimates from four pools of items constructed for operational use were used in the study to…

Outside of large-scale testing programs, the computerized adaptive test (CAT) has thus far had only limited impact on measurement practice. In smaller-scale testing contexts, limited data are often available, which precludes the establishment of calibrated item pools for use by traditional (i.e., item response theory (IRT) based) CATs. This paper…

A study was conducted to extend the sequential probability ratio testing (SPRT) procedure with the polytomous model under some practical constraints in computerized classification testing (CCT), such as methods to control item exposure rate, and to study the effects of other variables, including item information algorithms, test difficulties, item…

In June 2004, in conjunction with the Council of Chief State School Officers' (CCSSO) 34th national conference on large-scale assessment, the Institute for the Advancement of Emerging Technologies in Education (IAETE) at AEL hosted a daylong symposium to discuss critical policy issues related to technology-supported assessments. Held in Boston,…