Previous studies have shown that, when administered a self-adapted test, a few examinees will choose item difficulty levels that are not well-matched to their proficiencies, resulting in high standard errors of proficiency estimation. This study investigated whether the previously observed effects of a self-adapted test--lower anxiety and higher…

Expert systems can be used to aid decisionmaking. A computerized adaptive test is one kind of expert system, although not commonly recognized as such. A new approach, termed EXSPRT, was devised that combines expert systems reasoning and sequential probability ratio test stopping rules. Two versions of EXSPRT were developed, one with random…

The graded response model for two-stage testing was applied to an attitudes toward science scale using real-data simulation. The 48-item scale was administered to 920 students at a grade-8 equivalent in Singapore. A two-stage 16-item computerized adaptive test was developed. In two-stage testing an initial, or routing, test is followed by a…

According to item response theory (IRT), examinee ability estimation is independent of the particular set of test items administered from a calibrated pool. Although the most popular application of this feature of IRT is computerized adaptive (CA) testing, a recently proposed alternative is self-adapted (SA) testing, in which examinees choose the…

Tailored Response Testing (TRT) is a new type of test that has demonstrated its applicability to the evaluation of human performance in a wide variety of occupations and work settings. The Navy is using TRT to measure the technical proficiency of job incumbents in three of its jobs. The methodology holds great promise for testing aboard ships as…

A study was conducted to validate the Army's Computerized Adaptive Screening Test (CAST), using data from 2,240 applicants from 60 army recruiting stations across the nation. CAST is a computer-assisted adaptive test used to predict performance on the Armed Forces Qualification Test (AFQT). AFQT scores are computed by adding four subtest scores of…

The current technology of computerized testing is discussed, and a few comments are made on how such technology might be used for assessing school-related skills as part of the National Assessment of Educational progress (NAEP). The critical feature of computerized assessment procedures is that the test items are presented in interactive fashion,…

The purpose of this paper is to present two new alternative methods to the current goodness of fit methodology. With the increase use of computerized adaptive test (CAT), the ability to determine the accuracy of calibrated item parameter estimates is paramount. The first method applies a normalizing transformation to the logistic residuals to make…

In self-adapted testing, examinees are allowed to choose the difficulty of each item to be presented immediately before attempting it. Previous research has demonstrated that self-adapted testing leads to better performance than do fixed-order tests and is preferred by examinees. The present study examined the strategies that 29 college students…

Examinees (N=1,233) at the Johnson O'Connor Research Foundation (JOCRF) were administered one of three test forms in which only item order differed. The study was undertaken to determine the validity of the assumption underlying item response theory (IRT) that there are fixed item parameters that can predict performance. The Rasch IRT model was…

The use of computers to build diagnostic inferences is presented in two contexts: (1) closed world, exemplified by the space shuttle launch monitoring system; and (2) open world, represented by computerized diagnostic testing of reading comprehension. The analysis shows that the closed world provides a substantially cleaner environment within…

Simple sum procedure of the conditional PDF approach (plausiblity of distractor function) combined with the normal approach method was applied for estimating the plausibility functions of the distractors of the Level II vocabulary subtest items of the Iowa Tests of Basic Skills. In so doing, the normal ogive model was adopted for the correct…

The theory and technology of item characteristic curve (ICC) response theory and adaptive testing were applied to judging individuals' competencies against a prespecified mastery level to determine whether each individual is a "master" or "nonmaster" of a specified content domain. Items from two conventionally administered mastery tests…

A simulation study to determine appropriate linking methods for adaptive testing items was designed. Three basic data sets for responses were created. These were randomly sampled, systematically sampled, and selected data sets. The evaluative criteria used were fidelity of parameter estimation, asymptotic ability estimates, root-mean-square error…

Two methods of interactive, computer-assisted testing methods for multiple-choice items were compared with each other and with conventional multiple-choice tests. The interactive testing methods compared were tailored testing and the respond-until-correct (RUC) item response method. In tailored testing, examinee ability is successively estimated…