For many years personalization of achievement testing has been impossible in all but the simplest forms. Recently, item response theory (IRT), or latent trait theory, has emerged as a valuable tool which brings far greater flexibility to the process than had previously been possible. The single parameter Rasch Model, a mathematical model developed…

Monte Carlo simulation was used to investigate score bias and information characteristics of Owen's Bayesian adaptive testing strategy, and to examine possible causes of score bias. Factors investigated in three related studies included effects of item discrimination, effects of fixed vs. variable test length, and effects of an accurate prior…

A computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB) is being developed to test ten areas of vocational aptitude. Development of the CAT-ASVAB is based upon the use of item banks, testing and scoring procedures, assessment of test reliability and test validity, a technical manual, and the…

The applicability of item characteristic curve (ICC) theory to a multiple choice test item pool used to measure achievement is described. The rationale for attempting to use ICC theory in an achievement framework is summarized, and the adequacy for adaptive testing of a classroom achievement test item pool in a college biology class is studied.…

A conventional vocabulary test and two forms of a stradaptive vocabulary test were administered by a time-shared computer system to undergraduate college students. The two stradaptive tests differed in that one counted question mark responses (i.e., omitted items) as incorrect and the other ignored items responded to with question marks.…

This study empirically investigated the validity and utility of the stratified adaptive computerized testing model (stradaptive]developed by Weiss (1973). The model presents a tailored testing strategy based on Binet IQ measurement theory and Lord's (1972) modern test theory. Nationally normed School and College Ability Test Verbal analogy items…

A number of strategies are described for adapting ability test items to individual differences in ability levels of testees. Each strategy consists of a different set of rules for selecting the sequence of test items to be administered to a given testee. Advantages and disadvantages of each strategy are discussed, and research issues unique to the…

Some of the benefits available from using computers to administer the kinds of tests that are familiar in educational settings are reviewed. Four applications that represent current or near-term enhancements of assessment are discussed: computerized adaptive testing, diagnostic testing, test preparation, and administration of simulations of…

Discusses the research and steps needed to develop performance-based and computer-adaptive assessments that are culturally responsive. Supports the development of a new conceptual framework and more explicit guidelines for designing culturally responsive assessments. (SLD)

Describes a tool for building software systems which replace the role of the examiner during a typical Italian academic exam in technical/scientific subjects. Such systems are designed to exploit the advantages of self-adapted testing for reducing effects of anxiety, and of computerized adaptive testing for increasing assessment efficiency.…

Measures of the robustness of disease class-specific diagnostic concepts could play a central role in training programs designed to assure the development of diagnostic competence. In the pilot study, the authors used disease/sign-symptom conditional probability estimates, Monte Carlo procedures, and artificial intelligence (AI) tools to create…

The perspective of the examinee during the administration of a computerized adaptive test (CAT) is discussed, focusing on issues of test development. Item review is the first issue discussed. Virtually no CATs provide the opportunity for the examinee to go back and review, and possibly change, answers. There are arguments on either side of the…

The Educational Testing Service is moving rapidly to computerize its tests for admissions to postsecondary education and occupational licensure/certification. Computerized tests offer important advantages, including immediate score reporting, the convenience of testing when the examinee wishes, and for adaptive tests, equal accuracy throughout the…

The relationships among teaching, testing, and learning are examined and reconceptualized based on different theories and computer adaptive testing. Approaches that integrate teaching, testing, and learning include: (1) behavioral psychology; (2) cognitive psychology; and (3) computer adaptive testing (CAT). Some behaviorists have assumed that all…

This report examines the potential of adaptive testing, two-stage testing in particular, for improving the data quality of the National Assessment of Educational Progress (NAEP). Following a discussion of the rationale for adaptive testing in assessment and a review of previous studies of two-stage testing, this report describes a 1993 Ohio field…