An accurately calibrated item bank is essential for a valid computerized adaptive test. However, in some settings, such as occupational testing, there is limited access to test takers for calibration. As a result of the limited access to possible test takers, collecting data to accurately calibrate an item bank in an occupational setting is…

Computer simulation was used to assess the effects of item parameter estimation errors on different item selection strategies used in adaptive and conventional testing. To determine whether these effects reduced the advantages of certain optimal item selection strategies, simulations were repeated in the presence and absence of item parameter…

To assess the feasibility of computer-assisted Federal Aviation Administration certification examinations, a system for administering the Private Pilot Certification Examination was implemented using PLATO. Characteristics, reactions, and guidelines for use of the test are included. (Author/JJD)

This book documents the research, development, and implementation efforts that allowed the U.S. Department of Defense to initiate the Computerized Adaptive Testing Armed Services Vocational Aptitude Battery Program for enlistment testing. Traces the history of this program over 30 years. (SLD)

Tests to assess problem-solving ability being provided for the Air Force are described, and some details on the development and validation of these computer-administered diagnostic achievement tests are discussed. Three measurement approaches were employed: (1) sequential problem solving; (2) context-free assessment of fundamental skills and…

This report describes the sequence of activities that took place as the Examination Division of the New Jersey Department of Civil Service introduced a word processing system for a test item bank and for production of camera-ready test copy. The equipment selection, installation and orientation procedures are discussed. Keyboard and CRT terminals,…

The Computerized Adaptive Testing (CAT) project is a joint Armed Services coordinated effort to develop and evaluate a system for automated, adaptive administration of the Armed Services Vocational Aptitude Battery (ASVAB). The CAT is a system for administering personnel tests that differs from conventional test administration in two major…

A computerized adaptive testing version of the Armed Services Vocational Aptitude Battery (CAT-ASVAB) is being developed to test ten areas of vocational aptitude. Development of the CAT-ASVAB is based upon the use of item banks, testing and scoring procedures, assessment of test reliability and test validity, a technical manual, and the…

This report examines how selection fairness is influenced by the characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, degree of item bias, and testing strategy. Computer simulation was used in the administration of either a conventional or Bayesian adaptive ability test to a…

This report describes technical plans and progress during the second year (Fiscal Year 1984) of work on the U.S. Army's Project A: "Improving the Selection, Classification, and Utilization of Army Enlisted Personnel." Project A is a long-range research program developed by the Army Research Institute for the Behavioral and Social…

In Arkansas, in reaction to complaints about traditional methods of selection for promotion, the civil service commission has chosen to base promotions in the police department solely on scores on locally-developed objective tests. Items developed and loaded into a computerized test bank were selected from six areas of responsibility: (1) criminal…

Technical advances of the last 15 years in measurement theory and practice are described, notably criterion-referenced testing, item response theory, and computers and testing. Several remaining problems concerning the development and validation of credentialing examinations are also considered. (Author/LMO)

An overview of the development of a computerized version of the Differential Aptitude Tests (DAT) is presented. It describes the previously existing printed version of the DAT, design of the computerized adaptive edition, calibration of the test items for use in the computerized version, and two field studies that compared the Adaptive and…

In order to take advantage of advances in the field of mental measurement, the Armed Forces and the Department of Defense have supported the development of a computerized adaptive version of the Armed Services Vocational Aptitude Battery (ASVAB) for use in military personnel selection and classification. This report describes the development and…

Computer adaptive testing systems are feasible for certification and licensure testing. This is in part due to the availability of extensive yet inexpensive computers. Modern item response theory, combined with computerized adaptive testing, yields a powerful new method of testing which provides greater accuracy and efficiency and less boredom for…