The purpose of this study is to generate non-verbal items for a visual reasoning test using templated-based automatic item generation (AIG). The fundamental research method involved following the three stages of template-based AIG. An item from the 2016 4th-grade entrance exam of the Science and Art Center (known as BILSEM) was chosen as the…

This dissertation develops and applies sophisticated Item Response Theory (IRT) methods to address fundamental measurement challenges in cognitive testing, focusing on the Armed Services Vocational Aptitude Battery (ASVAB) data from the National Longitudinal Survey of Youth (NLSY). The first chapter implements a confirmatory multidimensional IRT…

The aim of this research is to study the accurate prediction of comparing test information and evaluation result by multidimensional computerized adaptive scholastic aptitude test program used for grade 9 students under different reviewing test conditions. Grade 9 students of the Secondary Educational Service Area Office in the North-east of…

Three prototypes of paper-and-pencil based adaptive tests were developed, refined and developed in sufficient quantities for administration to groups of 40 subjects. Two aptitude areas were employed in each prototype. These were Word Knowledge and Arithmetic Reasoning. A total of 711 Basic Airmen Recruits were administered the prototypes in both…

Presents two studies applying computerized adaptive testing (CAT) in schools. Compared paper-administered, computer-administered, and CAT modes for administering school achievement and assessment tests. Then compared computerized adaptive aptitude test results with individually administered Weschler Intelligence Scale for Children-Revised. Found…

Twelve structural models of similarity were fitted to data from conventional and computer adaptive test (CAT) batteries measuring the same aptitude in a double cross-validation design. Three of the 12 models, including a multiplicative structure model, performed well, providing support for using CATs as replacements for conventional tests. (NSF)

Proposes a procedure for empirical initialization of the trait (theta) estimator in adaptive testing that is based on the statistical relation between theta and background variables known prior to test administration. Illustrates the procedure for an adaptive version of a test from the Dutch General Aptitude Battery. (SLD)

This book documents the research, development, and implementation efforts that allowed the U.S. Department of Defense to initiate the Computerized Adaptive Testing Armed Services Vocational Aptitude Battery Program for enlistment testing. Traces the history of this program over 30 years. (SLD)

Computer Adaptive Sequential Testing (CAST) is a test delivery model that combines features of the traditional conventional paper-and-pencil testing and item-based computerized adaptive testing (CAT). The basic structure of CAST is a panel composed of multiple testlets adaptively administered to examinees at different stages. Current applications…

Conventional Armed Services Vocational Aptitude Battery-7 (ASVAB) Arithmetic Reasoning and Word Knowledge tests, were compared with computer-administered adaptive tests as predictors of performance in an Air Force Jet Engine Mechanic training course (n=495). Results supported earlier research in showing somewhat longer examinee response times for…

A computerized adaptive test of word knowledge was administered over the telephone by reading items and response alternatives to 144 recent military enlistees who had completed the Armed Services Vocational Aptitude Battery. Correlations, factor loadings, and administration time indicate that the procedure is a good measure of crystallized verbal…

The relationship between selected subtests from the Armed Services Vocational Aptitude Battery (ASVAB) and corresponding subtests administered as computerized adaptive tests (CAT) was investigated using a sample of Marine recruits. Results showed that the CAT subtest scores correlated as well with initial ASVAB scores as did ASVAB retest scores,…

The Navy Personnel Research and Development Center is developing a computerized adaptive test (CAT) administration, scoring, and reporting system for use in the selection and classification of military applicants. Scaling of the CAT version of the Armed Services Vocational Aptitude Battery (ASVAB) will produce CAT scores comparable to the current…

The effects of a fixed and variable entry procedure on bias and information of a Bayesian adaptive test were compared. Neither procedure produced biased ability estimates on the average. Bias at the distribution extremes, efficiency curves, item subsets generated for administration, and items required to reach termination are discussed. (TJH)

Computerized adaptive testing (CAT) offers the opportunity to replace paper-and-pencil aptitude tests such as the Armed Services Vocational Aptitude Battery with shorter, more accurate, and more secure computer-administered tests. Its potential advantages need to be verified by experimental administration of automated tests to military recruit…