This study was conducted in order to evaluate available linking techniques for forming large item pools and to make recommendations as to which techniques should be used under various circumstances. Variables of interest included calibration model and procedure, sample size, overlap level, and linking procedure. The calibration models considered…

It is widely believed that item selection methods using the maximum information approach (MI) can maintain high efficiency in trait estimation by repeatedly choosing high discriminating (alpha) items. However, the consequence is that they lead to extremely skewed item exposure distribution in which items with high alpha values becoming overly…

Two mathematical programming approaches are presented for the assembly of ability test from item pools calibrated under a multidimensional item response theory model. Item selection is based on Fisher's Information matrix. Several criteria can be used to optimize this matrix. In this paper, the A-criterion and the D-criterion are applied. In a…

Combined the methods of alpha-stratified adaptive testing and constrained adaptive testing with shadow tests. Outlines the advantages of this approach in reducing overexposure and underexposure of items in an item pool and illustrates these advantages with an example from the Law School Admission Test. (SLD)

In optimal assembly of tests from item banks, linear programming (LP) models have proved to be very useful. Assembly by hand has become nearly impossible, but these LP techniques are able to find the best solutions, given the demands and needs of the test to be assembled and the specifics of the item bank from which it is assembled. However,…

This research aimed to assess the underlying dimensionality of items commonly used to assess applicants' perceptions of job and organizational characteristics. First, exploratory factor analysis (EFA) was used to determine the number of underlying constructs in a job and organizational characteristics scale. The initial sample consisted of 450…

The national certification tests and entrance examinations are the most important tests for proving the ability or knowledge level of a person. To accurately evaluate the professional skills or knowledge level, the composed test sheets must meet multiple assessment criteria such as the ratio of relevant concepts to be evaluated and the estimated…

This paper discusses optimal test construction, which deals with the selection of items from a pool to construct a test that performs optimally with respect to the objective of the test and simultaneously meets all test specifications. Optimal test construction problems can be formulated as mathematical decision models. Algorithms and heuristics…

Presented is an integer-programming approach to item pool design that can be used to calculate an optimal blueprint for an item pool to support an existing testing program. The results are optimal in the sense that they minimize the efforts involved in actually producing the items as revealed by current item writing patterns. Also presented is an…