Computer-based testing by credentialing agencies has become common; however, selecting a test design is difficult because several good ones are available - parallel forms, computer adaptive (CAT), and multistage (MST). In this study, three computer-based test designs under some common examination conditions were investigated. Item bank size and…

The purpose of this paper is to describe some of the current changes in test development that are taking place because of the availability and capabilities of computers, especially microcomputers. Item banking and test assembly are discussed, and a comprehensive testing system is described. (BW)

A new method was developed to assist in the selection of a test length by utilizing computer simulation procedures and item response theory. A demonstration of the method presents results which address the influences of item pool heterogeneity matched to the objectives of interest and the method of item selection. (Author/PN)

The impact of capitalizing on chance in item selection on the accuracy of test information functions was studied through simulation, focusing on examinee sample size in item calibration and the ratio of item bank size to test length. (SLD)

Item parameter estimation errors in test development are highlighted. The problem is illustrated with several simulated data sets, and a conservative solution is offered for addressing the problem in item response theory test development practice. Steps that reduce the problem of capitalizing on chance in item selections are suggested. (SLD)

Errors in item parameter estimates have a negative impact on the accuracy of item and test information functions. The estimation errors may be random, but because items with higher levels of discriminating power are more likely to be selected for a test, and these items are most apt to contain positive errors, the result is that item information…

Addressing the shortcomings of classical item statistics for selecting criterion-referenced test items, this paper describes an optimal item selection procedure utilizing item response theory (IRT) and offers examples in which random selection and optimal item selection methods are compared. Theoretical advantages of optimal selection based upon…

This report provides a brief introduction to microcomputer technology and discusses five uses of microcomputers in classroom testing: item storage, test assembly, test administration, test scoring, and test score reporting and analysis. It focuses on the testing applications of microcomputer technology. (PN)

A brief overview of item response theory is provided, and a 186-item bibliography of books and articles on the subject dating from 1953 to June 1989 is presented. The overview includes a definition of the theory, a discussion of its development and application, and comparisons with classical test theory. All publications in the bibliography were…

This is one of the outcomes of the work of the Massachusetts Evaluation Service Center for Occupational Education (ESCOE). The purpose of the work described in this report is to provide a set of specific behavioral objectives for woodworking teachers to use in the development of their high school curricula. Special emphasis is given to a…

Outlines the specifications for objective-based programs in career education, describes the development of one component (an item and objective bank) of an objective-based woodworking program, and discusses the development of objectives and test items and the utilization of criterion-referenced testing data. A sample of the woodworking objectives…

Item response model applications to National Assessment of Educational Progress (NAEP) data specifically aimed at the uses of item response models in mathematics item banking are discussed. Approaches for addressing goodness of fit were organized into three categories: Checks on model assumptions, expected features, and additional model…