This paper outlines a technique for differentially weighting options of a multiple choice test in a fashion that maximizes the item predictive validity. The rule can be applied with different number of categories and the "optimal" number of categories can be determined by significance tests and/or through the R2 criterion. Our theoretical analysis…

From 13 objective interview items, five with adequate response variability were studied to determine if they would improve the validity of a verbal ability selection test in predicting work performance of 181 psychiatric aide trainees. In a multiple regression analysis, the verbal test correlated .27 with the weighted composite rating score.…

The usefulness of response latency data for biographical inventory items was assessed for improving the inventory's validity. Focus was on assessing whether weighting item scores on the basis of their latencies improves the predictive validity of the inventory's total score. A total of 120 items from the Armed Services Applicant Profile (ASAP)…

Previous research has studied the effects of different methods of item option weighting on the reliability and concurrent and predictive validity of achievement tests. Increases in reliability are generally found, but with mixed results for validity. Several methods of producing option weights, (i.e., Guttman internal and external weights and…

This research attempted to interrelate several methods of producing option weights (i.e., Guttman internal and external weights and judges' weights) and examined their effects on reliability and on concurrent, predictive, and face validity. It was concluded that option weighting offered limited, if any, improvement over unit weighting. (Author/CTM)