We determined the recommendations for preparing and scoring constructed-response (CR) test items in 25 sources (textbooks and chapters) on educational and psychological measurement. The project was similar to Haladyna's (2004) analysis for multiple-choice items. We identified 12 recommendations for preparing CR items given by multiple sources,…

In the context of paper and pencil testing, the frequency of the exposure of items is usually controlled through policies that regulate both the reuse of test forms and the frequency with which a candidate may retake the test. In the context of computerized adaptive testing, where item pools are large and expensive to produce and testing can be on…

A specific application of the process of automating exams for any introductory statistics course is described. The process of automating exams was accomplished by using the Statistical Test Item Collection System (STICS). This system was first used to select a set of questions based on course requirements established in advance; afterward, STICS…

Recently, behavioral scientists have examined interpersonal manipulation and its effects on individuals, groups, and society. Richard Christie's description of the Machiavellian personality orientation highlights the behaviors of those individuals who are highly successful manipulators of others. Scanning some Machiavellian works for items to tap…

This bibliography includes papers concerned with using a computer to help construct a list of questions for use as a test or exercise. It is not intended to contain references to papers which deal exclusively with computers administering tests. Sixty-four references are provided. (Author/WH)

Describes the SOCRATES Computer-Assisted Test Retrieval system available to the faculty and students of the California State University and Colleges. (Author/IRT)

This article describes some of the programming improvements made to a computer-based instructional support system after it was operating as had been envisioned during its design. Changes were made to accommodate differences between the original objectives and what users discovered they really wished to do. (Author/BD)

This Digest describes matrix sampling of test items as an approach to achieving broad coverage while minimizing testing time per student. Matrix sampling involves developing a complete set of items judged to cover the curriculum, then dividing the items into subsets and administering one subset to each student. Matrix sampling, by limiting the…

This study examined the effectiveness of the Sympson and Hetter conditional procedure (SHC), a modification of the Sympson and Hetter (1985) algorithm, in controlling the exposure rates of items in a computerized adaptive testing (CAT) environment. The properties of the procedure were compared with those of the Davey and Parshall (1995) and the…

A study was conducted to extend the sequential probability ratio testing (SPRT) procedure with the polytomous model under some practical constraints in computerized classification testing (CCT), such as methods to control item exposure rate, and to study the effects of other variables, including item information algorithms, test difficulties, item…

Discusses how to design a large exam question file for any discipline and how to use this file to extract examinations. (MLH)

Studied three stratification designs for computerized adaptive testing in conjunction with three well-developed content balancing methods. Simulation study results show substantial differences in item overlap rate and pool utilization among different methods. Recommends an optimal combination of stratification design and content balancing method.…

For measurement of multiple traits, this paper proposes assembling tests based on the targets for the variance functions of the estimators of each of the traits. A linear programming model is presented to computerize the assembly process. An example of test assembly from a two-dimensional item pool is provided. (SLD)

Studied the impact of using five different exposure control algorithms in two sizes of item pool calibrated using the generalized partial credit model. Simulation results show that the a-stratified design, in comparison to a no-exposure control condition, could be used to reduce item exposure and overlap and increase pool use, while degrading…

Demonstrates mathematically that if every item in an item pool has an equal possibility to be selected from the pool in a fixed-length computerized adaptive test, the number of overlapping items among an alpha randomly sampled examinees follows the hypergeometric distribution family for alpha greater than or equal to 1. (SLD)