The relationship between true ability (operationally defined as the number of items for which the examinee actually knew the correct answer) and the effects of guessing upon observed test variance was investigated. Three basic hypotheses were treated mathematically: there is no functional relationship between true ability and guessing success;…

A model is presented for test construction and scoring that utilizes the knapsack model of mathematical programing. The method applies to examinations of the type in which a choice exists in the number of questions the examinee is required to answer. The method has been utilized with respect to a mathematics examination, and computer-generated…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…

This handbook presents instructions for implementing a confidence testing program in technical training situations, identification of possible areas of application, techniques for evaluating confidence information, advantages and disadvantages of confidence testing, time considerations, and problem areas. Complete instructions for "Pick-One" and…

In October 1981, the Graduate Record Examinations (GRE) Program introduced a new version of the General Test (GT) that differed from the previous version in three major ways. The GT was altered to: reduce the verbal measure's speededness and allow the addition of several quantitative items; delete two item types from the analytical measure; and…

The purpose of this study was to determine whether it would be possible to equate rights-scored to formula-scored tests without causing a discontinuity in the meaning of the score scale. Several other subsidiary studies--of the characteristics of the two scoring methods, of nonresponse and guessing, and of reliability and parallelism--were also…

While most school districts believe they understand grade equivalent scores, teachers, parents, and measurement specialists frequently misinterpret this apparently simple statistical expression. Echternacht's article describes the construction, application, and interpretation of grade equivalent scores from the test publisher's perspective.…

A 15-stage pyramidal test and a 40-item two-stage test were constructed and administered by computer to 111 college undergraduates. The two-stage test was found to utilize a smaller proportion of its potential score range than the pyramidal test. Score distributions for both tests were positively skewed but not significantly different from the…

In some testing programs an early item analysis is performed before final scoring in order to validate the intended keys. As a result, some items which are flawed and do not discriminate well may be keyed so as to give credit to examinees no matter which answer was chosen. This is referred to as allkeying. This research examined how varying the…

This brief review explains some alternate scoring procedures to the classical method of summing correct responses. The novel procedures attempt in some way to retrieve and use even the information in the wrong responses. (Author)

This study describes intergroup guessing differences in response to tests and to test-like tasks. It is a composite of seven component inquiries with three substudies in Phase 1 and four in Phase 2. These seven studies cover the Graduate Record Examination (GRE) item-type domain from a number of viewpoints relevant to implicit guessing behavior.…

Reviews the literature on subgroup norming in testing and examines several types of score-adjustment methods. The authors discuss social and policy perspectives as well as the scientific and theoretical underpinnings of score adjustment. (GLR)

Focuses on score adjustment by racial or ethnic group (race norming) in employment testing, and provides a history of the original controversy. The author analyzes race-based adjustments in test scores and discusses how personnel-selection science is being compromised in an effort to reconcile contradictory legal demands. (GLR)