Reports findings of a study conducted at the University of Michigan that replicated an earlier study on users' perceptions of the binary, or dichotomous, nature of their relevance judgments in information retrieval evaluation. Results that support the earlier study are discussed, and further research is suggested. (LRW)

Discussion of the solicitation and measurement of relevance judgments focuses on a study of faculty and doctoral students at the University of Michigan that examined how users' judgments of document representations changed as more information about the documents was revealed to them. The use of magnitude estimation techniques is also discussed.…

This study examined judgments of document relevance made by library science graduate students who were not the originators of the queries for which the documents were retrieved. Although the secondary judgments compared well with those of the original users, it was found that secondary judges used document record fields differently and had a…

Describes an empirical study that investigated how well people in the information science field perform as judges of document relevance, topicality, and utility for information needs that they did not originate. Results are compared to the actual users' judgments, and the effects of experience and gender are explored. (Contains 17 references.)…