Examines the use of various statistical techniques for generating domain-oriented multiword vocabulary terms for natural language database systems. Conclusions show the vocabulary clustering effect should be considered when making significance calculations and that a simple ratio of subject matter relative frequency to total sample relative…

Describes a general framework for the evaluation of sets of links for user navigation between images in pictorial data banks and gives an example of the construction of a connection graph in a large image bank. A study of user navigation behavior in this set of links is described and the results are discussed. (18 references) (LAE)

Describes the hyperterm system REALIST (Retrieval Aids by Linguistics and Statistics) with emphasis on its semantic component, which generates term relations from free-text input. Experiments with various similarity measures are discussed, and the quality of the associated terms is evaluated using term recall and term precision measures. (22…

Reviews and expands on a 1985 study that described a detailed evaluation of the effectiveness of an operational full-text information retrieval system, STAIRS, which was used by IBM for litigation support. Problems the user faces are described, and recall/precision studies are discussed. (27 references) (LRW)

Describes a study of undergraduate students' search sessions on a full-text information retrieval system, NEXIS, that was conducted (1) to evaluate a novice user's ability to use such an information retrieval system, and (2) to analyze users' information seeking behavior. Sense-making theory and timeline interviews are discussed. (38 references)…

Describes work performed under the Spelling Error Detection Correction Project (SPEEDCOP) at Chemical Abstracts Service to devise effective automatic methods of detecting and correcting misspellings in scholarly and scientific text. The trigram analysis technique developed determined sites but not types of errors. Thirteen references are listed.…

The current state of information retrieval (IR) evaluation is reviewed with criticisms directed at the available test collections and the research and evaluation methodologies used, including precision and recall rates for online searches and laboratory tests not including real users. Automatic text retrieval systems are also discussed. (32…

Describes computer program which converts text of user input and system responses from online search system into fixed format records describing interaction. Query language syntax, format of output record produced by parser, problems in constructing parser, its performance characteristics, and recommendations for improving process of logging…

Discussion of online bibliographic database searches focuses on a software system, SORT-AID/SABRE, that ranks retrieved citations in terms of relevance. Results of a comprehensive user evaluation of the relevance ranking procedure to determine its effectiveness are presented, and implications for future work are suggested. (10 references) (LRW)

The increasing complexity of evaluating information retrieval (IR) systems is discussed in terms of contributing factors and research methods. Examples are provided from experiments with weighted searching on a front-end system, information-seeking behavior and online catalogs, and the OKAPI experimental retrieval system. (21 references) (LAE)

Describes an investigation of tools, techniques, and methods for the evaluation of interactive library catalogs, with emphasis on diagnostic methods and on use of the catalog in the wider context of user information-seeking behavior. A front-end system (Olive) developed to test various enhancements of traditional transaction lodging as a…

Describes a study of medical students that was conducted to evaluate measures of performance on factual searches of INQUIRER, a full-text database in microbiology. Measures relating to recall, precision, search term overlap, and efficiency are discussed; reliability and construct validity are considered; and implications for future research are…