Presents a general mathematical framework for information retrieval, in which query evaluation is seen as a mapping from the free term algebra built by query descriptors and weights to the semantic algebra of evaluation value. Competing mathematical models that try to describe how retrieval systems behave are reviewed. (Author/MBR)

Discusses the PRECALL, PRR (probability of relevance given retrieval), and EP (expected precision) approaches for dealing with the problem of weak ordering in information retrieval systems. Findings of two experiments comparing evaluation results obtained by PRR and EP are reported. Several mathematical formulas and proofs are included. (20…

The traditional concern with relevance or nonrelevance of unexamined documents is misplaced, and traditional measures of effectiveness should be replaced by estimates of direct utility of examined documents. (Author)

Six articles about evaluating information retrieval (IR) systems and methods are briefly described in this introduction to a special issue and some of the major problems that are encountered in evaluating interactive information retrieval are considered. (two references) (LAE)

Reviews and expands on a 1985 study that described a detailed evaluation of the effectiveness of an operational full-text information retrieval system, STAIRS, which was used by IBM for litigation support. Problems the user faces are described, and recall/precision studies are discussed. (27 references) (LRW)

Describes a new effectiveness measure as an alternative to the traditional evaluation measures of recall and precision in information retrieval systems. The statistical approach--which compares two retrieval algorithms--is explained, the information needs of the user are considered, and an experiment with a test collection of abstracts is…

Summarizes the similarities between classification systems for catalog selection and information retrieval systems, and discusses system characteristics that allow the use of measures such as recall and precision in system evaluation. (27 references) (Author/CLB)

The current state of information retrieval (IR) evaluation is reviewed with criticisms directed at the available test collections and the research and evaluation methodologies used, including precision and recall rates for online searches and laboratory tests not including real users. Automatic text retrieval systems are also discussed. (32…

Various methods for calculating and presenting results of information retrieval (IR) evaluation research are discussed, with illustrations from recent laboratory results. Highlights include measures for calculating recall and precision, user needs for high or low level of recall, and comparisons of Boolean and ranked output retrieval. (22…

Discusses approaches to the integration of query-based information retrieval and browsing in a hypertext network. A prototype system developed to evaluate the proposed approach in terms of retrieval effectiveness and search efficiency is presented, and design and implementation issues concerning the prototype are considered. (30 references) (EA)

These two articles discuss clustering structure in the Cystic Fibrosis Document Collection, which is derived from the National Library of Medicine's MEDLINE file. The exhaustivity of four subject representations and two citation representations is examined, and descriptor-weight thresholds and similarity thresholds are used to compute…

The increasing complexity of evaluating information retrieval (IR) systems is discussed in terms of contributing factors and research methods. Examples are provided from experiments with weighted searching on a front-end system, information-seeking behavior and online catalogs, and the OKAPI experimental retrieval system. (21 references) (LAE)

Introduces a special issue on research on hypertext systems and information retrieval. Systems design aspects, including navigation models, link weighting, multiple representation techniques, automatic authoring, user modelling, varying levels of abstraction, and evaluation techniques are addressed. (EA)

Reviews recent research into the use of hierarchic agglomerative clustering methods for document retrieval. The topics discussed include the calculation of interdocument similarities, algorithms used to implement clustering methods on large databases, validity testing of document hierarchies, appropriate search strategies, and other applications…

Describes the hyperterm system REALIST (Retrieval Aids by Linguistics and Statistics) with emphasis on its semantic component, which generates term relations from free-text input. Experiments with various similarity measures are discussed, and the quality of the associated terms is evaluated using term recall and term precision measures. (22…