Information Retrieval (IR) is one of the most evolving research fields and has drawn extensive attention in recent years. Because of its empirical nature, the advance of the IR field is closely related to the development of various toolkits. While the traditional IR toolkit mainly provides a platform to evaluate the effectiveness of retrieval…

Collecting (or "sampling") information that one expects to be useful is a powerful way to facilitate learning. However, relatively little is known about how people decide which information is worth sampling over the course of learning. We describe several alternative models of how people might decide to collect a piece of information…

The tremendously huge volume of biomedical literature, scientists' specific information needs, long terms of multiples words, and fundamental problems of synonym and polysemy have been challenging issues facing the biomedical information retrieval community researchers. Search engines have significantly improved the efficiency and effectiveness of…

Reports the results of experiments in document clustering using three well-known test collections. (Author)

Presents a general mathematical framework for information retrieval, in which query evaluation is seen as a mapping from the free term algebra built by query descriptors and weights to the semantic algebra of evaluation value. Competing mathematical models that try to describe how retrieval systems behave are reviewed. (Author/MBR)

Evaluates the effectiveness of spelling-correction and string-similarity matching methods in retrieving similar words in a Malay dictionary associated with a set of query words. Describes experiments that showed the best search combination used a stemming algorithm, and calculates retrieval effectiveness and relevant means measures from weighted…

Discussion of evaluation methodology in information retrieval focuses on the average precision over a set of fixed recall values in an effort to evaluate the retrieval effectiveness of a search algorithm. Highlights include a review of traditional evaluation methodology with examples; and a statistical inference methodology called bootstrap.…

Discusses approaches to the integration of query-based information retrieval and browsing in a hypertext network. A prototype system developed to evaluate the proposed approach in terms of retrieval effectiveness and search efficiency is presented, and design and implementation issues concerning the prototype are considered. (30 references) (EA)

Examines the problems of developing a framework and testbed for quantitative assessment of image retrieval effectiveness. To better harness the extensive research on content-based retrieval and improve capabilities of image retrieval systems, this article advocates the establishment of common image retrieval testbeds consisting of standardized…

Discusses general issues of computer and human understanding; contrasts three paradigms of information retrieval methodology, including statistical, deep semantic or natural language, and smart Boolean; describes CONIT, a knowledge-based intermediary retrieval assistance system; and examines system evaluation procedures, including a…

A comparison of the effectiveness of information retrieval based on full-text documents with retrieval based on paragraphs, abstracts, or controlled vocabularies was accomplished using a subset of journal articles with nine search questions. It was found that full-text retrieval achieved significantly higher recall and lower precision than did the…

In an attempt to measure on-line searching performance, test searches of one question conducted by three bibliographic searchers are analysed to determine the effects of search strategy on results. The study reviews retrieved citations for relevance, calculating precision values, and estimated recall for each search. Performance analysis reveals…

The following topics are included in this document: (1) evaluation of plans for implementation of new systems; (2) macroevaluation of document retrieval systems; (3) microevaluation of retrospective searching; (4) evaluation of document acquisition functions; evluation of indexing and indexing languages; (5) evaluation of document screening; (6)…

Discusses the concept of search failure in document retrieval systems and three effectiveness measures, precision, recall, and "fallout." Four research methods--retrieval effectiveness measures, user satisfaction measures, transaction log analysis, and critical incident technique--are examined, and findings of major studies using each of the…

Describes a study conducted at Oregon Health Sciences University that compared the use of three retrieval systems by medical students: a Boolean system, a word-based natural language system, and a concept-based natural language system. Results showed no statistically significant differences in recall, precision, or user preferences. (Author/LRW)