Presents the human evaluation of ILIAD, a program for machine-aided indexing that was designed to assist expert librarians in computer-aided indexing and document analysis. Topics include controlled indexing and free indexing; natural language and concept-based information retrieval; evaluation methodology; syntactic variations; and a comparison…

The problem of determining the optimal cross-reference structure for a given index and for a given community of users is discussed. A cross-reference structure is represented as a graph in which the nodes are index terms and the links are relations between index terms. In order to clarify the concept of 'level of cross-referencing' the…

Describes exploratory experiments in evaluating and improving a thesaurus through studying its effect on retrieval. A formula was developed to measure the conceptual distance between queries and documents encoded as sets of thesaurus terms. Comparison to the performance of people judging conceptual distance shows that the formula accurately…

Discussion of the information needs of medical professionals and researchers focuses on the architecture of a Web portal designed to integrate advanced searching and indexing algorithms, an automatic thesaurus, and self-organizing map technologies to provide searchers with fine-grained results. Reports results of evaluation of spider algorithms…

The current state of information retrieval (IR) evaluation is reviewed with criticisms directed at the available test collections and the research and evaluation methodologies used, including precision and recall rates for online searches and laboratory tests not including real users. Automatic text retrieval systems are also discussed. (32…

Describes the indexing concept of entry terms, and evaluates existing terms in the Medical Subject Headings by comparing them to the results of an automatic indexer. The results of experimental testing of a strategy for creating entry terms using the algorithms of the automatic indexer are presented. (31 references) (CLB)

A DETAILED ANALYSIS OF THE RETRIEVAL EVALUATION RESULTS OBTAINED WITH THE AUTOMATIC SMART DOCUMENT RETRIEVAL SYSTEM FOR DOCUMENT COLLECTIONS IN THE FIELDS OF AERODYNAMICS, COMPUTER SCIENCE, AND DOCUMENTATION IS GIVEN IN THIS REPORT. THE VARIOUS COMPONENTS OF FULLY AUTOMATIC DOCUMENT RETRIEVAL SYSTEMS ARE DISCUSSED IN DETAIL, INCLUDING THE FORMS OF…

Describes a task-oriented assessment of two MEDLINE searching systems by medical students, one using Boolean searching on human-indexed thesaurus terms and one using natural language searching on words in the title, abstract, and indexing terms. Highlights include user certainty in answering questions, time needed, and user satisfaction.…

THE TWELFTH IN A SERIES COVERING RESEARCH IN AUTOMATIC STORAGE AND RETRIEVAL, THIS REPORT IS DIVIDED INTO THREE PARTS TITLED EVALUATION, CLUSTER SEARCHING, AND USER FEEDBACK METHODS, RESPECTIVELY. THE FIRST PART, EVALUATION, CONTAINS A COMPLETE SUMMARY OF THE RETRIEVAL RESULTS DERIVED FROM SOME SIXTY DIFFERENT TEXT ANALYSIS EXPERIMENTS. IN EACH…