Discusses the problem of determining an adequate sample size for an information retrieval experiment comparing two systems on separate samples of requests. The application of statistical methods to information retrieval experiments is discussed, the Mann-Whitney U Test is used for determining minimum sample sizes, and variables and distributions…

Examines the statistical distribution of relevance judgments by reviewing and comparing the results of several studies over the last three decades. A characteristic distribution is examined, and a hypothesis is offered to explain it based on human judging characteristics and the nature of relevance experimentation. (Contains 13 references.) (LRW)

Comparing variability of test scores across alternate forms, test conditions, or subpopulations is a fundamental problem in psychometrics. A confidence interval for a ratio of standard deviations is proposed that performs as well as the classic method with normal distributions and performs dramatically better with nonnormal distributions. A simple…

Describes research which measured the efficiency of role operators through frequency of appearances in PRECIS input strings for 200 abstracts related to taxation, genetic psychology, and Shakespearian drama. Frequencies of appearance of major categories of role operators, role operators in different subjects, individual main line operators, and…

Describes the development of computer-based searching methods to support literature-based discoveries in medical literature through a replication of the discovery of a connection between Raynaud's disease and dietary fish oil. Topics include the logic of literature-based discovery, information retrieval methods for text analysis, and statistics…

Summarizes the experimental evidence that indicates that text indexing systems based on the assignment of appropriately weighted single terms produce retrieval results superior to those obtained with more elaborate text representations, and provides baseline single term indexing models with which more elaborate content analysis procedures can be…

Describes study that compared terminology indexing and citation indexing to determine the similarity of documents retrieved. Information science articles from 1971 to 1983 in three journals were studied for term co-occurrences. The distinction between relevant and pertinent documents is discussed, and further research topics are suggested. (LRW)

This second report on a two-part study on the application of informetrics to information retrieval (IR) system design used models of database contents in a factorial simulation study at the University of Western Ontario. The study explored whether different file structures were better suited for different informetric environments. (32 references)…