This paper examines representative research in information science and compares its designs to an abstract ideal of the experimental research design. Threats to validity of conclusions are highlighted, including history, maturation, testing, instrumentation, statistical regression, selection biases, experimental mortality, and selection-maturation…

Discussion of the development of expert systems for cataloging focuses on a feasibility study conducted at the National Agricultural Library. Topics addressed include the nature of cataloging expertise; limitations of existing expert systems; research on cataloging expertise; and a model for cataloging expertise based on five cataloging task…

Organizes, describes, and evaluates management information systems research from 1981 to 1985 to provide an understanding of what constitutes management information systems research and to indicate areas for future research. (210 references) (Author/CLB)

Describes and organizes the variables affecting display presentation format (i.e., tables and graphs) in information systems into a classification scheme and creates a framework for research in this area. Two-factor studies are discussed; research recommendations are presented; and Cognitive Match Interface Design is explained. (Contains 31…

Describes a study designed to evaluate the performance of an experimental semiautomatic map cataloging advisor, Mapper, in the descriptive cataloging of single-sheet maps from U.S. publishers. Hypotheses tested are discussed, treatment of experimental and control groups is described, and it is reported that Mapper helped produce better cataloging…

Various methods for calculating and presenting results of information retrieval (IR) evaluation research are discussed, with illustrations from recent laboratory results. Highlights include measures for calculating recall and precision, user needs for high or low level of recall, and comparisons of Boolean and ranked output retrieval. (22…

Examines methodologies underlying studies which measure the information economy and considers their applicability and limitations for analyzing policy issues concerning libraries and library networks. Two studies provide major focus for discussion: Porat's "The Information Economy: Definition and Measurement" and Machlup's…

Presents results of five experiments on human information-seeking behavior in different online information-seeking environments which studied search strategies and assessed information value in realistic search environments. A conceptual model of how humans value information is presented. Empirical and modeling results are considered for…

Discusses formulation of value function based on research from modelling, value assessment, human information seeking behavior, and human decision making. The proposed function is incorporated into computer-based fiction retrieval system and evaluated based on ability of individual's value function to discriminate among novels selected, rejected,…

The increasing complexity of evaluating information retrieval (IR) systems is discussed in terms of contributing factors and research methods. Examples are provided from experiments with weighted searching on a front-end system, information-seeking behavior and online catalogs, and the OKAPI experimental retrieval system. (21 references) (LAE)

Outlines problems involved in information retrieval evaluation and suggests a more user-centered interpretive approach. A longitudinal study that examines evaluation through the information-seeking behavior of 22 case studies of actual users is described; and relevance judgments, effectiveness ratios, and analysis of document failures are…

Considers the meaning of relevance and examines the role that relevance plays in information behavior. Literature on relevance is reviewed, cognitive and dynamic processing approaches to relevance are described, and 12 research questions are presented that address criteria users employ in evaluating information and suggest implications for system…

This overview of the research process for the novice information retrieval (IR) researcher provides guidance on selecting a research question, choosing the type of test, defining variables, developing or using databases, finding and processing queries, assigning treatments to experimental units, collecting and analyzing the data, and presenting…