This paper examines representative research in information science and compares its designs to an abstract ideal of the experimental research design. Threats to validity of conclusions are highlighted, including history, maturation, testing, instrumentation, statistical regression, selection biases, experimental mortality, and selection-maturation…

Describes experiment designed to assess information value for individual searchers in realistic search environment. Included in data analysis are comparison of two alternative retrieval methods, evaluation of how well humans are able to estimate document relevance, and investigation of value function components (features and coefficients) and…

Presents results of five experiments on human information-seeking behavior in different online information-seeking environments which studied search strategies and assessed information value in realistic search environments. A conceptual model of how humans value information is presented. Empirical and modeling results are considered for…

Considers the meaning of relevance and examines the role that relevance plays in information behavior. Literature on relevance is reviewed, cognitive and dynamic processing approaches to relevance are described, and 12 research questions are presented that address criteria users employ in evaluating information and suggest implications for system…

This overview of the research process for the novice information retrieval (IR) researcher provides guidance on selecting a research question, choosing the type of test, defining variables, developing or using databases, finding and processing queries, assigning treatments to experimental units, collecting and analyzing the data, and presenting…