This paper examines representative research in information science and compares its designs to an abstract ideal of the experimental research design. Threats to validity of conclusions are highlighted, including history, maturation, testing, instrumentation, statistical regression, selection biases, experimental mortality, and selection-maturation…

Describes experiment designed to assess information value for individual searchers in realistic search environment. Included in data analysis are comparison of two alternative retrieval methods, evaluation of how well humans are able to estimate document relevance, and investigation of value function components (features and coefficients) and…

This overview of the research process for the novice information retrieval (IR) researcher provides guidance on selecting a research question, choosing the type of test, defining variables, developing or using databases, finding and processing queries, assigning treatments to experimental units, collecting and analyzing the data, and presenting…