Discusses the test collections developed in the TREC (Text REtrieval Conference) workshops for information retrieval research and describes a study by NIST (National Institute of Standards and Technology) that verified their reliability by investigating the effect changes in the relevance assessments have on the evaluation of retrieval results.…

Considers relevance and recall as measures of the effectiveness of information retrieval systems. Highlights include relevance judgments and information retrieval, including experiments with test collections; information retrieval and assessment of recall; and a comparison of two retrieval mechanisms using a new set of relevance judgments designed…

Discusses some of the work included in the sixth TREC (Text Retrieval Conference). Highlights include retrieval effectiveness and relevance feedback; linguistic phrase identification; word elimination; weighting; precision and recall; query concepts; ad hoc and Chinese retrieval; and cross lingual information retrieval. (LRW)

Considers some of the most fundamental problems in music information retrieval, challenging the common assumption that searching on pitch alone is likely to be satisfactory for all purposes. Discusses special issues related to polyphonic music, user-interface issues, and the notion of relevance for music information retrieval. (Contains 52…

With the increase in available educational data, it is expected that Learning Analytics will become a powerful means to inform and support learners, teachers and their institutions in better understanding and predicting personal learning needs and performance. However, the processes and requirements behind the beneficial application of Learning…

Today, search engines are embedded into all aspects of digital world: in addition to Internet search, all operating systems have integrated search engines that respond even as you type, even over the network, even on cell phones; therefore the importance of their efficacy and efficiency cannot be overstated. There are many open possibilities for…

Task analytic theories of graph comprehension account for the perceptual and conceptual processes required to extract specific information from graphs. Comparatively, the processes underlying information integration have received less attention. We propose a new framework for information integration that highlights visual integration and cognitive…

This study reported an investigation of eighth graders' (14-year-olds) web searching strategies and outcomes, and then analyzed their correlations with students' web experiences, epistemological beliefs, and the nature of searching tasks. Eighty-seven eighth graders were asked to fill out a questionnaire for probing epistemological beliefs (from…

Interpreting a verb-phrase ellipsis (VP ellipsis) requires accessing an antecedent in memory, and then integrating a representation of this antecedent into the local context. We investigated the online interpretation of VP ellipsis in an eye-tracking experiment and four speed-accuracy tradeoff experiments. To investigate whether the antecedent for…

The nature and scope of available documents are changing significantly in many areas of document analysis and retrieval as complex, heterogeneous collections become accessible to virtually everyone via the web. The increasing level of diversity presents a great challenge for document image content categorization, indexing, and retrieval.…

A model for an information retrieval system in which recall and precision are inversely related is described, and then the anomaly is resolved. (PF)

This paper reports the results of the testing and use of a batch-mode program, QUERY, in three large computer runs performed by the ERIC (Educational Resources Information Center) Clearinghouse on Teacher Education from March through August 1970. Focus is on the behavior of QUERY as a search tool, not on cost-benefit analysis or comparison with…

The Cranfield Project was done in a laboratory sphere. In a practical situation, it is impossible to determine how many documents are relevant to a certain question. Although in the Cranfield Project collections of different sizes have been used, these collections do not fulfill the requirements that the small collections are randomly taken from…

The idea of pseudo-classification based on external relevance is introduced and compared with the more usual classifications derived by associative techniques. A general model for an information retrieval system using term classification is described. The derivation of a set of operators, or perturbations, for adjusting pseudo-classification and…

Reports on the experimental use of MEDLINE at Oakland University in January-April 1974. (PF)