Discusses the test collections developed in the TREC (Text REtrieval Conference) workshops for information retrieval research and describes a study by NIST (National Institute of Standards and Technology) that verified their reliability by investigating the effect changes in the relevance assessments have on the evaluation of retrieval results.…

Considers relevance and recall as measures of the effectiveness of information retrieval systems. Highlights include relevance judgments and information retrieval, including experiments with test collections; information retrieval and assessment of recall; and a comparison of two retrieval mechanisms using a new set of relevance judgments designed…

Discusses some of the work included in the sixth TREC (Text Retrieval Conference). Highlights include retrieval effectiveness and relevance feedback; linguistic phrase identification; word elimination; weighting; precision and recall; query concepts; ad hoc and Chinese retrieval; and cross lingual information retrieval. (LRW)

Considers some of the most fundamental problems in music information retrieval, challenging the common assumption that searching on pitch alone is likely to be satisfactory for all purposes. Discusses special issues related to polyphonic music, user-interface issues, and the notion of relevance for music information retrieval. (Contains 52…

Today, search engines are embedded into all aspects of digital world: in addition to Internet search, all operating systems have integrated search engines that respond even as you type, even over the network, even on cell phones; therefore the importance of their efficacy and efficiency cannot be overstated. There are many open possibilities for…

Task analytic theories of graph comprehension account for the perceptual and conceptual processes required to extract specific information from graphs. Comparatively, the processes underlying information integration have received less attention. We propose a new framework for information integration that highlights visual integration and cognitive…

This study reported an investigation of eighth graders' (14-year-olds) web searching strategies and outcomes, and then analyzed their correlations with students' web experiences, epistemological beliefs, and the nature of searching tasks. Eighty-seven eighth graders were asked to fill out a questionnaire for probing epistemological beliefs (from…

Interpreting a verb-phrase ellipsis (VP ellipsis) requires accessing an antecedent in memory, and then integrating a representation of this antecedent into the local context. We investigated the online interpretation of VP ellipsis in an eye-tracking experiment and four speed-accuracy tradeoff experiments. To investigate whether the antecedent for…

The nature and scope of available documents are changing significantly in many areas of document analysis and retrieval as complex, heterogeneous collections become accessible to virtually everyone via the web. The increasing level of diversity presents a great challenge for document image content categorization, indexing, and retrieval.…

When remembering past choices, people tend to attribute positive features to chosen options and negative features to rejected options. The present experiments reveal the important role beliefs play in memory reconstruction of choices. In Experiment 1, participants who misremembered which option they chose favored their believed choice in their…

This document provides recommendations for request for proposal (RFP) and contract language that state education agencies can use to specify their requirements for access to test item banks. An item bank is a repository for test items and data about those items. Item banks are used by state agency staff to view items and associated data; to…

This article examines issues faced by scholarly societies that are developing and sustaining online paper repositories. It is based on the AERA Conference on Online Paper Repositories, which focused on fundamental issues of policy and procedure important to the operations of online working paper repositories. The report and recommendations address…

The article discusses problems that arise from comparing different kinds of presentation modes such as texts, pictures or animations with regard to learning outcome. These comparisons are confounded with or depend on other variables like quality of the instructional design, learning content, familiarity with the presentation mode as well as…

A model for an information retrieval system in which recall and precision are inversely related is described, and then the anomaly is resolved. (PF)

This paper reports the results of the testing and use of a batch-mode program, QUERY, in three large computer runs performed by the ERIC (Educational Resources Information Center) Clearinghouse on Teacher Education from March through August 1970. Focus is on the behavior of QUERY as a search tool, not on cost-benefit analysis or comparison with…