Presents a theoretical framework for navigation in information retrieval systems and describes a prototype retrieval system that was developed to investigate navigation. The use of a visual interface in a spatial representation scheme is described, and results of a user-based evaluation of the system are reported. User questionnaires are appended.…

This paper introduces the concept of a reusable assessment framework (RAF). An RAF contains a library of linked assessment design objects that express: (1) specific set of proficiencies (i.e. the knowledge, skills, and abilities of students for a given content or skill area); (2) the types of evidence that can be used to estimate those…

Three Web search engines--Alta Vista, Excite, and Lycos--were compared and evaluated in terms of their search capabilities and retrieval performances using sample queries drawn from real reference questions. Findings indicated Alta Vista outperformed Excite and Lycos in both search facilities and retrieval performance, although Lycos had the…

The usability of Instructional Multimedia (IMM) applications is vital for their success and for the satisfaction of their users, as the confusion resulting from using poorly designed programs can be particularly detrimental to learning performance. A number of approaches for expert-based evaluation of IMM have been proposed during the past few…

This paper describes the conceptualization and development of an evaluation system that can be used to monitor and evaluate online instructional efforts. The evaluation system addresses concerns of both program administrators and course instructors. Computer technology is used to provide partial automation to reduce respondent burden and to…

This paper describes the use of the CoFIND (Collaborative Filter in N Dimensions) system to evaluate two assessment styles. CoFIND is a resource database that organizes itself around its users' needs. Learners enter resources, categorize, then rate them using "qualities," aspects of resources which learners find worthwhile, the n…

Describes the comparative approach to system evaluation used in a project which administered an online retrieval test to an experimental online catalog to produce data for evaluating effectiveness of a new subject access design. Discusses efforts used to ensure data reliability, and strategies the researchers can use to improve on the data…

Examines Web site assessment criteria that producers of public information may use to evaluate the effectiveness of a Web site. The goal of this study was to design analytical tools from system-based techniques and user feedback with which federal Web site administrators can assess the quality of their Web sites. (Author/AEF)

Describes the system architecture and user evaluation tools for Cheshire II, an online catalog and full-text information retrieval system being developed at the University of California, Berkeley, that uses advanced information retrieval techniques to overcome the problems of topical searching in online catalogs, search failure, and information…

This paper presents a comprehensive evaluation framework for a variety of organizations that wish to find the perfect fit between the needs of the organization and the online solutions they adopt. The framework described in this paper is an outcome of a collaborative effort between the department of Instructional Design, Development and Evaluation…

This paper documents issues in converting the Figure Classification Test to the computer. The purpose of the test, which is almost entirely visual, is to determine the subject's ability to discover rules via the visual/spatial environment. The methodology of the paper-and-pencil Figure Classification Test is as follows: the subject views a series…

The Evaluation and Assessment Laboratory at the University of Alabama (Tuscaloosa) has contracted with the Georgia Department of Education (GDOE) to develop a microcomputer-based data management system for use in applying evaluation standards to schools and school systems. The Comprehensive Evaluation System (CES) was implemented statewide and has…

Effective classroom simulations can provide opportunities for end-users to analyze human teaching and learning behaviors and can also help prepare teachers for real-world experiences. This paper proposes a simulation project based on an aggregation of ideas associated with knowledge-based simulations, behavior observations, visualization, and the…

This paper presents a World Wide Web-based electronic feedback system for use in lectures and practical classes. The system is based on Java and provides a configurable feedback form, a managing tool for administrators, and a statistics viewer for presenting the generated statistical data in various ways. In addition, it generates a statistical…