Purpose: The purpose of this paper is to discuss heuristic evaluation as a method for evaluating e-learning courses and applications and more specifically to investigate the applicability and empirical use of two customized e-learning heuristic protocols. Design/methodology/approach: Two representative e-learning heuristic protocols were chosen…

This article deals with evaluating an interactive learning environment (ILE) during the iterative-design process. Various aspects of the system must be assessed and a number of evaluation methods are available. In designing the ILE Ambre-add, several techniques were combined to test and refine the system. In particular, we point out the merits of…

Although previous research has demonstrated learning benefits for both instructors and students in the web-based collaborative learning environments, one of them major difficulties is the lack of a practical approach to assist teachers in evaluating the knowledge contribution of learners. A novel method of merging multi-modes of assessment and…

Digital educational games (DEGs) possess the potential of providing an appealing and intrinsically motivating learning context. Usually this potential is either taken for granted or examined through questionnaires or interviews in the course of evaluation studies. However, an "adaptive" game would increase the probability of a DEG being…

The rapid evolution of System-on-Chip (SoC) challenges academic curricula to keep pace with multidisciplinary/interdisciplinary system thinking. This paper presents a curricular prototype that cuts across artificial course boundaries and provides a meaningful exploration of diverse facets of SoC design. Specifically, experimental contents of a…

This article reports on the outcomes from the "e-scape Primary Scientific and Technological Understanding Assessment Project" (2009-2010), which aimed to support primary teachers in developing valid portfolio-based tasks to assess pupils' scientific and technological enquiry skills at age 11. This was part of the wider…

This paper examines the problem of studying and comparing student software designs. We propose semantic categorization as a way to organize widely varying data items. We describe how this was used to organize a particular multi-national, multi-institutional dataset, and present the results of this analysis: most students are unable to effectively…

Three Web search engines--Alta Vista, Excite, and Lycos--were compared and evaluated in terms of their search capabilities and retrieval performances using sample queries drawn from real reference questions. Findings indicated Alta Vista outperformed Excite and Lycos in both search facilities and retrieval performance, although Lycos had the…

Describes the comparative approach to system evaluation used in a project which administered an online retrieval test to an experimental online catalog to produce data for evaluating effectiveness of a new subject access design. Discusses efforts used to ensure data reliability, and strategies the researchers can use to improve on the data…

Providing detailed, constructive and helpful feedback is an important contribution to effective student learning. Quality assurance is also required to ensure consistency across all students and reduce error rates. However, with increasing workloads and student numbers these goals are becoming more difficult to achieve. An automated feedback…

Describes a project at Stanford University Library that was initiated to enhance user access to government documents collections by developing a prototype natural language computer-based aid. The development of an expert system, Government Documents Reference Aid (GDRA), is explained, and the application of expert systems in libraries is…

This study, part of a larger effort to develop a methodology for evaluating intelligent computer systems (Artificial Intelligence Systems), explores the use of benchmarking as an evaluation technique. Benchmarking means comparing the performance of intelligent computer systems with human performance on the same task. Benchmarking in evaluation has…