Studying pervasive games is inherently difficult and different from studying computer or board games. This article builds upon the experiences of staging and studying several playful pervasive technology prototypes. It discusses the challenges and pitfalls of evaluating pervasive game prototypes and charts methods that have proven useful in…

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

Although previous research has demonstrated learning benefits for both instructors and students in the web-based collaborative learning environments, one of them major difficulties is the lack of a practical approach to assist teachers in evaluating the knowledge contribution of learners. A novel method of merging multi-modes of assessment and…

This case study examined the educational software evaluation processes of pre-service teachers who attended either expertise-based training (XBT) or traditional training in conjunction with a Software-Evaluation checklist. Forty-three mathematics teacher candidates and three experts participated in the study. All participants evaluated educational…

How can the average educator who teaches online, without experience in evaluating emerging technologies, build on what is successful and modify what is not? Written for educators who feel ill-prepared when required to evaluate e-learning initiatives, "Evaluating e-Learning" offers step-by-step guidance for conducting an evaluation plan of…

This study examined the use of automatic speech recognition (ASR) scored elicited oral response (EOR) tests to assess the speaking ability of English language learners. It also examined the relationship between ASR-scored EOR and other language proficiency measures and the ability of the ASR to rate speakers without bias to gender or native…

A CMI-based online forum is designed to address the need for a system to manage students' online participation. The proposed system may reduce the time required to manage online participation. The system was evaluated by a total of 64 students enrolled in an academic semester. The evaluation has two objectives. The first was to determine the…

Earlier studies have suggested that higher education institutions could harness the predictive power of Learning Management System (LMS) data to develop reporting tools that identify at-risk students and allow for more timely pedagogical interventions. This paper confirms and extends this proposition by providing data from an international…

Currently available spreadsheet programs for microcomputers provide many features that can be very useful for evaluators and researchers. Some of the basic concepts involved in spreadsheet use are introduced, and information is provided on the use of spreadsheets in maintaining and analyzing evaluation data. The spreadsheet used in the discussion…

The application of computer technology in qualitative research and evaluation ranges from simple word processing to doing sophisticated data sorting and retrieval. How computer software can be used for qualitative research is discussed. Researchers should consider the use of computers in data analysis in light of their own familiarity and comfort…

This project was designed to provide a framework for user evaluation of software packages and hypertext environments in terms of the extent to which they provide flexibility for learners to follow their preferred learning styles. Evaluation was carried out in relation to hypertext packages, learning styles and outcomes, and system design. (four…