This article intends to investigate the consistency between a few popular generative AI robots in the evaluation of massive open online course (MOOC) platforms. The four robots experimented with in the study were Claude+, GPT-4, Sage, and Dragonfly, which were tasked with awarding rating scores to the eight major dimensions, namely (1)…

Outlines a workshop to develop and discuss strategies for formative evaluation of courseware and to create evaluation tools appropriate to those strategies. After watching a software demonstration, small groups devised evaluation strategies. Two approaches were identified: one to evaluate the software and printed material separately and together,…

The MEDA (Methodologie d'Evaluation des Didacticiels pour les Adultes) tool is a generic instrument to evaluate training courseware. It was developed for software designers to improve products, for instructors to select appropriate courseware, and for distributors and consultants to match software to client needs. Describes software evaluation…

Currently available spreadsheet programs for microcomputers provide many features that can be very useful for evaluators and researchers. Some of the basic concepts involved in spreadsheet use are introduced, and information is provided on the use of spreadsheets in maintaining and analyzing evaluation data. The spreadsheet used in the discussion…

The purpose of the study was to develop an educational software evaluation form to provide an evaluation and selection instrument of educational software that met the requirements of some balance between mechanics, content and pedagogy that is user friendly. The subjects for the study comprised a group of 32 biology teachers working in secondary…

Increases in the availability of technology, the range of content software, and curriculum via the Internet have placed countless options in the hands of teachers. Similarly, increasing accountability has placed added pressure on teachers to meet stated objectives and ensure student performance. How can teachers optimize available technologies and…

Heuristic evaluation is a methodology for investigating the usability of software originally developed by Nielsen (1993, 2000). Nielsen's protocol was modified and refined for evaluating e-learning programs by participants in a doctoral seminar held at the University of Georgia in 2001. The modifications primarily involved expanding Nielsen's…

This paper addresses the lack of evaluative resources for computer-assisted reading and writing instruction (CARWI). It begins by discussing the benefits, drawbacks, and effectiveness of computer-based instruction. It then describes types of CARWI packages, including: (1) writing process software; (2) electronic handbooks; (3) interactive…

This paper focuses on faculty use of a decision-making process for complex situations. The analysis part of the process describes and compares course management software focusing on: technical specifications, instructional design values,tools and features, ease of use, and standards compliance. The extensive comparisons provide faculty with…

The application of computer technology in qualitative research and evaluation ranges from simple word processing to doing sophisticated data sorting and retrieval. How computer software can be used for qualitative research is discussed. Researchers should consider the use of computers in data analysis in light of their own familiarity and comfort…

The systematic evaluation process used in Georgia's DeKalb County School System to purchase comprehensive instructional software--an integrated learning system (ILS)--is described, and the decision-making model for selection is presented. Selection and implementation of an ILS were part of an instructional technology plan for the DeKalb schools…

This paper proposes an automated, third party World Wide Web (WWW)-based evaluation service (i.e., an online questionnaire) that focuses on usability issues of WWW-based courseware and can be used by any WWW course instructor/student. Requirements related to the usability of educational systems are summarized, including the learning environment,…

This paper presents a comprehensive evaluation framework for a variety of organizations that wish to find the perfect fit between the needs of the organization and the online solutions they adopt. The framework described in this paper is an outcome of a collaborative effort between the department of Instructional Design, Development and Evaluation…

Evaluators of software for education must make a series of decisions about which issues have a direct impact on their choice of software. Instructional context analysis is the first step, including identifying the learners, the instructor, the learning environment, and technical needs and limitations. The next step is instructional goal analysis;…

The Center for Interactive Technology, Applications, and Research at the College of Engineering of the University of South Florida (Tampa) has developed objective and descriptive evaluation models to assist in determining the educational potential of computer and video courseware. The computer-based courseware evaluation model and the video-based…