The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

The design and development research, first proposed by Brown and Collins in the 1990s, is currently among the well-known methods in educational research to test theory and validate its practicality. The method is also known as developmental research, design research, design-based research, formative research and design-cased and possesses…

Although the term data-driven decision making (DDDM) is relatively new (Moss, 2007), the underlying concept of DDDM is not. For example, the practices of formative assessment and computer-managed instruction have historically involved the use of student performance data to guide what happens next in the instructional sequence (Morrison, Kemp, &…

Quality assurance in instructional development demands an exhaustive formative evaluation effort and applied testing. Unfortunately, this process is expensive and requires large numbers of user testers with characteristics similar to the intended audience. This article presents a procedure for increasing the efficiency of quality assurance efforts…

Outlines a workshop to develop and discuss strategies for formative evaluation of courseware and to create evaluation tools appropriate to those strategies. After watching a software demonstration, small groups devised evaluation strategies. Two approaches were identified: one to evaluate the software and printed material separately and together,…

Describes the formative evaluation of a prototype, computerized, interactive learning and practice program for university students in theoretical computer science. Found the program to provide a rich learning environment. (EV)

Describes the design and development of the Computer Logging of User Entries (CLUE) system for evaluating computer network-based learning courseware, or Web-based distance-education courseware. CLUE is an innovative evaluation system that combines computer-logging techniques with self-reporting methods used widely in the field of formative…

ECOSET was established to meet the demand from policy makers and the teaching community in the European Community (EC) Member States for evidence of the effectiveness of information technology in various learning situations in general and of various kinds of software in particular. The main goals of ECOSET were to identify organizations in the…

This paper examines the impact the use of the Java programming language has had on the way our students learn to program and the success they achieve. The importance of a properly constructed first course in programming cannot be overstated. A course well experienced will leave students with good programming habits, the ability to learn on their…

Electronic portfolios are becoming more prevalent on colleges and universities and can be a valuable tool in assessment efforts on campus.

Discussion of evaluation of computer-based learning (CBL) looks at six different approaches: use of quantitative data for assessment; student and staff attitudes and perceptions of computer use for learning; formative evaluation for CBL design; effectiveness of CBL in comparison to conventional instruction; evidence of whether CBL enables students…

Discusses the role of interactive multimedia in museums; describes the development and design at the New Mexico Museum of Natural History of a multimedia program on water conservation; analyzes the effect of the presence of audio on the users' completion of the program; and discusses evaluation of the program. (10 references) (LRW)

This paper reflects on the author's participation in two government-sponsored educational software development projects that used a holistic design paradigm in which classroom formative assessment and teacher input played a critical role in the development process. The two project were: R-WISE (Reading and Writing in a Supportive Environment)--a…

Considers the use of pre- and posttest results as formative evaluation tools and describes a small group evaluation of computer-assisted language learning (CALL) courseware dealing with French for banking. Test design is discussed, including standards, validity, and reliability; and results from user questionnaires are examined. (Contains 14…

Effective classroom simulations can provide opportunities for end-users to analyze human teaching and learning behaviors and can also help prepare teachers for real-world experiences. This paper proposes a simulation project based on an aggregation of ideas associated with knowledge-based simulations, behavior observations, visualization, and the…