Pronunciation teaching is an important stage in language learning activities. This article tackles the pronunciation scoring problem where research has demonstrated relatively low human-human and low human-machine agreement rates, which makes teachers skeptical about their relevance. To overcome these limitations, a fuzzy combination of two…

This paper presents the integration of a real time evaluation method of collaboration quality in a monitoring application that supports teachers in class orchestration. The method is implemented as an automatic rater of collaboration quality and studied in a real time scenario of use. We argue that automatic and semi-automatic methods which…

Audit trail analysis can provide valuable insights to researchers and evaluators interested in comparing and contrasting designers' expectations of use and students' actual patterns of use of educational technology environments (ETEs). Sequence analysis techniques are particularly effective but have been neglected to some extent because of real…

Considers the characteristics of computer based learning (CBL) which have caused it to attract so much attention from evaluators, gives an overview of current approaches to evaluation, and raises questions about what services in CBL are being required of evaluators and how they might best be achieved. (Author/CMV)

Based on the "Courseware Evaluation Project," supported by the Israeli Ministry of Education and Culture, this article addresses basic issues regarding formative evaluation practices in the context of computerized instruction. Topics discussed included the rationale for evaluation, elements to evaluate, dimensions for assessing quality, and…

Some special problems associated with evaluating intelligent computer-assisted instruction (ICAI) programs are addressed. This paper intends to describe alternative approaches to the assessment and improvement of such applications and to provide examples of efforts undertaken and shortfalls. Issues discussed stem chiefly from the technical demands…

The Center for Interactive Technology, Applications, and Research at the College of Engineering of the University of South Florida (Tampa) has developed objective and descriptive evaluation models to assist in determining the educational potential of computer and video courseware. The computer-based courseware evaluation model and the video-based…

The Formative Evaluation and Heuristic Research (FEHR) PRACTICUM, a computerized game, gives practical experience in such program evaluation tasks as problem definition, operationalizing objectives, field study, budgeting, proposal writing, data analysis, and interpretation--without the expense and time commitments required by most research. The…