Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

This article shows how microcomputer software can help in overcoming key methological problems in program/policy evaluation by: (1) paired comparisons; (2) sensitivity analysis to deal with missing information; (3) allocation percentages to deal with multiple alternatives; (4) sub-optimizing to deal with conflicting constraints; and (5) decision…

Investments in web-based training (WBT) have increased presumably to attain cost savings and performance improvement. However, it has been difficult to assess the cost of WBT. In order to conduct an accurate cost analysis of WBT, three primary issues remain as follows: 1) identifying the missing cost components of WBT, 2) assessing the costs of…

This paper addresses some of the concerns inherent in evaluating feminists' projects and focuses on three topics: (1) a discussion of some objections raised by feminists about traditional forms of assessment; (2) a description of the strengths and weaknesses of illuminative evaluation as an alternative approach to evaluate feminist programs; and…

Some special problems associated with evaluating intelligent computer-assisted instruction (ICAI) programs are addressed. This paper intends to describe alternative approaches to the assessment and improvement of such applications and to provide examples of efforts undertaken and shortfalls. Issues discussed stem chiefly from the technical demands…