In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by…

We evaluate feedback methods for oral presentations used in training non-quantitative research skills (literature review and various associated tasks). Training is provided through a credit-bearing module taught to MSc students of banking, economics and finance in the UK. Monitoring oral presentations and providing "best practice"…

This study aims to present a new model measuring the economic value of public libraries, combining the dissonance minimizing (DM) and information bias minimizing (IBM) format in the contingent valuation (CV) surveys. The possible biases which are tied to the conventional CV surveys are reviewed. An empirical study is presented to compare the model…

This article presents procedures for improving professional group cooperation in responding to mailed survey questionnaires which differ from those used with general populations. The procedures deal with: (1) improving the cost-benefit ratio of cooperation; (2) being sensitive to confidentiality concerns; and (3) allowing respondents a full range…

The article presents the results of an application of the authors' economic model for evaluating general interest adult education programs. Available from: Extension Division, University of Saskatchewan, Saskatoon S7N OWO. (MW)

Four instruments to be used in developing school library and media programs are included in this package. Two questionnaires, addressed to students, teachers, administrators, and library staff, inventory current services and determine service priorities. Seventeen charts for data collection and a 20-page costing matrix are provided. Instructions…

This report discusses the analysis of program review data obtained through visits to schools identified by an earlier statewide cost-effectiveness study. Primary purpose of this report was to determine the feasibility of conducting program site reviews of selected schools for the purpose of recommending instructional improvements. Site reviews…

In the past, distance learning evaluations have been conducted as afterthoughts and have relied heavily on reaction questionnaires, which are unreliable and nonrepresentative of the participants involved. Even when evaluations attempted to collect information about changes in student achievement, questions were asked that confused the separate…

This study of the legal services provided for the Montgomery County Public Schools (MCPS), Maryland has two purposes: (1) to determine the cost-effectiveness and quality of current arrangements; and (2) to present alternative arrangements with estimates of their costs, effectiveness, and acceptability. MCPS budgets significant funds for legal…

An evaluation of alternative methods--including three types of questionnaires and face-to-face interviews--of obtaining post training feedback from naval personnel is described. Using a sample of recent radio technician trainees, various approaches to data collection were employed. It was found that questionnaires provide the most cost-effective…

About 960,000 U.S. civilian employees have received about 45 million hours of training, costing the Federal Government about $216 million. To find out how the Civil Service Commission and the Federal Executive department measured the effectiveness of this training, fulfilled the evaluation requirements of the Government Employees Training Act of…

A questionnaire was designed to aid the interested professional in describing, characteristics and analyzing his game, model, or simulation, and tested on a number of Department of Defense (DOD) games. An over-riding goal for the questionnaire was to produce a categorization scheme for games in general. The different sections of the questionnaire…

This report presents the evaluation design and results of a two-year pilot test of the Wisconsin System for Instructional Management (WIS-SIM) in seven Wisconsin elementary schools. WIS-SIM is a management information system designed to support management processes in Individually Guided Education programs. The evaluation design, which is based on…

A revised edition of PS-14, "An Introduction to Benefit-Cost Analysis for Evaluating Public Programs," presents concepts and techniques of benefit-cost analysis as tools that can be used to assist in deciding between alternatives. The goals of the new edition include teaching students to think about the possible benefits and costs of each…

A total educational information system for evaluation of vocational education in Massachusetts is described. Specifically, the evaluation guide describes the evaluation plan, reveals the philosophy of evaluation upon which the design was built, outlines the processes of evaluation called for in the design, introduces the forms for data collection…