Using a set of scenarios derived from actual evaluation studies, this simulation study examines the reported influence of evaluation information on decision makers' potential actions. Each scenario described a context where one of three types of evaluation information (large-scale study data, case study data, or anecdotal accounts) is presented…

It is argued that no discarding policy is likely to be generally applicable: every special library must be regarded as a special case. Rather than suggest new measurements, therefore, the paper offers simple graphical techniques that are applicable to any special case. (Author/MF)

Policy Implications Analysis (PIA) is a tool designed to maximize the likelihood that an evaluation report will have an impact on decision-making. PIA was designed to help people planning and conducting evaluations tailor their information so that it has optimal potential for being used and acted upon. This paper describes the development and…

The traditional concern with relevance or nonrelevance of unexamined documents is misplaced, and traditional measures of effectiveness should be replaced by estimates of direct utility of examined documents. (Author)

The use of evaluation information in a large state agency was investigated through a case study approach. Utilization was measured through a scaling procedure considering the status of recommendations within a report and the extent of influence of the evaluation of the status. The scaling procedure, the equal-appearing interval method, used…

This summary of a recent evaluation of the Minnesota Management Information System (MIS) focuses on problems encountered during its evolution and on options available to solve those problems. A delineation between state and district information needs is provided, with an emphasis on statewide standards for reporting educational needs. (MER)

Naturalistic research methods were used to analyze five case studies of school program evaluations. Interviews were conducted with program personnel and evaluators for the five programs, which were funded by the Elementary and Secondary Education Act, Title I, Title III, or Title IV-C. Programs were: (1) Bayview: Project MORE, a program to improve…

Individual document evaluation profiles are reported in a three-page display for each of the 146 documents in the sample of NCEC information analysis products. The three pages are: (1) Title Page and Descriptive Data Report, (2) Reader (on 58 products) and Non-Reader Evaluation Data for: A. Practical Guidance Papers and Reviews, and B.…

The value systems by which the users of purchased information services select which one to use or buy are found to differ sharply among different user populations, but the variable found to control them is a function of use, not of the user as an individual. Selection variables are summarized in a matrix of user values and interaction effects. The…

This report presents the results of a survey of Digital Library Federation members that examined the kinds of assessments they were conducting, what they did with the results, and what worked well or not so well. The first section of the report is an introduction that describes the report structure and summarizes challenges in assessment. The…

Needs assessments are conducted with the expectation that the information obtained will be used to make rational decisions. A prior review of the anticipated utilization of needs assessment data and evaluation of the appropriateness of such utilization may prevent inefficient use of resources. A structured interview was developed to evaluate the…

The complexity of the design problem for modern computer based information systems has increased significantly over its predecessors. The problem presented to the designer is to configure a system which satisfies the user criterion while achieving system resource related performance criteria. The purpose of this paper is to present an evaluation…

Characteristics of periodical use at a small liberal arts college were studied using a methodology aimed at providing a more accurate system for data collection by recording all the periodicals used in an entire semester. In the John J. Wright Library at La Roche College (Pennsylvania), circulation records were consulted, and one person while…