The Episode of Purposive Change Model was used to evaluate the statewide redesign of human services for vulnerable children/families. Significant findings included the following: (1) community context is important; (2) long-term change requires keeping the initiative on the community agenda; and (3) participants must remain focused on ultimate…

Describes the criteria used by optical disk (CD-ROM) database publishers to select test sites; the responsibilities of and benefits to test site libraries; and plans for future use of test sites. The experiences of Texas A&M University are discussed and suggestions are offered to libraries wishing to become test sites. (CLB)

Describes a process and instrument developed by the Children's Bureau of Los Angeles to evaluate its in-home family support program. The agency has combined case assessment, reporting and recording, evaluation structure, and research data collection in one instrument and one case-long process. (RJC)

Discusses results of a survey of 15 educational software developers, which indicate that none of the companies perform any empirical evaluation of their products as part of the development process. Importance and advantages of validation of the effectiveness of a program are considered, and suggestions for encouraging such validation are offered.…

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Purpose: The study aim was to develop a measure of self-reported quality of life (QoL) for people with mild to moderate dementia based on their views--the Bath Assessment of Subjective Quality of Life in Dementia (BASQID). Design and Methods: We developed the measure through multiple stages. Two field tests of the measure (ns = 60 and 150)…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…

These two evaluation updates cover segments of the third phase of the Apprenticeship Training Materials Clearinghouse project, which is being conducted at Lane Community College in Eugene, Oregon. The first update evaluates activities related to the following project objectives: conduct a field test on clearinghouse services; revise the model…

This paper posits a taxonomy for categorizing issues that arise in the evaluation of Intelligent Tutoring Systems (ITSs). The taxonomy has three dimensions: Life Cycle of Evaluation, Research Issues, and Methodological Issues. The Life Cycle dimension has four levels: pre-experimental, laboratory study, field study, and initial operational test…

Test items are designed to be representative of the subject areas that they measure and to reflect the importance of specific domains or item types within those subject areas. Content validity is achieved by content specification and number of items in each content domain included in the design of the test. However, largely due to the normal…

In order to determine the extent to which the LOGO programming language can be used as a reinforcer for general problem solving ability, this field study used a production theory approach to problem solving as a conceptual model, and then translated the model into a LOGO oriented framework. The methodology tested the use of an algorithm in a…

This document, the second of two volumes, completes the report of a Lilly Endowment, Inc. funded project whose major objective was to establish a process for both teachers and students to be involved in the field testing or evaluation of microcomputer software. Workshops were held in nine Indiana school corporations where more than 2,300 students…

In this monograph, technical jargon is avoided and a variation is described from the common approaches to evaluation that emphasize experimental design and pretesting and post-testing. In this variation the emphasis is upon the processes and procedures of the bilingual programs in Illinois and information is obtained by visiting teams, hence the…

This discussion of formative evaluation as part of the instructional design process focuses on developmental testing and expert review. A review of the literature helps define each approach, research on formative evaluation is reviewed, and 37 references are provided. (LRW)

Discusses the importance of the response time of an online public catalog and its capacity to support multiple users without system degradation; outlines general requirements of an online catalog; explains the difference between menu and command systems; defines response time; and suggests ways of testing an online system accurately. (EM)