Discusses results of a survey of 15 educational software developers, which indicate that none of the companies perform any empirical evaluation of their products as part of the development process. Importance and advantages of validation of the effectiveness of a program are considered, and suggestions for encouraging such validation are offered.…

Purpose: This research was conducted to develop a clinical tool--the Index of Narrative Microstructure (INMIS)--that would parsimoniously account for important microstructural aspects of narrative production for school-age children. The study provides field test age- and grade-based INMIS values to aid clinicians in making normative judgments…

The purpose of this study was to identify the major components of a secondary school counselor's job and translate these job responsibilities into an instrument that could be used by school administrators to identify high quality secondary school counselors during the employment interview. A review of literature resulted in the identification of…

This article discusses field tests that can be used in physical education programs. The most common field tests are anthropometric measurements, which include body mass index (BMI), girth measurements, and skinfold testing. Another field test that is gaining popularity is bioelectrical impedance analysis (BIA). Each method has particular strengths…

Purpose: The purpose of this article is to highlight the results of the online Delphi research project; in particular the procedures used to establish an online and innovative process of content validation and obtaining "rich" and descriptive information using the internet and current e-learning technologies. The online Delphi was proven to be an…

Purpose: The study aim was to develop a measure of self-reported quality of life (QoL) for people with mild to moderate dementia based on their views--the Bath Assessment of Subjective Quality of Life in Dementia (BASQID). Design and Methods: We developed the measure through multiple stages. Two field tests of the measure (ns = 60 and 150)…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…

These two evaluation updates cover segments of the third phase of the Apprenticeship Training Materials Clearinghouse project, which is being conducted at Lane Community College in Eugene, Oregon. The first update evaluates activities related to the following project objectives: conduct a field test on clearinghouse services; revise the model…

This paper posits a taxonomy for categorizing issues that arise in the evaluation of Intelligent Tutoring Systems (ITSs). The taxonomy has three dimensions: Life Cycle of Evaluation, Research Issues, and Methodological Issues. The Life Cycle dimension has four levels: pre-experimental, laboratory study, field study, and initial operational test…

Test items are designed to be representative of the subject areas that they measure and to reflect the importance of specific domains or item types within those subject areas. Content validity is achieved by content specification and number of items in each content domain included in the design of the test. However, largely due to the normal…

In order to determine the extent to which the LOGO programming language can be used as a reinforcer for general problem solving ability, this field study used a production theory approach to problem solving as a conceptual model, and then translated the model into a LOGO oriented framework. The methodology tested the use of an algorithm in a…

This document, the second of two volumes, completes the report of a Lilly Endowment, Inc. funded project whose major objective was to establish a process for both teachers and students to be involved in the field testing or evaluation of microcomputer software. Workshops were held in nine Indiana school corporations where more than 2,300 students…

In this monograph, technical jargon is avoided and a variation is described from the common approaches to evaluation that emphasize experimental design and pretesting and post-testing. In this variation the emphasis is upon the processes and procedures of the bilingual programs in Illinois and information is obtained by visiting teams, hence the…

This discussion of formative evaluation as part of the instructional design process focuses on developmental testing and expert review. A review of the literature helps define each approach, research on formative evaluation is reviewed, and 37 references are provided. (LRW)

Discusses the importance of the response time of an online public catalog and its capacity to support multiple users without system degradation; outlines general requirements of an online catalog; explains the difference between menu and command systems; defines response time; and suggests ways of testing an online system accurately. (EM)