This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

Identifies techniques for the formative and summative evaluation of intelligent tutoring systems (ITS) based on ITS research, expert systems design, computer-based instruction, education, and psychology. Highlights include criterion-based evaluation, expert knowledge, certification, sensitivity analysis, pilot testing, domain knowledge, student…

The purpose of this report is to document the pilot test of the Instruction and Learning Appraisal (ILA) and describe the quality of the ILA process. The ILA process was developed by Edvantia staff who serve as technical assistance providers to schools and districts in the region. Low-performing schools and districts (i.e., those that fail to…

The emergence and purpose of formative evaluation as a tool for curriculum developers is described. It is pointed out that formative evaluation seeks to establish the merit of instructional materials during their development, to modify and improve the design of instructional materials, and to establish their worth so they may be adapted for use in…

Library administrators, faced with the problems of acid-paper deterioration, are examining mass deacidification procedures. Mass deacidification of acidic books while they are still physically sound and not yet brittle is the most cost-effective corrective action to extend the life of the paper. There are currently at least five mass…

This document presents effectiveness charts that demonstrate the impact of various programs of the Austin (Texas) Independent School District (AISD) on strategic objectives of the district and executive summaries of all reports produced by the AISD's Office of Research and Evaluation in 1990-91. The programs described in the effectiveness charts…

Science assessment has been included with mathematics and language assessment on the international level since the 1970s. This paper discusses techniques of assessment that have been utilized to measure science process skills. The first section discusses the Assessment Performance Unit, a British project with the aim of developing innovative…

This paper summarizes the standardized procedures and psychometric standards states must follow in developing performance-based assessment. The National Reporting System (NRS), which serves as the accountability system for federally funded adult education and literacy programs, requires that states have their local programs assess educational gain…

This paper reviews and critiques empirical evidence concerning knowledge gaps and misconceptions among secondary school students, parents/guardians, and educators about postsecondary education and student financial assistance opportunities and prerequisites, in particular, how Michigan's middle school based Project Awareness may affect student…

This handbook, which is intended for tutors, disability practitioners, and others working with adults with intellectual/developmental disabilities, contains supplementary materials for and about supporting literacy for people with intellectual/developmental challenges. The handbook is a product of the following activities: extensive research of…