This paper examines the effect of a formal evaluation process upon educational change--specifically, the adoption of innovative reading programs and practices--at different organizational levels of implementation. Because of the size of the project (62 school systems, 142 designated schools, three sets of categorical funded projects), the…

This paper describes the experiences of Colorado Springs School District Eleven in using multiple measures to determine if third graders were reading at "grade level." The use of multiple measures may be threatened by the rapidly increasing pressures about assessment and accountability in Colorado that teachers are beginning to feel that…

Answers criticisms by Mary Anne Bunda, Ernest House, and Mary Kennedy. Discusses, among other issues, legal authorization for the use of higher quality evaluation designs and the use of evaluation research results. (GC)

Suggestions for enhancing use of evaluation studies (i.e., state-level mental health programs) are presented. Steps for maximizing evaluation utilization include marketing, planning, and conducting the evaluation; developing/focusing policy questions; translating findings; and making people pay attention to the results. These are processes for…

The Evaluation of Worker Profiling and Reemployment Services (WPRS) systems was designed to provide the U.S. Department of Labor information on how states are designing, implementing, and operating their worker profiling and reemployment services systems for dislocated workers and to compare the effectiveness of different state approaches to…

This paper presents two examples of how methodological research in testing and evaluation simultaneously served the needs of both researchers and practitioners. The first example focuses on Center for the Study of Evaluation (CSE) research in writing assessment. This research investigated issues in domain definition, cognitive processing…

This report describes the technical assistance rendered to the NIE-sponsored R&D Utilization Program (R&DU) by the contractor working with the NIE staff, the Center for the Study of Evaluation, and the seven R&DU projects, to develop cross-project instrumentation, develop mutually acceptable plans for data collection and analysis, and…

A framework is presented that relates concepts of audit reliability to the uses of information gathered from a discrepancy program audit of Elementary and Secondary Education Act Title IV-C programs in Florida. Three issues are addressed: (1) the meaning of reliability in relation to the audit process; (2) the importance of reliability of auditor…

the 1983 Appalachia Educational Laboratory (AEL) Forum brought together educational researchers and practitioners to learn from one another by sharing their innovations, successes, concerns, and progress in utilizing research and development to promote excellence in their state and local education agencies. Two thematic strands: (1) applications…

There is a continuing need in evaluation research for the establishment of a relationship between evaluation findings and decision making. A method is proposed for a particular situation: annual funding decisions for projects in a large grant program in vocational education. Outcome and predictive impact variables were ranked by three groups of…

The research and development (R&D) projects funded by the Florida Division of Vocational Education are intended to have utility for vocational educators in their efforts to improve vocational education programs and practices. This project was conducted to determine why some R&D products are accepted by potential users while others are not…

This handbook is designed to help state and local vocational education evaluators and persons using evaluation results by presenting strategies and procedures for improved use of vocational education evaluation results. It is divided into five sections, followed by a glossary and annotated bibliographies. Chapter 1 contains an overview of the…

A new professional licensure system for teachers developed by the Minnesota Board of Teaching in conjunction with the Educational Testing Service is described. Initial work with the Rand Corporation in 1987 provided a plan for a new licensure system. The state's expectations for a performance assessment system to measure the skills of first-year…

Twenty-six papers on evaluation, which were presented at the 1971 American Educational Research Association Convention, are summarized. The papers range from a general overview of evaluation concepts to quite specific evaluative applications. A group of reports concerning state assessment efforts in Florida and Michigan is given separate…