Praxis III is an assessment procedure that provides information for making instructional and licensing decisions about beginning teachers. The Praxis III Assessor's job is to interview the beginning teacher, observe the teacher in the classroom, score the teacher's performance on 19 criteria, and summarize the evidence for each score. The Assessor…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

The scoring method that will be applied in the current 12th-grade science assessment project of the National Science Foundation and the Office of Educational Research and Assessment is described. The method, "graded mark-point" scoring, is modeled after procedures developed by P. Tamir for use in the performance exercises of the Israeli…

Reflecting on a career spent in assessment in personnel selection and managment, the author lists 12 things (items) that he wishes he knew about assessment. The first four items are underdeveloped ideas set aside because of the field's preoccupation with equal employment opportunity. A second set (items five through eight) comes from intellectual…

Involving producing, analyzing, and using information, evaluation is the central discipline of the information age. Both traditional criteria for good evaluation and standards formulated in 1981 prescribe evaluations that are useful, practical, ethical, and accurate. The burning question in evaluation is the utilization of information for…

A national conference on autism, attended by agency staff, organization staff, advocates, and parents of children and adults with autism, consisted of paper presentations, site visits, and small group reports and recommendations. This volume of proceedings includes papers with the following authors and titles: (1) "An Overview of the…

Reviews of 2,554 educational software programs by thirty reviewing sources were examined to compare the tendency of different review sources to give generally positive, negative, or neutral ratings. The reliability of language arts and reading software reviews was studied. Thirty-eight percent of the software programs were reviewed by two or more…

This document presents information to trainers already trained in the Registered Holistic scoring method. It has been developed to assist these trainers in training others in the procedures and the criteria of the new scoring method. The Registered Holistic scoring method was designed and field tested for the ninth grade writing sample component…

Whether judges on bias review committees can identify test items that function differently for black and white examinees was studied. Judges (n=42) on three bias review committees were asked to examine a set of items and predict differential item functioning (DIF) without empirical data. Test items from teacher certification tests in the content…

This paper describes a system of built-in, or internal, evaluation used within the Botswana National Literacy Program (NLP). Launched in 1981 and targeted toward illiterate adults and youth aged 10 years and older, the program aims at eradicating illiteracy in Botswana by 1986. The built-in evaluation was implemented in 1983, using program…

The evaluation team of the Lincoln Public Schools (Nebraska) used the multi-attribution utility technology (MAUT) approach to prioritize potential evaluation projects. The priorities were used to allocate resources to the district's most important projects, and to eliminate or scale down less important projects. The problem was caused initially…

This paper documents the evaluation use process among districts using the Guide for Evaluation Decision Makers, published by the Center for the Study of Evaluation (CSE) during the 1984-85 school year. Included are the following: (1) a discussion of research that led to conclusions concerning the administrator's role in evaluation use; (2) a…

The Palos Verdes Peninsula Unified School District Office of Program Evaluation and Research is responsible for providing information for program development and improvement; providing test information to special programs coordinators; and acting as a clearinghouse for all information concerning tests, evaluation methodology, and educational…

This paper reports results of an exploratory study designed to identify some of the issues most critical for understanding how naturalistic inqiry is done and why researchers behave as they do. Preliminary results are discussed of an inquiry into ten case studies, The Case Studies in Science Education (CSSE), funded as one project by the National…

This study assessed the impacts on 58 schools and 379 on-site visitation team members participating in a Wisconsin Secondary Vocational Education Program Evaluation during three years, 1978-80. To accomplish this, a methodological mix was chosen, so that impacts could be documented quantitatively through questionnaire data, and qualitatively…