Data from two studies on evaluation budgeting practices are presented. In the first study, estimated budget figures are provided for formative and summative evaluations by 29 state education agency evaluators. In the second study, initial budget figures, final costs, and study characteristics are abstracted from the records of 85 evaluations…

Faculty of the education department of a midwestern university were rated as teachers by both students and peers, and ranked by peers as to their effectiveness in service and research. Student ratings were gathered from three questions on The Student Description of Teaching form, which concerned assessment of the teacher, the is appended. Access…

One of a series of reports concerned with the creation of new evaluation methodologies for use in education, this report contains a collection of thirteen brief statements of problems encountered first-hand by evaluation practitioners in state departments of education (SEAs). Its intent is to make available practitioner statements so that further…

A number of brief papers are presented to provide guidelines for test directors of school systems. This collection is intended for both newly appointed and experienced directors. Contributions were solicited from practicing directors of testing; the authors include Anthony J. Allen, Margaret Backman, Joan Bollenbacker, Gerald Hanna, James Lawson;…

As part of an ongoing investigation of the relationship between teacher behavior and pupil affective and cognitive outcomes, coders practiced recording their observations of existing classroom videotapes in order to determine the amount of interobserver agreement. The videotapes were coded, using seven existing low- to medium-inference classroom…

Program evaluation strategies and techniques based on materials developed by the California Evaluation Improvement Project were discussed at this meeting of the Regional Interstate Planning Project (RIPP). RIPP members represent the State Departments of Education of ten western states, and have met periodically over the past nine years to discuss…

The speaker discusses Congressional program evaluation. From the Congressional perspective, good evaluators understand the political, social, and economic processes; are familiar with various evaluation methods; and know how to use authority and power within their roles. Program evaluation serves three major purposes: to anticipate social impact…

This overview of educational evaluation in the Netherlands provides background and details the state of the art in student, curriculum, and innovation evaluation. The role of international evaluation issues (such as evaluation criteria and the decision-making process) in evaluation theory and practice in The Netherlands is discussed. (BS)

Point of entry problems are faced by evaluators when asked to start an evaluation at an inappropriate time or to perform an inappropriate study. The fundamental purpose of evaluation is to help improve services. Guidelines are presented for choosing when to do a context, input, process, or product evaluation. (GDC)

An evaluation research capability was used to document the design and implementation of two programs in a large urban school district. This paper describes the research context, the origins of the role of resident evaluator, the broad functions of this role, and factors contributing to the usefulness of this approach. (BW)

States are using a variety of approaches to assess secondary students' career technical education (CTE) skill attainment under Perkins. According to data reported in the U.S. Department of Education's "Report to Congress on State Performance, Program Year 2002-03," states and territories are currently using the following approaches to collect…

Studied whether special education placement decisions made by teams are superior to those made by individuals. The investigation was conducted in Puerto Rico to determine the benefits of the cooperative group process. Results indicated that teams generated significantly less variability (i.e., errors) than did the same specialists acting…

Describes an automated scoring algorithm for a computer-based simulation examination of physicians' patient-management skills. Results with 280 medical students show that scores produced using this algorithm are highly correlated to actual clinician ratings. Scores were also effective in discriminating between case performance judged passing or…

Considers the interrater reliability of certified testers in five European languages, the relationship between interviewer-assigned ratings and second ratings based on audio replay, interrater reliability as a function of proficiency level, effect of different languages on interrater agreement, and interrater disagreements with regard to…

The purpose of this study was to derive the criteria/dimensions underlying learners' second-language oral ability scores across three tests: an oral interview, a narration, and a read-aloud. A stimulus tape of 18 speech samples was presented to 3 native speaker rater groups for evaluation. Results indicate that researchers might need to reconsider…