This paper presents a comparison of performance auditing and evaluation. It is the product of a collaboration between the senior evaluator from the Office of Research and Evaluation in the Austin Independent School District (Texas) and the senior auditor of Austin's City Auditor's Office. These officials were required to work together when the…

The North Carolina Teacher Performance Appraisal System (TPAS) embodies both formative and summative evaluation of teachers, and is based on multiple observations and collection of data on teacher performance. This study was conducted to report on a survey of the effectiveness of the TPAS as perceived by 639 evaluators (Es) and 2,732…

In 1990, a study was conducted at Rio Hondo College (Whittier, California) to determine if readers exhibited any bias in scoring test papers that were composed on a word processor as opposed to being written by hand. The study began with the formulation of tentative pilot study questions and the development of procedures to address them. Three…

Although the standard-setting method of W. H. Angoff (1971) has broad-based support in the research literature, inconsistencies in the resulting standards do occur. Sources of these inconsistencies are examined in a study of judges, competencies (items), rounds (replications), and the interactions among them. A modified Angoff approach was used to…

Classroom teachers have the best possible vantage point for constructing locally appropriate surveys and tests; the fact is, however, that teachers tend to rely on nationally mass-produced and marketed test packages. The purpose of this paper is to present a procedure for developing and refining teacher-made surveys and tests, which would be valid…

The Maryland School Performance Assessment Program (MSPAP) is a relatively new, statewide performance assessment of students in grades 3, 5, and 8. When first administered in May of 1991, the MSPAP included a battery of performance assessment tasks designed to generate written or drawn responses to reading texts. This study evaluated selected…

Performance rating systems frequently use multiple raters in order to improve the reliability of ratings. However, unless all candidates are rated by the same raters, some candidates will be at an unfair advantage or disadvantage solely because they were rated by more stringent or lenient raters. To obtain fair and accurate evaluations of…

Easily accessible publications which report procedures and results of real evaluation studies of inservice teacher education are lacking. Therefore, this collection of case studies was initiated by the Association for Teacher Education in Europe (ATEE) to provide some practical help for practitioners. The first section of the volume is a general…

A well-planned and well-conducted evaluation can provide useful information to funding agencies, sponsoring institutions, instructors, and participants. Evaluating an instructional program, such as a workshop or institute, involves collecting, organizing, analyzing, and reporting data about several features of the program and its impact on the…

The implementation of research design in studies on substance abuse education is discussed in this meta-analysis. Findings indicate that the quality of research design is constrained by negative feedback from evaluation stakeholders. This finding is applied to an evaluation of the Here's Looking at You, 2000 drug education program currently…

A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff…

This paper suggests a strategy for the evaluation of programs designed for Native children enrolled in predominantly non-Native urban school districts. The strategy provides a means by which Native people can increase their involvement in, responsibility for, and control of the education of their children. The paper is divided into five sections.…

This manual is a resource guide for teachers and administrators and was compiled to provide direction for planning an effective orientation program. An in-depth design is given which will enable participants to derive maximum benefit from an intercultural experience. Each of the sections includes detailed instructions for the preparation of the…

What users of student ratings of instruction know about ratings and what they need to know to make valid and reliable use of ratings data were studied. An item bank of 153 multiple-choice items was developed from sources of information about student ratings. The full item bank had five subsets: (1) knowledge of ratings concepts; (2) knowledge of…

The methods used by the General Educational Development Testing Service (GEDTS) to establish and maintain score stability and reading reliability on its direct assessment of writing are described. Using the 1988 site certification and monitoring results of several scoring sites, the focus is on describing how the score scale was established and…