As an introduction to a series on the array of issues in the implementation and evaluation of substance abuse prevention programs, this volume attempts to integrate two types of competence for alcohol and other drug abuse prevention program practitioners: program evaluation competence and cultural competence. The chapters in this document provide…

The results are provided of an initial analysis of the reliability (generalizability) of the System for Teaching and Learning Assessment and Review (STAR) as a comprehensive measure of classroom teaching and learning for making teacher certification decisions. The STAR contains 140 indicators of teacher effectiveness and student learning, which…

The Teacher Evaluation and Assessment Center (TEAC) was established by the Department of Education at the University of South Florida in 1984 to serve the state in the certification of trainers and observers of the Florida Performance Measurement System (FPMS) and to score and report performance evaluations for special programs. This report…

A preliminary survey of 32 school districts identified as having highly developed teacher evaluation systems was followed by the selection of 4 case study districts (Salt Lake City, Utah; Lake Washington, Washington; Greenwich, Connecticut; and Toledo, Ohio) representing diverse teacher evaluation processes and organizational environments. Common…

A method for understanding and controlling the multiple facets of an oral examination (OE) or other judge-intermediated examination is presented and illustrated. This study focused on determining the extent to which the facets model (FM) analysis constructs meaningful variables for each facet of an OE involving protocols, examiners, and…

The document addresses challenges that a developmental and wholistic approach to learning presents in the area of educational screening and evaluation in native communities. The introduction considers the connection between wholistic educational evaluation and alcohol and drug abuse, where to begin, the role of evaluation in learning, and…

Evaluation training materials developed by federally funded research and development laboratories were surveyed, analyzed, and described. This project included the collection and analysis of training materials, and the development of The Consumer's Guide to Evaluation Training Materials. This final report describes the rationale, purpose, and…

Principles and guidelines for the use of expert judgment of experiential learning are outlined. The report deals with a number of basic issues that apply to expert judgment, such as the role of the evaluator in defining criteria, and structuring the assessment procedure so that it will be reliable and valid. The importance of establishing…

Four evaluation methods for determining educational policy are objectivism; subjectivism; emotive-imperative; and instrumentalism. For the objectivist, the rationale for undertaking an evaluation is based on empirical verification or non-verification of claims of existing policies or activities. Secondly, the objectivist is interested in…

Based on the premise that teachers gain useful insights by considering what students notice when evaluating a written text, this pilot project reports on the implementation of an evaluative activity with one group of students and considers the implications of the results for classroom practice. Thirteen students in a university-level Spanish…

This study examines and describes the changes in four teachers' beliefs and practices in literacy and literacy assessment over the course of a yearlong graduate level clinical experience. Four teachers who worked in the university literacy clinic as part of their graduate course work participated in this study. Two of the four teachers teach…

School-Based Management/Shared Decision Making is a city-wide program supported by New York City Schools in collaboration with Bank Street College, based on the belief that students, parents, school staff, and communities have unique needs, and that these needs can best be addressed by these persons. Participating schools formed teams of…

Several tests from the Educational Testing Service (ETS) have been used or are candidates for use by the Tennessee State Department of Education as initial licensure endorsement area tests. Memphis State University conducted a study in 1991 to recommend minimum qualifying scores for endorsement area applicants who would take the applicable tests.…

The involvement of an actual class in the conduct of a product evaluation is described as a powerful learning experience for the students and a valuable service for a client. The essential elements of such a program are: (1) a teacher-negotiated contract for an evaluation; (2) students who sign on by enrolling for credit; (3) background provided…

In this paper, performance assessments are cast within a sampling framework. A performance assessment score is viewed as a sample of student performance drawn from a complex universe defined by a combination of all possible tasks, occasions, raters, and measurement methods. Using generalizability theory, the authors present evidence bearing on the…