This is the first book to gather and address what we have learned about the impacts and challenges of data-intensive teacher evaluation systems--a defining characteristic of the current education policy landscape. Expert researchers and practitioners speak to what we know (and what remains to be known) about evaluation measures themselves, the…

Available resources and indicators of high quality inclusive practices are presented in this compilation. Assembling many different resources in one place allows for easy comparison of potential indicators of quality. Excerpts and adaptations of the resources are intended to provide some familiarity with the content of each resource and encourage…

The representativeness of behavioral observation samples with durations of less than the whole time of interest was investigated with five profoundly mentally retarded physically handicapped adults in an institutional setting. It was found that the session representativeness was a function of the relative duration of the behavioral categories and…

Two participant observers evaluated the week-long camp experience of adult women in order to assess the appropriateness of participant observation research methods in the camp setting, to identify strengths and weaknesses of this method, and to develop guidelines for its use. The study was part of a larger evaluation of the 9th annual Women's Week…

The purpose of this paper is to summarize some of the author's logical and empirical reflections on the practice of using naturalistic techniques to conduct evaluations. The main assertion to be supported by these reflections is that naturalistic evaluation is possible and in some cases powerful. This assertion is supported through a review of (1)…

To provide a real life example of case study methodology for educational evaluation, a naturalistic study of a Catholic junior college in Minneapolis, Minnesota is presented. Conducted as part of the ongoing evaluation of a federally supported project, the study provides an external observer's descriptive portrayal of the school, plus the…

A social organizational theory is outlined, and how types of data drawn from it may be useful in an evaluation context is indicated. Anthropological ethnography is proposed as a more powerful tool in those evaluations undertaken from a phenomenological perspective. Naturalistic/qualitative evaluation lacks a theoretical perspective on how groups…

The reactivity of normal preschool children's peer praising behavior to observer presence was investigated during baseline and intervention conditions. Evaluation of an intervention package designed to increase peer praising suggested reactivity to observation during intervention. Results have implications for evaluation of internal validity of…

The purpose of this report was to explore one way in which quantitative and qualitative paradigms in program evaluation can be employed to reinforce each other. An evaluation was conducted of a large number of special education programs for preschoolers with handicaps in Louisiana. Since 1978, Louisiana has funded programs in 65 public school…

The paper describes a naturalistic evaluation study of an enrichment program for gifted learners in Newfoundland. The pull-out program (for two half days out of six) is described in terms of audience concerns and issues, standards, program components, and data-generating techniques (observations and interviews). The evaluation led to a report…

This report describes a two-phase study designed to (1) investigate the appropriate evaluation literature and develop a formative evaluation model; (2) investigate the formative evaluation procedures utilized by Advanced Systems Incorporated (ASI), a successful producer of training materials; (3) develop a model based upon these procedures; and…

This longitudinal study examined the effectiveness of two different assessment methodologies, low structured observation and structured elicitation tasks, to obtain communicative intents from 35 normal children at the sensorimotor stage of development (9-24 months). The two approaches appeared to vary depending on the age of the child and the…

This paper explores the variety of qualitative methods available, in the context of a larger quantitative-qualitative debate in the field of educational evaluation. Each approach is reviewed in terms of the work of its major proponents. The dominant forms of qualitative evaluation include: (1) ethnography; (2) naturalistic inquiry; (3) generic…

Although college faculty may hesitate to evaluate each others' teaching, it is a sensible alternative to evaluation by students or by administrators. Peer evaluations are not only useful for improving teaching, but also affect promotion and tenure decisions. When faculty are rated by observation, repeated visits and rater training are required in…

The Service Delivery Assessment (SDA) model is a human services evaluation tool which offers a viable alternative to more traditional approaches and is appropriate for small local evaluations as well as large national studies. There are five phases to an SDA study: assignment, pre-assessment, design, analysis, and communication of the findings.…