The current age of standardization and accountability in education presents a need for educators to be proficient consumers and producers of data. To understand what mathematics teachers see as the purpose of data and assessment, as well as their perceived needs in these areas, we administered a survey to all mathematics teachers in two school…

This paper initiates the AERA symposium on issues and methods in qualitative evaluation with a theoretical overview and critique of the state of the evaluation field in the United States. Some of the basic theoretical underpinnings to a qualitative approach to evaluation are presented. This type of approach complements and compensates for those…

The spread of testing to its present near-universal status in American education is ascribed in part to the fact that tests have been found generally superior to suggested alternative ways of obtaining information about human behavior. Where alternative methods are used, it is from necessity rather than choice: there are important human…

Studies were conducted by the American Institute for Research (AIR) under contract with the Department of Education (ED). An evaluability assessment determines the extent to which a program is ready for evaluation, the changes needed to make the program more manageable and accountable, and toward what questions a more extensive evaluation might…

Though instructional development models stress the importance of formative evaluation, techniques for the formal evaluation of video tape programs remain primitive. The attention, attitude, and adoption levels achieved can be assessed by use of the following evaluation instruments: (1) expert appraisal of script; (2) special questionnaires; (3)…

This paper reviews what has been learned about evaluation ultilization during the past 20 years. Evaluation utilization is discussed in terms of what is used, who uses evaluation, when evaluation is used, how evaluation is used, where evaluation is used, and why evaluation is used. It is suggested that the personal factor - the interests and…

The field of ethnography is expected to provide reliable, accurate information regarding some aspect of an unfamiliar culture. However, this contribtuion is only useful if the results are presented along with a description and critical evaluation of the context in which the data was obtained. An example of failure to do this is found in an…

Procedures for generating evaluation questions in the Discrepancy Evaluation Model (DEM) are problematic as they are described in the literature. These procedures would lead to unmanageably or ineffectively long lists of questions. Any process of narrowing down the list must be drawn from other sources. One such source, developed for a specific…

For an evaluation design or "political strategy" to succeed in instituting a process of valuing and be appropriate for a particular setting, patterns of social relations and beliefs about the evaluation must be in agreement with those of the chosen evaluation design. This agreement must be in place either at the onset or occur during the…

Curriculum criticism, an alternative to traditional modes of educational inquiry, encourages researchers and evaluators to respect the unique and non-replicable qualities of school training. It assumes an analogy between the curriculum (as lived-in experience) and a work of art (which offers an immediate experience to viewers). The curriculum…

Brief case studies of three projects are presented to illustrate the steps which open "Wonderful Programs" to evaluation research. The evaluator is provided with the perspective needed to believe the evaluation is worth doing. The project staff is then redirected to the need for a new type of evidence. An ongoing review of the commitment…

This report is based on the observations of the recent director/consultant of the Center for Evaluation and Policy Research (CEPR) at the University of Vermont concerning evaluation practices in educational research. The history of CEPR and descriptions of practices in managing the center, directing several research and evaluation projects, and…

This paper discusses finding new approaches to personnel evaluation, learning to handle special problems that arise, and calculating prospects for program success. Obstacles to an effective evaluation program, which the paper discusses and diagrams, include diverse or conflicting expectations, time drain, negative attitudes, lack of relevancy,…

The new NIE (National Institute of Education) projects, Compensatory Education Study (Hill et al., 1976, 1977a, 1977b) and the Vocational Education Study (David et al., 1978), along with an earlier Safe Schools Study, are being considered in the evaluation community as possible new paradigms for research. Results of previous evaluation studies…

Assessment in the discipline of speech communication is far from a "passing trend." Between 1988 and 1991, assessment activity on college and university campuses moved from a 55% level of involvement to 81%. Following certain steps allows for an approach that needs to be taken to make the transition to departmental assessment a…