Some of the methodological problems in analyzing and reporting qualitative data are addressed, and some solutions based on recent experiences in conducting several qualitative studies are proposed. The following are some guidelines for implementing an intuitive approach to analyzing and reporting qualitative data: (1) use a team of evaluators; (2)…

Problems related to the evaluation of rehabilitation agencies and rehabilitation education programs are reviewed. Questioned are the assumptions that even shoddy evaluation is better than nothing and that the consumer is one of the best sources of evaluation data. Corruption of data and selective or distorted reporting of results are discussed.…

Serial Evaluation Activities (SEAs) are series' of focused evaluational studies, each dealing with a well-defined "component unit" within a complex project. Strategies for enhancing timeliness in SEAs include a comprehensive conceptual framework, a permanent institutional setting, a prearranged sample plan, utilization of item banks, and…

Two quick methods for evaluating pilot tests of training programs are (1) group debriefing--directed group discussion with pilot participants; and (2) short surveys directly after specific modules are taught and at the end of the course. (SK)

"Black box" evaluation considers program input and outcomes (what) without considering process (how and why). A broader approach to evaluation based on implementation process theory explores the social system context of programs and provides information useful for improving them. (SK)

Evaluation data about extension programs are subject to variation. Program improvement requires control of this variance. Statistical quality control charts provide a means of measuring variation, determining sources, and making modifications. (SK)

This paper provides a rationale for studies of educational program implementation and offers a causal model for program evaluation emphasizing pupil-related variables that intervene between program implementation and outcome variables. The rationale is followed by a discussion of implementation as an evaluation construct. Process, independent…

The author proposes using an action research model to diagnose, develop, implement, and evaluate a career development (CD) program that fits the needs and goals of the organization. Phases of a CD program development plan (data gathering, analysis and synthesis, feedback, program development, pilot implementation, and tracking) are examined. (CT)

The rupture between evaluation and action is seen as a failure to take a systems view of the situation. Both the organization and the proposed evaluation program must be understood as interactive systems, which mesh with, rather than oppose, each other if they are appropriately designed and implemented. (MLW)

Demonstrating program impact through documentation of child progress is a problem in programs for handicapped children. It is proposed that intervenors consider approaches closely tied to the actual interventions. Four strategies are described: increased magnitude of intervention, increased power of design, refined assessment procedures, and…

This paper is devoted to an analysis of the "Standards for Evaluation of Educational Programs, Projects, and Materials" as they apply to qualitative data. The most difficult ethical problem arises from the conflict between the right to privacy of research subjects and the right to know of audiences. There are two technical points in the…

Separate selection and pretesting of students eliminate regression effects in the pre-post achievement gain measured in the RMC Model--A method of program evaluation. (CP)

A matrix approach can solve the problem of identifying quality technical education programs. This method focuses on the end products of the program rather than on the educational process itself. Educators must use their professional competencies to judge program quality based on follow-up data and costs per pupil per program. (CT)

Program evaluation is seen as an organized process of collecting and disseminating information to assist administrators and faculty in making judgments about the value of academic departments and programs. The decision-making process depends upon the network of people designed to implement the system of program evaluation. (MLW)

When different individuals operating in different contexts implement similar innovations, they approach the various parts of the innovation in different ways. When assessed according to the research procedures used to study innovation implementation at the Research and Development Center for Teacher Education at the University of Texas at Austin,…