The principles of method development and assessment that have resulted from a long-range project at the Northwest Regional Educational Laboratory to create new methods for program evaluation are summarized. (Author/AL)

The use of qualitative measures in a quantitative framework can result in triangulation. Independently conducting qualitative and quantitative evaluations is less likely to cause triangulation and allows for greater discovery. Three usages of triangulation, research as story telling, and problems with qualitative methods and phenomenological…

Beyond assessing whether a treatment is effective, researchers must understand why it is effective if evaluation research is to determine how treatments can be improved. Means of combining process evaluation and outcome evaluation toward this goal and two general approaches to testing causal models are described. (TJH)

Attitude theories are reviewed as they relate to the response rates for mailed questionnaires. Attitudes as behavioral intentions and as involvement are discussed in detail. (BW)

A pilot study of the use of an investigative journalism document-tracking procedure in the evaluation of library operations is discussed. The technique provides a straightforward but powerful method of evaluation that is equally applicable in simple studies and complex investigations. (Author/AL)

The concept of ideology is discussed. An evaluation design that is based on values and ideologies is advocated so that it can be applied to services in different categories and still produce valid comparisons. (Author/AL)

In this account of the drafting of the Evaluation Research Society (ERS) Standards, the author notes that the committee was concerned not only with a broad range of evaluation applications, but also with different forms of evaluation. The absence of specificity in the standards reflects the committee's steering between opposing views. (Author/LC)

The variety of contexts, the politics of each situation, and the availability of resources all dictate variations in assessing outcomes. Seven major principles of program evaluation are considered, along with a cautionary note to the ambitious who expect large program effects. (Author)

Our scientific conceptions of evaluation are strongly influenced by underlying, deep-seated metaphors. This analysis draws upon recent philosophic work concerning the role of metaphors in all thought processes. (Author/PN)

Focusing on the patterns of interaction between evaluators and managers, the interrelationship of evaluation and management activities are examined. Strategies for improving relationships between the two groups are suggested. (Author/PN)

Standardization is inimical to innovation. Although the function of a standard is to standardize, the Evaluation Research Society (ERS) Standards avoid a standardizing effect. Their contribution lies mostly in the symbolism of their existence: to issue a set of standards is to proclaim maturity of thought for the field. (Author/LC)

The assessment of the outcomes of social programs should always include estimates of the size of the effects produced. Various approaches to this problem are discussed. (Author)

Multiple evaluation methods (MEMs) can cause an inferential challenge, although there are strategies to strengthen inferences. Practical and theoretical issues involved in the use by social scientists of MEMs, three potential problems in drawing inferences from MEMs, and short- and long-term strategies for alleviating these problems are outlined.…

This synthesis of the previous articles concludes that cultural considerations are important for effective evaluation practice. Culturally sensitive and situationally responsive evaluation practices can contribute to international understanding. (BS)

Construct validation theory is founded upon conflicting metaphysical principles, methodological approaches, and standards of adequacy. This paper explores these unrecognized conflicts and indicates some consequences that these conflicts have for construct validation theory. (Author/PN)