Multiple evaluation methods (MEMs) can cause an inferential challenge, although there are strategies to strengthen inferences. Practical and theoretical issues involved in the use by social scientists of MEMs, three potential problems in drawing inferences from MEMs, and short- and long-term strategies for alleviating these problems are outlined.…

In no-difference research, no differences are found among groups or conditions. This article summarizes the existing commentary on such research. The characteristics of no-difference research, its acceptance by the research community, strategies for conducting such studies, and its centrality within the experimental and nonexperimental paradigms…

Situations in which mailed questionnaires are most appropriate are identified. Population variables, characteristics of questionnaires, and social desirability variables are examined in depth. (Author)

The dilemma inherent in formal standards results from the tension between maintaining quality control and constraining creativity. This dilemma is nowhere more apparent than in matters of method: measurement, sampling, research design, and statistical analysis. The author offers suggestions for revision of the standards to allow for specific…

Using examples from government program evaluation studies, six areas where research synthesis is more effective than individual studies are presented. Research synthesis can: (1) help match treatment type with recipient type; (2) explain which treatment features matter; (3) explain conflicting results; (4) determine critical outcomes; (5) assess…

Recent methodological advances are described that enable the analyst to extract additional information from the data envelopment analysis (DEA) methodology, including goal programming to develop cross-efficiencies, cluster analysis, analysis of variance, and pooled cross section time-series analysis. Some shortcomings of DEA are discussed. (LMO)

This theme issue discusses the misuse of evaluation. The eight articles all discuss instances in which the evaluation process or evaluation findings were misused. Misuse is usually not the result of methodological issues but rather is an issue of human relations and sometimes of political pressure. (SLD)

Evaluation synthesis, a meta-evaluation method developed by the General Accounting Office to improve evaluation utilization by legislators, is described. It is designed to: (1) focus on the information needs and priorities of legislators, and (2) ensure continuous communication between sponsor and evaluator. The strengths and limitations of this…

The applications of evaluation training in clinically oriented social interventions are examined. A joint program in evaluation and clinical psychology at Northwestern University is described. The core evaluation course, which emphasizes methodological study and substantial fieldwork, is discussed. (BS)

Two chapters of this issue consider critical multiplism as a research strategy with links to meta analysis and generalizability theory. The unifying perspective it can provide for quantitative and qualitative evaluation is discussed. The third chapter explores meta analysis as a way to improve causal inferences in nonexperimental data. (SLD)

Evaluation management requires a system for measuring, improving, and accounting for quality. The Institute for Program Evaluation in the United States General Accounting Office is developing such a system. (Author)

Time series analysis is applied to an assessment of the temporary and permanent impact of the 1975 Australian Family Law Act and its effect on number of divorces. The application and construct validity of the model is examined. (Author/PN)

The eight articles of this issue examine the nature of differences that arise between qualitative and quantitative researchers in program evaluation in terms of goals and epistemologies. The origins of these differences and their consequences are explored. Authors represent both perspectives but do not defend their ideological turfs. (SLD)

The delicacy required of ethnographic work is nowhere more evident and more necessary than at the conceptual crossroads where methods and ethical decision making intersect. This paper addresses moments of decision and puts them into perspective by locating them within the lifecycle of ethnographic evaluation. (LMO)

The methodology of data envelopment analysis, (DEA) a linear programming-based method, is described. Other procedures often used for measuring relative productive efficiency are discussed in relation to DEA, including ratio analysis and multiple regression analysis. The DEA technique is graphically illustrated for only two inputs and one output.…