We present a case study of the process through which a methodology was developed and applied to a quasi-experimental research study that employed propensity score matching. Methodological decisions are discussed and summarized, including an explanation of the approaches selected for each step in the study as well as rationales for these…

The authors encourage those in the field of school psychology to consider the use of learning disabilities assessment practices in relation to specific American Psychological Association and National Association of School Psychologists ethical codes and in regard to the American Educational Research Association, American Psychological Association,…

The importance of addressing the political dynamics inherent in any evaluation research process is discussed. The theoretical orientation contributing to the denial and avoidance of politics is articulated and contrasted with one which posits politics as normative and useful. (Author/LMO)

Analysis of the assumptions underlying the stakeholder approach to evaluation combined with the limited experience in testing the approach reported in this volume, suggests that some claims are cogent and others problematical. (Author)

This paper offers answers to nine important questions concerning standard-setting issues and methods: (1) Should normative or content-referenced standards be used? (2) Different standard-setting methods yield different results. What is your reaction to this finding? That of your clients? Does this finding present a problem for the application of…

As the number and scope of school-based clinics grow, interest in their evaluation increases. Evaluation of a comprehensive school-based clinic program in New York City revealed methodological issues in evaluation of these programs. The first issue involves program goals and objectives. Even before program implementation, the evaluator should…

This model of consultation is a process of highly structured consensus for decision making. The consultant provides a framework for generating plans and solutions. The weakest link in consultation appears to be research and evaluation. Infusing consulting interns and university professors into internal operations will result in better evaluation…

Policy analysis, or policy study, is defined as the study of the nature, causes, and effects of alternative public policies; sometimes policy analysis refers to specific methods used. Two new developments associated with policy analysis are discussed. One is the concern for deducing the effects of alternative policies before they are adopted, as…

The National Center for Education Statistics supported this conference as a first step in a dialogue among forecasters to benefit all in the field. Fifty forecasters representing 20 different federal agencies attended the day-long session. Objectives of the conference include: (1) to bring forecasters together for a forum to share information on…

Reviews the process employed in evaluating the national 4-H program. Holds that the evaluation design was influenced by political, rather than methodological, concerns. Takes examples from the 4-H evaluation to illustrate dilemmas that have emerged in current evaluation process and theory. (Author/GC)

One problem faced by researchers is the selection of the most appropriate research method or methods, given the context of the research setting. This dilemma does not concern the choice of the best research method given the program objectives or research questions, nor the selection of the best state-of-the-art methods. The issue concerns the…

The possible influence of cognitive dissonance in psychotherapy was examined by conceptualizing therapy as an effort justification process. It was predicted that freely choosing to undergo a highly effortful procedure would aid in positive therapeutic change. Subjects (N=52) participated in a weight-reduction experiment in which the degree of…

This chapter presents a number of problems related to designing local-level summative evaluation studies and suggests solutions to these problems. Three general areas are covered. First, many of the motivational, organizational, and attitudinal constraints likely to face the local-level evaluator are discussed. Second, various threats to the…

The need for competent formal evaluation programs, particularly for new federally assisted programs, is expressed. Problems in defining educational evaluation and its requirements, in designing such evaluations, and 3 possible sources of faulty conceptual bases for evaluations, are presented. An attempt is made to define evaluation in general, to…

This article challenges applied behavior analysts to use their knowledge of consumer behavior and effective educational strategies to provide consumers with useful information, thereby enabling them to make informed decisions. This will decrease the misconceptions that many consumers have about behavior analysis, thus improving the social validity…