The emergence of a new, naturalistic, paradigm of inquiry has led to a demand for rigorous criteria that meet traditional standards of inquiry. Two sets are suggested, one of which, the "trustworthiness" criteria, parallels conventional criteria, while the second, "authenticity" criteria, is implied directly by new paradigm…

Ten functions of program theory are reviewed: contributing to social science knowledge; assisting policymakers, discriminating between theory failure and program failure, identifying the problem and target group, providing program implementation description, uncovering unintended effects, specifying intervening variables, improving formative use…

Two forms of naturalistic evaluation have appeared within the past decade: (1) a collection of qualitative techniques that are complimentary with conventional quantitative methods; and (2) an alternative paradigm that emphasizes the negotiation of multiple socially constructed realities, interdependence of facts and values, and the emergent…

Modeling the process by which participants are selected into groups, rather than adjusting for preexisting group differences, provides the basis for several new approaches to the analysis of data from nonrandomized studies. Econometric approaches, the propensity scores approach, and the relative assignment variable approach to the modeling of…

Program theory and implementation process theory contribute, respectively, to specifying the what and the why of program delivery. This article discusses the relationship between these two theories and the types of data collection methods that can be derived from each in order to contribute to more comprehensive evaluation designs. (JAZ)

Program theory can be used to improve programs and policies. This article describes a set of techniques for complicating and simplifying program theory, referred to as conceptual and action heuristics. Methods such as analyzing metaphors, clarifying concepts, mapping, component assessment, causal modeling, and decision analysis are discussed. (JAZ)

Several conceptual issues in the theory of evaluation methodology are discussed and illustrated. Four objectives are to: (1) narrow the distinction between research and evaluation; (2) extend the scope of triangulation and multimethods; (3) approach the problem concretely with extended data and interpretations; (4) structure the discussion in…

In evaluation, the whole is greater than the sum of the parts when quantitative and qualitative approaches and methods are combined. Some circumstances in which both approaches can be effectively combined are considered, and case studies of two evaluations using multiple methods are presented. (LMO)