Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Complex survey data are collected by means other than simple random samples. This creates two analytical issues: nonindependence and unequal selection probability. Failing to address these issues results in underestimated standard errors and biased parameter estimates. Using data from the nationally representative Head Start Family and Child…

The determinants of sentencing are of much interest in criminal justice and legal research. Understanding the determinants of sentencing decisions is important for ensuring transparent, consistent, and justifiable sentencing practice that adheres to the goals of sentencing, such as the punishment, rehabilitation, deterrence, and incapacitation of…

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

Evaluators usually have preconceptions about how decisions are made in social programs and how evaluation results will be used. This article demonstrates how an evaluator's choice of a decision-making model has significant impact on the conduct and fate of the research. (Author/CM)

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Describes procedures that can be used to summarize the effect of schools when interactions between school practice and student background exist. Applies these procedures to a fairly realistic school effects dataset. Highlights the importance of considering differential school effectiveness rather than using a single quantitative indicator. (SLD)

A broad conceptual framework is presented as a tool to guide researchers toward identification and development of variables in policy implementation studies. Concepts for developing variables to measure the "amount" of implementation and variables to identify the aspects of policy that need to be incorporated in a study are discussed.…

An analytical technique is reviewed that allows a researcher to decompose informant reports into their respective trait, informant bias, and measure specificity using LISREL. The technique is illustrated in a study of decision making in 151 police agencies. (SLD)

The validity of vignettes used to elicit subject responses in social science research is examined in a study of the validity of a group of patient assault vignettes seen by 12 persons with experience in patient care. A model for establishing the validity of vignettes is proposed. (SLD)

A formative evaluation model is proposed for use by administrators of large health services research grant programs. The model assists in assessing the purpose, methodology, and level of analysis of funded research. It is illustrated through a discussion of HIV/AIDS care. (SLD)