Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Complex survey data are collected by means other than simple random samples. This creates two analytical issues: nonindependence and unequal selection probability. Failing to address these issues results in underestimated standard errors and biased parameter estimates. Using data from the nationally representative Head Start Family and Child…

The determinants of sentencing are of much interest in criminal justice and legal research. Understanding the determinants of sentencing decisions is important for ensuring transparent, consistent, and justifiable sentencing practice that adheres to the goals of sentencing, such as the punishment, rehabilitation, deterrence, and incapacitation of…

Many Medicaid programs have either fully or partially carved out mental health services. The evaluation of carve-out plans requires a case-mix model that accounts for differing health status across Medicaid managed care plans. This article develops a diagnosis-based case-mix adjustment system specific to Medicaid behavioral health care. Several…

In multilevel regression, centering the model variables produces effects that are different and sometimes unexpected compared with those in traditional regression analysis. In this article, the main contributions in terms of meaning, assumptions, and effects underlying a multilevel centering solution are reviewed, emphasizing advantages and…

The problem of drawing causal inferences from retrospective case-controlled studies is considered. A model for causal inference in prospective studies is applied to retrospective studies. Limitations of case-controlled studies are formulated concerning relevant parameters that can be estimated in such studies. A coffee-drinking/myocardial…

A meta-program theory is proposed to overcome the limitations and improve the use of program theory as an approach to faith-based program evaluation. The essentials for understanding religious organizations, their various programs, and faith and spirituality are discussed to support a rationale for developing a faith-based program theory that…

Five causal metaphors running throughout youth employment and education programs are reviewed: (1) the functionalist economic model; (2) the institutional socialization model; (3) a psychosocial view of youth development; (4) the subcultural model; and (5) a self-determined community development vision. (Author/GK)

The role of program evaluation is examined in relation to policy analysis. Program evaluation is most persuasive as a component of the policy process when its role is clearly understood. Clarity can be achieved by using the program mandate to guide evaluation and by including practitioners in evaluation model developments. (SLD)

A group of defenses of qualitative evaluation methods is examined, based on a hard relativistic interpretation of the work of Thomas Kuhn. A promising defense of qualitative evaluation may be found in a soft-relativist interpretation of Kuhn's analysis of the nature of scientific discovery. (Author/LMO)

After a brief discussion of the terms implementation and monitoring, this article illustrates a strategy for monitoring program implementation. The strategy, called model-guided method, offers a way to develop conceptual and empirical specifications for testing the adequacy of a program implementation. It also provides feedback to program…

The use of theoretical models in impact assessment can heighten the power of experimental designs and compensate for some deficiencies of quasi-experimental designs. Theoretical models of implementation processes are examined, arguing that these processes are a major obstacle to fully effective programs. (Author/CM)

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Recognizing that community acceptance of potential juvenile justice treatment programs often determines the success or failure of the programs, an assessment model was developed to assist in policy planning. The procedure applies the tenets and methods of subjective expectancy utility models. (Author/GK)

A 10-site school program is evaluated, the history of community schools, local program's goals, and the method used to study each goal are described. Included also are a structural equation model of the data and discussion of the politics of the evaluation. (Author/GK)