Homelessness is a serious and growing issue. Evaluations of systemic-level changes are needed to determine progress in reducing or ending homelessness. The report card methodology is one means of systems-level assessment. Rather than solely establishing an enumeration, homelessness report cards can capture pertinent information about structural…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

In contrast to the prevailing image of monitoring systems as technical systems, it is proposed that they should rather be conceived of as social endeavors at exchanging information. Drawing on the monitoring and evaluation framework of Cornford, Doukidis, and Forster, the concept of information agreement is suggested as a way of assessing the…

Proposes group mean centering as a solution to the problem of pooling data from multiple sites. Uses California's Work Pays Demonstration Project to illustrate three analysis strategies for data from multiple sites. Discusses considerations in choosing the centering strategy. (SLD)

In multilevel regression, centering the model variables produces effects that are different and sometimes unexpected compared with those in traditional regression analysis. In this article, the main contributions in terms of meaning, assumptions, and effects underlying a multilevel centering solution are reviewed, emphasizing advantages and…

Opposes the practice of aggregating impacts on outcome dimensions to arrive at one summary assessment of program merit. Suggests that impacts should be kept separate and unweighted, expressed in their own measurement scales. Illustrates this method through an evaluation of the effects of research grants on a university. (SLD)

The chronic and relapsing nature of substance abuse points to the need for continuing care after a primary phase of treatment. This article reviews the economic studies of continuing care, discusses research gaps, highlights some of the challenges of conducting rigorous economic evaluations of continuing care, and offers research guidelines and…

Discusses potential sources of self-selection bias in quasi-experimental evaluations of whole-school reform and considers how individual school-level data might be used to provide valid impact estimates. Develops an instrumental variable strategy that can be used to improve on common value-added estimators when only post-treatment measures are…

Introduces an new approach for measuring the impact of whole school reforms. The approach, based on "short" interrupted time-series analysis, is explained, its statistical procedures are outlined, and how it was used in the evaluation of a major whole-school reform, Accelerated Schools is described (H. Bloom and others, 2001). (SLD)

The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…

The methodology and design of the process evaluation system of the Pawtucket Heart Health Program (an 11-year project for changing/documenting change in cardiovascular disease risk status of a northeastern city's residents) are described. Examples of the system's use are provided. The maintenance of such a system without substantial evaluation…

Presents conversion factors to be used to translate the quality of the respective contraception methods distributed to a single measure of protection for calculating couple-years of protection in family planning studies. Discusses the implications for the evaluation of family planning programs. (SLD)

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

In-house evaluators must develop evaluation procedures that accommodate not only their own professional standards but also the problem-solving styles of the organizations they serve. This article describes how a small sample of evaluators have adapted their methods to their contexts. (Author)

The collaborative effort between university researchers and a CETA sponsor aimed at "knowledge development" in employment and training services for disadvantaged out-of-school youth is described. Discussion is included concerning the feasibility of experimental evaluation for youth employment programs in a local setting. (Author/GK)