Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

This reaction article highlights areas of agreement and disagreement with the study conducted by Hughes, Rycus, Saunders-Adams, Hughes, and Hughes on the current state of research and practice in differential response (DR). Overall, we agree with several of the arguments put forth by Hughes et al. regarding the limitations of DR research and the…

In this article, the authors responded to nine commentaries by 17 contributors to their article, "Issues in Differential Response." The authors found that a majority of the respondents agreed with the major conclusions of "Issues in Differential Response." However, there were varying degrees of disagreement regarding the…

Differential response (DR), also referred to as alternative response (AR), family assessment response (FAR), or multiple track response, was developed to incorporate family-centered, strengths-based practices into child protective services (CPS), primarily by diverting lower risk families into an assessment track rather than requiring the…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

The third-year evaluation of the federally funded Washington, D.C. voucher program shows that low-income students offered vouchers in the first two years of the program had modestly higher reading scores after three years but showed no significant difference in mathematics. Students were randomly assigned to treatment and control groups, and the…

A report from the School Choice Demonstration Project examines issues concerning the funding formula used for the Milwaukee Parental Choice Program (MPCP). It finds that the program generates a net saving to taxpayers in Wisconsin but imposes a significant fiscal burden on taxpayers in Milwaukee. However, these findings depend significantly on how…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

"How New York City's Charter Schools Affect Achievement" estimates the effects on student achievement of attending a New York City charter school rather than a traditional public school and investigates the characteristics of charter schools associated with the most positive effects on achievement. Because the report relies on an…

Comments on an article by Kotelchuck and colleagues concerning the benefits of WIC participation on pregnancy outcomes. Raises methodological considerations, especially the effects of duration of WIC participation and benefits, and the problem of matching study subjects with controls. (GC)

In a secondary analysis of the Abrams and Siegel evaluation of the Transcendental Meditation program at Folsom prison, experimental groups fared better than control groups, although the treatment explains only a small proportion of the variance. (Author)

Recognition of radio and television antismoking messages was measured in 6 treatment and 4 control cities. A survey of 574 adolescents found high recognition of messages even in areas where they were not broadcast, reinforcing the need for true control groups and distinctive messages to ensure validity in mass media evaluation. (SK)