Whether selection processes contribute to group-level disparities or merely reflect pre-existing inequalities is an important societal question. In the context of observational data, researchers, concerned about omitted-variable bias, assess selection-contributing inequality via a kitchen-sink approach, comparing selection outcomes of…

The What Works Clearinghouse (WWC) Standards Briefs explain the rules the WWC uses to evaluate the quality of studies for practitioners, researchers, and policymakers. This brief explains what baseline equivalence is and why it matters. As part of the WWC review process for certain types of studies, reviewers assess whether the intervention group…

Randomized experiments provide unbiased estimates of treatment effects, but are costly and time consuming. We demonstrate how a randomized experiment can be leveraged to measure selection bias by conducting a subsequent observational study that is identical in every way except that subjects choose their treatment--a quasi-doubly randomized…

Adolescent clinical and subclinical depression has a significant negative impact on adolescents well being, school performance and consequently produces maladaptive outcomes in terms of subsequent education and occupational functioning. This research is a part of a larger research project with a focus on clinical and subclinical depression during…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

The need to attend to both methodological and social concerns is demonstrated in two examples: one where the unchecked effects of the social consequences of a methodologically rigorous research design invalidated the evaluation and a second where explicit trade-offs between methodological rigor and social costs enabled the evaluation to proceed.…

This paper identifies methodological and practical problems in studies of child maltreatment, including developing classification schemes for multiple forms of maltreatment; distinguishing between chronic maltreatment and isolated incidents; choosing criteria for selecting comparison groups; determining whether comparison groups have experienced…

Addresses a number of ethical and methodological issues related to research involving vulnerable populations such as the frail elderly, when the research design calls for a control or nonintervention group. Techniques are presented for building a "limited" service component into the research design. (Author)

The problem of the appropriate comparison group for bereavement studies is discussed. The use of the retrospective pretest design is illustrated through a longitudinal study of bereavement outcome following pregnancy loss, involving 138 bereaved women and a comparison group of 215 currently pregnant women. (SLD)

Evidence is presented that strengthens the argument against comparison group research strategies. Results from a study of youth attitudes related to the California Conservation Corps involving 528 participants and 668 comparisons indicate that the comparison group may not adequately represent the nontreatment state. (SLD)

Mandatory real estate education has been intensely debated for many years. New Jersey is the only state in the nation that does not require licensed real estate agents to attend an ongoing educational event after securing a license to practice. A bill was proposed to the legislature to mandate real estate education in June of 2001. (It was…

The National Job Corps Study was conducted in 1994-1996 to provide a thorough and rigorous assessment of the impacts of the Job Corps on key participant outcomes. To ensure that the study was well implemented, a study team from Mathematica Policy Research, Inc., (MPR) investigated outcome and admission (OA) procedures in each Job Corps region and…