Publication Date
In 2025 | 0 |
Since 2024 | 0 |
Since 2021 (last 5 years) | 1 |
Since 2016 (last 10 years) | 2 |
Since 2006 (last 20 years) | 11 |
Descriptor
Program Effectiveness | 11 |
Research Design | 11 |
Program Evaluation | 9 |
Evaluation Methods | 5 |
Statistical Analysis | 5 |
Research Methodology | 4 |
Federal Programs | 3 |
Intervention | 3 |
Bias | 2 |
Case Studies | 2 |
Causal Models | 2 |
More ▼ |
Source
American Journal of Evaluation | 11 |
Author
Bell, Stephen H. | 3 |
Peck, Laura R. | 2 |
Blake, Susan M. | 1 |
Burns, Catherine E. | 1 |
Chatterji, Madhabi | 1 |
Constance, Nicole | 1 |
Deterding, Nicole M. | 1 |
Dong, Nianbo | 1 |
Gubits, Daniel | 1 |
Harvill, Eleanor L. | 1 |
Jaycox, Lisa H. | 1 |
More ▼ |
Publication Type
Journal Articles | 11 |
Reports - Descriptive | 4 |
Reports - Evaluative | 3 |
Reports - Research | 3 |
Opinion Papers | 1 |
Education Level
Adult Education | 1 |
Audience
Location
Arizona | 1 |
California | 1 |
Maryland | 1 |
Laws, Policies, & Programs
No Child Left Behind Act 2001 | 1 |
Assessments and Surveys
Early Childhood Environment… | 1 |
Early Childhood Longitudinal… | 1 |
What Works Clearinghouse Rating
Bell, Stephen H.; Stapleton, David C.; Wood, Michelle; Gubits, Daniel – American Journal of Evaluation, 2023
A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…
Descriptors: Public Policy, Policy Formation, Federal Programs, Social Services
Zandniapour, Lily; Deterding, Nicole M. – American Journal of Evaluation, 2018
Tiered evidence initiatives are an important federal strategy to incentivize and accelerate the use of rigorous evidence in planning, implementing, and assessing social service investments. The Social Innovation Fund (SIF), a program of the Corporation for National and Community Service, adopted a public-private partnership approach to tiered…
Descriptors: Program Effectiveness, Program Evaluation, Research Needs, Evidence
Solmeyer, Anna R.; Constance, Nicole – American Journal of Evaluation, 2015
Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…
Descriptors: Program Effectiveness, Program Evaluation, Program Content, Measurement Techniques
Bell, Stephen H.; Peck, Laura R. – American Journal of Evaluation, 2013
To answer "what works?" questions about policy interventions based on an experimental design, Peck (2003) proposes to use baseline characteristics to symmetrically divide treatment and control group members into subgroups defined by endogenously determined postrandom assignment events. Symmetric prediction of these subgroups in both…
Descriptors: Program Effectiveness, Experimental Groups, Control Groups, Program Evaluation
Does My Program Really Make a Difference? Program Evaluation Utilizing Aggregate Single-Subject Data
Burns, Catherine E. – American Journal of Evaluation, 2015
In the current climate of increasing fiscal and clinical accountability, information is required about overall program effectiveness using clinical data. These requests present a challenge for programs utilizing single-subject data due to the use of highly individualized behavior plans and behavioral monitoring. Subsequently, the diversity of the…
Descriptors: Program Evaluation, Program Effectiveness, Data Analysis, Research Design
Dong, Nianbo – American Journal of Evaluation, 2015
Researchers have become increasingly interested in programs' main and interaction effects of two variables (A and B, e.g., two treatment variables or one treatment variable and one moderator) on outcomes. A challenge for estimating main and interaction effects is to eliminate selection bias across A-by-B groups. I introduce Rubin's causal model to…
Descriptors: Probability, Statistical Analysis, Research Design, Causal Models
Harvill, Eleanor L.; Peck, Laura R.; Bell, Stephen H. – American Journal of Evaluation, 2013
Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…
Descriptors: Experimental Groups, Control Groups, Research Design, Sampling
Reichardt, Charles S. – American Journal of Evaluation, 2011
I define a treatment effect in terms of a comparison of outcomes and provide a typology of all possible comparisons that can be used to estimate treatment effects, including comparisons that are relatively unknown in both the literature and practice. I then assess the relative merit, worth, and value of all possible comparisons based on the…
Descriptors: Program Effectiveness, Evaluation Methods, Evaluation Criteria, Comparative Analysis
Lam, Tony C. M. – American Journal of Evaluation, 2009
D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…
Descriptors: Workshops, Success, Self Evaluation (Individuals), Test Bias
Chatterji, Madhabi – American Journal of Evaluation, 2007
This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…
Descriptors: Program Effectiveness, Research Methodology, Educational Research, Research Design
Jaycox, Lisa H.; McCaffrey, Daniel F.; Ocampo, Beverly Weidmer; Shelley, Gene A.; Blake, Susan M.; Peterson, Donna J.; Richmond, Lucinda S.; Kub, Joan E. – American Journal of Evaluation, 2006
The current emphasis on best practices for school-based health and mental health programs brings with it the demand for evaluation efforts in schools. This article describes the challenges of launching a successful school program and evaluation, with lessons learned from three projects that focus on intimate partner violence. The authors discuss…
Descriptors: Intervention, Prevention, Research Methodology, Program Implementation