Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability.…

This article presents an analytic approach to assessing the relationship between policy advocacy activities and outcomes for discrete episodes of advocacy, using a holistic array of factors that affect the relationship between advocacy and policy change. The factors pertain to not only advocacy organizational structure and strategies, but also the…

Contemporary Froebelian-inspired early childhood education in the United States is challenged by government regulation and accreditation requirements that have arisen alongside neoliberalism in education. Using Critical Policy Analysis and case study examples from a preschool in Atlanta, Georgia, this paper examines the influence of neoliberalism…

This article describes a 12-step model that can be used for policy analysis. The model encompasses policy development, implementation, and evaluation; takes into account structural foundations of policy; addresses both legal formalism and legal realism; demonstrates contextual sensitivity; and addresses application issues and different…

Researchers and policy makers are increasingly dissatisfied with the "average treatment effect." Not only are they interested in learning about the overall causal effects of policy interventions, but they want to know what specifically it is about the intervention that is responsible for any observed effects. In the U.S., using…

This paper explores the notions of active ageing and elder learning in Hong Kong where a strategic approach to elderly education is applied by the government to encourage lifelong learning. The paper outlines the policy development and support for elder learning in Hong Kong in two distinct periods: pre-1997 and post-1997. The post-1997 period is…

Education reform advocates who base policy decisions on empirical research often face the argument that because background variables explain so much of student outcomes, it follows that policy interventions cannot be effective. This policy brief explains the logical fallacy in the argument, illustrating with two examples, one taken from the…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

Smaller universities may produce research which is on a par with larger, elite establishments. This is confirmed by a recently developed mathematical model, supported by data from British and French higher education research-evaluation exercises. The detailed nature of the UK system, in particular, allows quantification of the notion of critical…

This policy brief outlines how national education accounts (NEAs) are created, and why they are a vast improvement over current financial tracking systems in the education sector. Examples from the health sector illustrate the benefits of national accounts for improving public services, and their ubiquity highlights the poor state of affairs of…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

Nearly every high-priority item in national, federal, state, and local discussions about education--and policy proposals across the political spectrum--requires high-quality longitudinal data to inform its design, implementation, and evaluation. This factsheet shares Data Quality Campaign's (DQC's) analysis of what "Data for Action 2011:…

From the 1980s to the present, educational accountability in the United States has grown dramatically. Such accountability in U.S. school districts, although driven primarily by external demands, has internal manifestations as well. The chapter traces the historical development of internal evaluation in American school districts, then highlights…

This report uses administrative data provided by the Los Angeles Unified School District (LAUSD) on kindergarten to third-grade students. The records begin with kindergartners in 2001, first-graders in 2002, second-graders in 2003, and third-graders in 2004 and include all LAUSD students in grades K-3 for 2004 to 2008. Altogether, the raw data…

This article demonstrates the value of theoretical ex-ante evaluation of policy programs. We show how a specific policy might not achieve its objectives and illustrate the elements of the policy, which need improvement. These conclusions are based on a reconstruction and evaluation of the theory behind a policy program that aims to increase…