ERIC Number: ED563154
Record Type: Non-Journal
Publication Date: 2013
Pages: 6
Abstractor: ERIC
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Evaluation of Alternative Difference-in-Differences Methods
Yu, Bing
Society for Research on Educational Effectiveness
Difference-in-differences (DID) strategies are particularly useful for evaluating policy effects in natural experiments in which, for example, a policy affects some schools and students but not others. However, the standard DID method may produce biased estimation of the policy effect if the confounding effect of concurrent events varies by individual characteristics and if the experimental group and the comparison group differ in such characteristics. This paper reviews the existing alternative DID methods and compares their identification assumptions with those of the new prognostic score-based DID strategy. The author hypothesize that, in comparison with other existing DID methods, the new prognostic score-based DID strategy invokes assumptions that are relatively more plausible and is more likely to produce unbiased and efficient estimates of policy effects. Empirical findings obtained from simulation studies will inform the understanding of the relative performance of the new prognostic score-based DID method in comparison with the existing DID methods under a wide array of scenarios often plausible in educational policy evaluations with accountability data. The results will contribute to the statistics and econometrics literature and will provide practical guidance for applied researchers.
Descriptors: Evaluation Methods, Bias, Research Methodology, Scores, Simulation, Educational Policy, Statistical Analysis, Measurement, Prognostic Tests, Economics
Society for Research on Educational Effectiveness. 2040 Sheridan Road, Evanston, IL 60208. Tel: 202-495-0920; Fax: 202-640-4401; e-mail: inquiries@sree.org; Web site: http://www.sree.org
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Society for Research on Educational Effectiveness (SREE)
Grant or Contract Numbers: N/A
Author Affiliations: N/A