NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 5 results Save | Export
Peer reviewed Peer reviewed
Direct linkDirect link
Tipton, Elizabeth – Journal of Educational and Behavioral Statistics, 2014
Although a large-scale experiment can provide an estimate of the average causal impact for a program, the sample of sites included in the experiment is often not drawn randomly from the inference population of interest. In this article, we provide a generalizability index that can be used to assess the degree of similarity between the sample of…
Descriptors: Experiments, Comparative Analysis, Experimental Groups, Generalization
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Tipton, Elizabeth; Yeager, David; Iachan, Ronaldo – Society for Research on Educational Effectiveness, 2016
Questions regarding the generalizability of results from educational experiments have been at the forefront of methods development over the past five years. This work has focused on methods for estimating the effect of an intervention in a well-defined inference population (e.g., Tipton, 2013; O'Muircheartaigh and Hedges, 2014); methods for…
Descriptors: Behavioral Sciences, Behavioral Science Research, Intervention, Educational Experiments
Tipton, Elizabeth – Society for Research on Educational Effectiveness, 2011
The main result of an experiment is typically an estimate of the average treatment effect (ATE) and its standard error. In most experiments, the number of covariates that may be moderators is large. One way this issue is typically skirted is by interpreting the ATE as the average effect for "some" population. Cornfield and Tukey (1956)…
Descriptors: Probability, Statistical Analysis, Experiments, Generalization
Peer reviewed Peer reviewed
Direct linkDirect link
Tipton, Elizabeth – Journal of Educational and Behavioral Statistics, 2013
As a result of the use of random assignment to treatment, randomized experiments typically have high internal validity. However, units are very rarely randomly selected from a well-defined population of interest into an experiment; this results in low external validity. Under nonrandom sampling, this means that the estimate of the sample average…
Descriptors: Generalization, Experiments, Classification, Computation
Tipton, Elizabeth; Sullivan, Kate; Hedges, Larry; Vaden-Kiernan, Michael; Borman, Geoffrey; Caverly, Sarah – Society for Research on Educational Effectiveness, 2011
In this paper the authors present a new method for sample selection for scale-up experiments. This method uses propensity score matching methods to create a sample that is similar in composition to a well-defined generalization population. The method they present is flexible and practical in the sense that it identifies units to be targeted for…
Descriptors: Sampling, Selection, Research Methodology, Reading Programs