Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

E-learning researchers face considerable challenges in creating meaningful and generalizable studies due to the complex nature of this dynamic training medium. Our experience in conducting workplace e-learning research led us to create this guide for planning research on e-learning. We share the unanticipated complications we encountered in our…

PCI Education conducted a three-year longitudinal study to determine the comparative effectiveness of the "PCI Reading Program" ("PCI") for students with severe disabilities as implemented in Florida's Brevard Public Schools and Miami-Dade County Public Schools. The primary question addressed by the study is whether students…

This report provides an overview of the Milwaukee Parental Choice Program and the author's plan for evaluating it over a five year period. It also presents a brief summary of the main findings of the four distinct topical reports that the author and his colleagues have completed for 2006-07--the baseline year of the evaluation. Those four…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

PCI Education sought scientifically based evidence on the effectiveness of the "PCI Reading Program--Level One" for students with severe disabilities. During the 2007-2008 academic year. Empirical Education conducted a randomized control trial (RCT) in two Florida districts, Brevard and Miami-Dade County Public Schools. For this…

The U.S. Department of Education recently held a competition for grants to support states in their efforts to build longitudinal data systems to track and analyze student and school performance. The Value-Added Research Center (VARC) at the Wisconsin Center for Education Research, University of Wisconsin-Madison, proposed a Tri-State Partnership…

Factors that influence the sample size necessary for longitudinal evaluations include the nature of the evaluation questions, nature of available comparison groups, consistency of the treatment in different sites, effect size, attrition rate, significance level for statistical tests, and statistical power. (Author/GDC)

Designed to identify sources for planning longitudinal evaluation strategies, this paper provides an overview and bibliography of resources regarding vocational follow-up and presents a conceptual model for longitudinal program assessment. Introductory material highlights major works in the area of vocational program assessment and summarizes the…

The self-selection problem in program evaluation is explored, and two ways of addressing it, covariate control approaches and two-stage sample selection models, are described. A longitudinal study of the effects of participation in Alcoholics Anonymous illustrates both approaches and shows the advantages of the two-step procedure. (SLD)

Advocates that the Current Population Survey (CPS) be redesigned to permit valid longitudinal studies, that the CPS include questions to evaluate poverty programs, that a common sampling framework be designed for the CPS and operating agencies serving the poor to assure that links between CPS and other data can be established, and that samples of…

The evaluation of the preschool program conducted by the High/Scope Educational Research foundation is an example of a program evaluation that employed a randomized design and also examined long-term outcomes. The study, which employed a 22-year follow-up study, is important for its findings and its methodology. (SLD)

In 1988, Congress mandated a national longitudinal evaluation of the effects of the Title I program on students' academic achievement and classroom behavior. This paper presents an overview of the study design, analysis methods, and impact results for student achievement. The analysis used four types of designs to assess the impact of Title I: (1)…

Strategies are presented for analyzing longitudinal research designs with many waves of data using hierarchical linear modeling. The approach defines well-focused parameters that yield meaningful effect size estimates and significance tests. It is illustrated with data from the Boys Town Follow-Up Study. (SLD)

Articles in this special issue suggest improvements in longitudinal program evaluation to meet the challenges of evaluation of human services programs. Contributions describe innovations in design, methods, data analysis, utilization, and interpretation of the findings of longitudinal studies. (SLD)