To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

In this article, a group of inservice providers and beginning researchers describe their experiences in learning to conduct evaluation research on a long-term school-university partnership program. We offer the practical lessons we learned in how to undertake such a study, and we share the immediate and powerful effects that the process of…

Many investigators have documented the need for valid and credible program evaluation research of teacher professional development programs. Accordingly, the purpose of this study was to conduct a comprehensive program evaluation of the Lincoln School District's Teacher Collaboration Time (TCT) staff development program. The study questions…

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

How can the average educator who teaches online, without experience in evaluating emerging technologies, build on what is successful and modify what is not? Written for educators who feel ill-prepared when required to evaluate e-learning initiatives, "Evaluating e-Learning" offers step-by-step guidance for conducting an evaluation plan of…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

Articles in this special issue suggest improvements in longitudinal program evaluation to meet the challenges of evaluation of human services programs. Contributions describe innovations in design, methods, data analysis, utilization, and interpretation of the findings of longitudinal studies. (SLD)

Examined the utility of general growth mixture modeling (GGMM) for evaluating early childhood education programs. Initially, growth mixture modeling procedures identified two growth patterns among Head Start children. However, GGMM procedures found that children with at least 2 years program participation did not have faster achievement growth…

Although focus groups continue to gain popularity in marketing and social science research, their use in program evaluation has been limited. Here we demonstrate how focus groups can benefit evaluators, program staff, policy makers and administrators by providing an in-depth understanding of program effectiveness from the perspective of…

This article is the second contribution to a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information that decision makers can use with confidence when conducting program evaluation and policy…

This monograph critiques the many nonexperimental impact estimation approaches that have been based on external comparison groups. It proposes an approach to evaluating employment and training (E&T) programs that calls for using the group of individuals who apply to a program but then choose not to participate in that program as an…

An overview of the evaluation issues associated with contraceptive social marketing programs is provided. Methodologies covered include survey techniques, cost-effectiveness analyses, retail audits of sales data, time series analysis, nested logit analysis, and discriminant analysis. (TJH)