To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

The purpose of this study is to extend the work of Spybrook and Raudenbush (2009) and examine how the research designs and sample sizes changed from the planning phase to the implementation phase in the first wave of studies funded by IES. The authors examine the impact of the changes in terms of the changes in the precision of the study from the…

In this article, a group of inservice providers and beginning researchers describe their experiences in learning to conduct evaluation research on a long-term school-university partnership program. We offer the practical lessons we learned in how to undertake such a study, and we share the immediate and powerful effects that the process of…

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

Higher education experts tout learning outcomes assessment as a vehicle for program improvement. To this end the authors share a rubric designed explicitly to evaluate the quality of assessment and how it leads to program improvement. The rubric contains six general assessment areas, which are further broken down into 14 elements. Embedded within…

This action research study was conducted for purposes of changing the formal evaluation for school administrators to one constructed around the Interstate School Leaders Licensure Consortium (ISLLC) 2008 standards, inclusive of multifaceted components aimed to increase the active participation of both the evaluator and the individual being…

Increasingly, government, foundations, and others are asking community-based organizations for more evaluation information. Although the demand for this information may be increasing, the field knows very little about the way organizations are responding to this demand. Using data collected from interviews and a mail survey of community-based…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

Recent calls for high standards and hard content for all students have brought a growing interest in Opportunity-To-Learn (OTL) measures. OTL indicators provide valuable information for anyone interested in knowing what instruction is like, whether it is equitably distributed, and whether it is improving over time. This paper describes an effort…

The "2004/06 Beginning Postsecondary Students Longitudinal Study (BPS:04/06)" is sponsored by the U.S. Department of Education to respond to the need for a national, comprehensive database concerning issues students may face in enrollment, persistence, progress, and attainment in postsecondary education and in consequent early rates of…

Research practitioners have traditionally collected and analyzed data using experimental designs and inferential statistical procedures. In addition to being difficult to learn and apply, these quantitative procedures generally leave out such variables as attitudes, feelings, and emotions. This paper describes the nature and role of qualitative…

This report describes the methods and procedures used for the Beginning Postsecondary Students Longitudinal Study: 1996-2001 (BPS:1996/2001). These students, who started their postsecondary education during the 1995-96 academic year, were first interviewed in 1996 as part of the National Postsecondary Student Aid Study (NPSAS:96). A follow-up…

This text is designed to enable educators to design, conduct, and report research and evaluation in a way that transforms special education by addressing the needs of persons with disabilities as heterogeneous, cultural groups. The book explores ways to adapt those research methods to the special education context by providing a framework for…