To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

The commentaries on my article contain a number of points with which I disagree but also several with which I agree. For example, I continue to believe that the existence of many cases in which between-person variability does not increase with age indicates that greater variance with increased age is not inevitable among healthy individuals up to…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Horner et al. (2005) present a review substantiating how single-subject research methodology can be utilized to determine whether interventions are evidence-based practices (EBPs). The current study utilized the Horner et al. research piece to: (a) systematically identify a set of quality standards for the evaluation of single-case research…

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

Web-based surveys have become more prevalent in areas such as evaluation, research, and marketing research to name a few. The proliferation of these online surveys raises the question, how do response rates compare with traditional surveys and at what cost? This research explored response rates and costs for Web-based surveys, paper surveys, and…

This action research study was conducted for purposes of changing the formal evaluation for school administrators to one constructed around the Interstate School Leaders Licensure Consortium (ISLLC) 2008 standards, inclusive of multifaceted components aimed to increase the active participation of both the evaluator and the individual being…

Action research places a powerful tool for school improvement in the hands of teachers. By highlighting the outcomes that are possible and presenting clear steps in the research process, this book is one to encourage anyone who is seeking to implement evidence-based school improvement. Eileen Piggot-Irvine uses her Problem Resolving Action…

This study compares three variations in how researchers construct middle childhood social networks: (1) with "friendships" or "affiliations" as a relational tie; (2) with children providing "self reports" of relationships, or in addition, "multi-informant reports" of relationships in which they are not involved; and (3) whether network computation…

This article describes rates of missing item responses in personal digital assistant (PDA) assessments as compared to paper assessments. Data come from the evaluation of a classroom-based leisure, life skills, and sexuality education program delivered to high school students in Cape Town, South Africa. Analyses show that the paper assessments had…

In the context of health sciences education, and education in general, the knowledge or ability of one or several subjects in a specific area is frequently compared using different forms of a test, or by means of different instruments aimed at measuring this knowledge or ability. In such cases, test scores must be equated so that they can be…

The authors reviewed the application of consensual qualitative research (CQR) in 27 studies published since the method's introduction to the field in 1997 by C. E. Hill, B. J. Thompson, and E. N. Williams (1997). After first describing the core components and the philosophical underpinnings of CQR, the authors examined how it has been applied in…

Qualitative research has increased in popularity among social scientists. While substantial attention has been given to various methods of qualitative analysis, there is a need to focus on strategies for collecting diverse forms of qualitative data. In this article, the authors discuss four sources of qualitative data: participant observation,…

Increasingly, government, foundations, and others are asking community-based organizations for more evaluation information. Although the demand for this information may be increasing, the field knows very little about the way organizations are responding to this demand. Using data collected from interviews and a mail survey of community-based…

The Project on State-Level Child Outcomes is designed to assist states and other groups to improve the measurement of child outcomes in state welfare evaluations and in other state data systems. This report summarizes a meeting of the 12 states (California, Connecticut, Florida, Illinois, Indiana, Iowa, Michigan Minnesota, Ohio, Oregon, Vermont,…