Most program evaluation efforts concentrate on assessments of "program implementation" and "program outcomes." However, another area of programs that has not received sufficient attention in the literature is evaluating the plan of the program. Since the quality of the plan and planning process can influence program…

Early investigation led the Evaluative Study of Action Research (ESAR) team to conclude that the complexity of a global, large scale study (evaluation of more than 100 highly diverse action research [AR] projects) called for an overarching research evaluation framework that differed from traditional frameworks. This article details the flexible,…

Effective principals run effective schools--this much we know. Accurately measuring principal effectiveness, however, has long been an elusive goal for school administrators. In this indispensable book, author James H. Stronge details the steps and resources necessary for designing a comprehensive principal evaluation system that is based on sound…

This paper reviews the literature about peer and self-assessment in university courses from the point of view of their use, and the suitability of their use, in the first year of university study. The paper is divided into three parts. The first part argues that although first-year students are involved in many of the studies that report on the…

Designing and implementing assessment instruments are ongoing challenges for physical educators. The initial design phase includes asking the question, "What do I want the students to know and/or be able to do?" Seemingly, the question is direct and should lead to a concrete answer. In addition to designing assessment instruments, one of the most…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

Despite the common belief that information and communication technology (ICT) has the potential to support certain fundamental changes in learning, few have examined ICT implementation conceptually within a wider context of educational change. Methodologically, we are by and large limited to building simple models that accommodate only a single…

As states and communities invest in initiatives to improve the quality of early care and education, the measurement of quality is becoming more widespread and the importance of measuring quality well is gaining increasing attention. Within the broad context of interest in improving quality, this report seeks to differentiate among a number of…

Despite the growing knowledge base on evidence-based practices in social work and medicine, there is a large gap between what is known and what is consistently done. Implementation research is the study of methods to promote the uptake of research findings into routine practice. In this article, we describe the rationale for implementation…

Environment and sustainable development show how policies are becoming ever more complex and ambiguous. This trend calls for new evaluation approaches. They need to be more clearly focused on specific, explicit concerns. They must be driven by a strategic concept of use to overcome the vulnerability to manipulation of many integrative, essentially…

The purposes of metaevaluation go beyond the traditional functions of accountability and enhancement. It helps guide strategic organizational change and legitimizes evaluation systems. Metaevaluation results can also be used to create checklists so that the persons responsible for any evaluation can revise, monitor, and control them by themselves.…

Qualitative case study methodology provides tools for researchers to study complex phenomena within their contexts. When the approach is applied correctly, it becomes a valuable method for health science research to develop theory, evaluate programs, and develop interventions. The purpose of this paper is to guide the novice researcher in…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

In consultation with experts in the fields of education research and whole school improvement, researchers at the Comprehensive School Reform Quality (CSRQ) Center created a framework for evaluating the scientific rigor of research studies that report on the efficacy of whole school improvement models. In this paper, the authors begin with a brief…

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…