This chapter presents the findings from a review of the practice of evaluation in federal agencies as an attempt to inform policies on method choice. The author explores whether federal agencies differ in their approaches to evaluation design and the factors that influence these differences. The nature of the programs, agency culture, evaluator…

Extension and evaluation share some similar challenges, including working with diverse stakeholders, parallel processes for focusing priorities, meeting common standards of excellence, and adapting to globalization, new technologies, and changing times. Evaluations of extension programs have helped clarify how change occurs, especially the…

In 1996, United Way of America (UWA) developed and began disseminating the most widely used approach to program outcome measurement in the nonprofit sector. Today an estimated 450 local United Ways encourage approximately 19,000 local agencies they fund to measure outcomes. The authors first describe and then assess the strengths and limitations…

Three literacy teacher-educators chart the ways in which portfolio assessment impacted their program. They discuss the tension between the demands of national accreditation standards and faculty belief systems in more ecological approaches. They describe the processes of change that occurred programmatically and individually which continue to…

This paper presents the methods and the main results of the 6 studies which were conducted in order to test the validity of the comprehensive model of educational effectiveness. The synthesis of these studies reveals that some support to the model has been provided. It is also demonstrated that 2 characteristics of the comprehensive model…

Achieving the Dream colleges engage in a process of institutional improvement to increase student success. A central component of this process is engaging internal and external stakeholders to help develop and implement interventions or changes in programs and services that improve student success. To determine whether these interventions do…

John Carroll University (JCU) is a Jesuit Catholic institution located in University Heights, approximately 10 miles east of Cleveland, Ohio. Founded in 1888, the university has a population of 3,400 undergraduates and 800 graduate students. The Division of Student Affairs at JCU comprises 11 units. The mission of the division is the same as that…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

This pilot study describes elementary teachers' use of collaborative inquiry as a strategy for assessing Response to Instruction and Intervention (RtI [superscript 2]) in reading for an English Learner student. The design of the study was based on the sociocultural theory that assessment practices shape teachers' understanding of students and of…

The purpose of this study was to develop a model for evaluating a professional development school program to enact an evidence-based model for a continuous cycle of program improvement. Guided by the logic model for program evaluation, we developed three survey instruments based on the professional development school standards of the National…

In an effort to generate a bottom-up approach for the program-wide implementation of electronic portfolios, this article first reports on the ways in which teacher candidates perceived the benefits and setbacks of this experience, after an initial course. Second, this article reports on whether and how the teacher candidates continued to develop…

Most K-12 evaluations are designed to make inferences about how a program implemented at the classroom or school level affects student learning outcomes and such inferences inherently involve hierarchical data structure. One methodological challenge for evaluators is linking program implementation factors typically measured at the classroom or…

The paper presents an evaluation design for measuring the effectiveness of special education programs for handicapped preschoolers. Reasons for not selecting traditional evaluation designs are noted, and the use of a "change-index" is supported instead. A value-added analysis was selected to determine the value added by the program beyond that…

A study was conducted to clarify issues and problems involved in the assessment of the effectiveness of military training and to evaluate and recommend objective procedures for determining the effectiveness of Navy training. The study results are reported in two volumes. This volume reviews current military training evaluation programs. Evaluation…