The role of data analysis in the jobs of instructional leaders has become as commonplace as teachers creating lesson plans and taking roll in the classroom. Teachers and building leaders routinely use interim assessment data to develop thoughtful and robust instructional plans that address identified areas of student need. The link between the…

In recent years, interest has spiked in data-driven decision making in education--that is, using various types of student data to inform decisions in schools and classrooms. In October 2008, the Council of the Great City Schools and American Institutes for Research (AIR) launched a project funded by The Bill & Melinda Gates Foundation that focused…

School districts across the country have adopted interim and benchmark assessments in response to NCLB pressures to raise student achievement, despite the lack of a research base. Thus, it is especially important that well-conceived, empirical studies of the effects of such programs be carried out. Various theoretical frames can help understand…

Utilization should be defined according to the evaluation approach used and the purposes established for it. By developing a matrix that includes the dimensions of utilization and the various evaluation approaches, it is possible to plan and conduct evaluations that increase the likelihood of the desired type of utilization. (Author/LC)

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)

Four forms of evaluation are outlined: (1) evaluation and development; (2) design evaluation; (3) process evaluation; and (4) summative evaluation. Each form is understood through five dimensions (orientation, state, focus, timing, and approach), which are illustrated through evaluation of a community services training program in Australia. (SLD)

This reaction piece briefly reviews the findings from the Bober and Bartlett study of training evaluation use in corporate universities. It then focuses on the importance of context in understanding and facilitating evaluation use. The author suggests an alternative interpretation of particular findings based on a deeper consideration of the…

This article describes the background and rationale for the Convening Process, created and evaluated by the U.S. Department of Education staff, and its relation to other efforts to increase the use of research and evaluation information. (Author/LMO)

The evaluator's role in planning/implementing an evaluation of a new program to train school administrators in performance appraisal skills is described. This case study of the evaluators' broadening roles uses E. Chelimsky's continuum (1987) to analyze political processes and decision making involved in the evaluation of a state-funded program.…

An approach for involving beneficiaries in specifying program attributes for evaluators to address is discussed. Methods are outlined for sharing influence among program decision makers and beneficiaries. Application of this approach in the evaluation of a problem-based medical school curriculum is described, with evidence on the enhancement of…

Few research studies have examined the use of student ratings of instructors from the standpoint of their ability to be interpreted and their subsequent usefulness. This study examined the effects of a training session conducted by experts in the field of student ratings of instruction. The first question was to determine the knowledge, skills,…

This study analyzes the ways in which school boards assess and utilize evaluation data and their attitudes toward testing. Interviews with 27 school board members from 10 districts indicate that board members tend to rely on informal working knowledge over formal information, and on district administrators' judgments. Findings suggest that simple…

This paper presents a discussion of several factors which influence evaluation utilization. Its purpose is to propose to Alkin's utilization framework the addition of one factor: multiplexity of data gathering methods. Two distinct discussions comprise this paper. First, supportive arguments for the assumption that this factor substantially…

This paper is concerned with defining evaluation as a domain in instructional technology, and with specifying the sub-areas of the domain. In education, evaluation is the process of determining the adequacy of instruction. It begins with problem analysis, which refers to determining the nature of the solution and the parameters of the problem. A…