This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience,…

Coburn and Turner (this issue) present an intriguing framework for understanding how data has come to be used in the current high accountability environments in education. In this framework, they connect various processes of data use within organizational and political contexts. Data use is presented using an ecological perspective that deepens…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

This article reports on a formative and internal evaluation of teacher induction practices for newly hired teachers in a US university ESL program. By adopting a utilization-focused approach, evaluators produced a design that was articulated to the information needs of the evaluation users. The ensuing findings were then used to develop and…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Examines the similarities and differences between social accounting and more traditional types of evaluation as well as identifying the strengths and weaknesses of each. Presents a framework of "comprehensive evaluation" that considers program theory, input costs, research design, and outputs. (SLD)

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

The concept of evaluation readiness complements other evaluation planning approaches. Its basic products are the formal program definition and the data inventory framework. Ways to improve timeliness, appropriateness, and use of evaluation are also discussed. (Author/GDC)

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)

Assesses the value of the Government Printing Office's 1983 "Biennial Survey" as a tool to support depository library planning and decision making. The survey data are evaluated in terms of reliability, validity, and utility, and recommendations are offered for improving the design, administration, and analysis of the survey. (CLB)

Aiming to encourage longitudinal studies in science education, we clarify conceptual and methodological aspects of longitudinal research. We use the studies that other articles in this issue describe to illustrate these aspects. The illustrations range from attempts to promote long-term change through experimental teaching to investigations that…

An evaluation system which would describe and assess statewide services for preschool children is described. Component theory conceptualizes the unit of analysis for evaluation as the component. This approach increases the generalizability and utilization of evaluations and enhances the ability to evaluate several programs at the state level.…

Lack of use of educational evaluation results in the Netherlands was investigated by analyzing 14 curriculum evaluation studies. Results indicated that rational decision making with a technical (empirical) evaluation approach makes utilization of results most likely. Incremental decision making and a conformative approach make utilization least…

The promise of the stakeholder approach to evaluation lies in its potential to counter criticism that evaluation is too narrow, unrealistic in its standards for success, unfair to program staff and participants, and irrelevant to decision makers. (Author)