Using data strategically to guide decisions and actions can have a positive effect on education practices and processes. This facilitation guide shows education data teams how to move beyond simply reporting data to applying data to direct strategic action. Using guiding questions, suggested activities, and activity forms, this guide provides…

This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience,…

Coburn and Turner (this issue) present an intriguing framework for understanding how data has come to be used in the current high accountability environments in education. In this framework, they connect various processes of data use within organizational and political contexts. Data use is presented using an ecological perspective that deepens…

Since its inception, the National Center for Education Statistics (NCES) has been committed to the practice of documenting its statistical methods for its customers and of seeking to avoid misinterpretation of its published data. The reason for this policy is to assure customers that proper statistical standards and techniques have been observed,…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

This article reports on a formative and internal evaluation of teacher induction practices for newly hired teachers in a US university ESL program. By adopting a utilization-focused approach, evaluators produced a design that was articulated to the information needs of the evaluation users. The ensuing findings were then used to develop and…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

This report discusses the most relevant issues concerning using student test results in OECD countries. Initially the report provides an overview of how student test results are reported in OECD countries and how stakeholders in these countries use and perceive of the results. The report then reviews the literature relating to using student test…

"Evaluation Theory, Models, and Applications" is designed for evaluators and students who need to develop a commanding knowledge of the evaluation field: its history, theory and standards, models and approaches, procedures, and inclusion of personnel as well as program evaluation. This important book shows how to choose from a growing…

Examines the similarities and differences between social accounting and more traditional types of evaluation as well as identifying the strengths and weaknesses of each. Presents a framework of "comprehensive evaluation" that considers program theory, input costs, research design, and outputs. (SLD)

This handbook presents current explanations of how each survey program of the National Center for Education Statistics (NCES) obtains and prepared the data it publishes. The handbook aims to provide users of NCES data with the most current information necessary to evaluate the suitability of the statistics for their needs, with a focus on the…

One of the goals of the Strategies and Models for Improved Learning through Effective Data Use (SMILE) project was to develop a data-capacity survey (DCS) to measure a schools capacity to use data. In this study, a DCS was developed and field tested. The DCS, which was field tested at six Milwaukee Public Schools (Wisconsin), was a pen-and-paper…

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)