Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

Earlier this year, in "Subprime Learning: Early Education in America since the Great Recession," the current state of early education in the U.S. was surveyed by examining progress over the last five years . It was found that while the public, political, and research consensus is stronger than ever, the field remains in dire need of…

In their opening comments to this special issue on data use, Coburn and Turner point to "one of the most central questions in social theory: the interrelationship between macro-social structure and micro-level action." Questions about data use--which entail social phenomena that range from federal policy to moment-to-moment interactions…

Despite the growing volume of research on data use systems or data use activities in which teachers engage, micro-process studies--investigations of what teachers and others actually do under the broad banner of "data use" or "evidence-based decision making"--remain substantially underdeveloped. Starting with a review of the…

In the present study, an examination is conducted in three school districts of how data are used to improve classroom practice. In doing so, we explore the effects that attitudes toward data, principal leadership, and computer data systems have on how data are used to affect classroom practice. Findings indicate that educators are ambivalent about…

Six articles on the relationship between policy theory and the practice of policy evaluation are presented. Articles address basic theoretical issues, theories in practice, the epistemological foundations of decision technology, selection of policy analysis instrumentation, utilization of public policy analysis, and justifying policy arguments.…

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

Evaluators must use a flexible, open-minded approach oriented toward a holistic view of the implementation and operation of the program they are analyzing. The use of more than one methodology expands the potential findings and avoids the limitations of a unidimensional approach. (SLD)

Few examples exist on how to use survey data to inform public environmental education programs. I suggest a process for interpreting statewide survey data with the four questions that give insights into local context and make it possible to gain insight into potential target audiences and community priorities. The four questions are: What…

The five articles of this sourcebook, organized around the five-component framework for evaluation described by W. Shadish, T. Cook, and L. Leviton (1991), present a new theory of realist evaluation that captures the sensemaking contributions of postpositivism and the sensitivity to values from the constructivist traditions. (SLD)

Twelve articles discuss the advantages of theory-driven evaluation for: (1) identifying crucial issues; (2) integrating program implementation into evaluation; (3) diagnosing problems in program studies; (4) diagnosing problems in program structures; and (5) enhancing evaluation utilization. Topics include optimizing validity in program and…

Three major pragmatic issues in computerized testing are addressed: (1) encouraging teacher use; (2) reporting of information; and (3) test construction. Reference is made to four related articles. Additional areas for research include reporting of test information; item bank standards; validity; and rules for stopping in computerized testing.…

This piece was guided by the framing question "How can CEE [Conference on English Education] help its constituencies, the broader public, and policymakers understand the relationship between research and teaching?" The authors consider the usefulness of a range of empirical traditions; explore how expert language arts teachers read, conduct, and…

In program evaluation and policy analyses, utility supplants rigor as the first and most important criterion in judging literature reviews. Although R. T. Ogawa and B. Malen emphasize rigor, a utilization-focused evaluation emphasizes purpose and audience, both of which affect the conduct of a multivocal literature review. (SLD)

Based on experiences in working with school district staff, suggestions for enhancing evaluation use through stakeholder involvement are discussed in terms of who should be involved, when involvement should occur, and how stakeholders should be involved via a dialogue-dependent process. (SLD)