Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

The authors tell about their heterogeneous 91 person research and evaluation unit at an operating foundation in St. Paul, Minnesota. They focus on evaluation for program improvement, one of several purposes of studies they work on. The three authors write from their different manager positions within the unit. Included are the context of the…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

The Center for the Study of Evaluation (CSE) developed a formative evaluation system for the National Diffusion Network (NDN). A national, federally funded organization, NDN disseminates innovative ideas to schools nationwide. A formative evaluation was designed as an ongoing low-cost series of activities to be carried out by NDN managers,…

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)

Describes the rationale, structure, and operation of a new evaluation procedure in which pro and con presentations are made to a hearing panel that recommends action on the question posed. Suggestions are made for further improvement and development of this new procedure. (Author)

Program theory can be used to improve programs and policies. This article describes a set of techniques for complicating and simplifying program theory, referred to as conceptual and action heuristics. Methods such as analyzing metaphors, clarifying concepts, mapping, component assessment, causal modeling, and decision analysis are discussed. (JAZ)

In fall 2003, the Head Start Bureau began implementing the Head Start National Reporting System (NRS) to systematically assess the early literacy, language and numeracy skills of all 4- and 5-year-olds enrolled in Head Start. In addition to child progression on a designated set of outcomes during the year preceding kindergarten, the data will…

This paper describes a system of built-in, or internal, evaluation used within the Botswana National Literacy Program (NLP). Launched in 1981 and targeted toward illiterate adults and youth aged 10 years and older, the program aims at eradicating illiteracy in Botswana by 1986. The built-in evaluation was implemented in 1983, using program…

This document is one of a series of reports which describe the experiences of six state agencies that are developing systems to affect the development and implementation of policy in the federal/state program for vocational rehabilitation. The state programs are developing model program evaluation/management information support units. This second…

A number of changes have been made in student assessment at the University of Montana School of Law, in an attempt to assess elements of student performance as well as knowledge level. Within the educational goal of blending legal theory and practical skills, practicing lawyers were surveyed about what a good lawyer should be able to do and should…

This study highlights the value of leveraging department resources in principal preparation program resources to achieve multiple teaching and program review goals. In this study, masters degree candidates participated in all aspects of the evaluation of the Department of Educational Administration and Counseling. As consumers they already had a…

There is concern that the nation's schools are not preparing students to excel in science, technology, engineering, and mathematics (STEM) fields. At both precollege and postsecondary levels, much effort is needed to create and implement powerful STEM curricula, prepare and support highly qualified teachers, deliver effective instruction, and give…