Schools, districts, and state-level educational organizations are experiencing a great shift in the way they do the business of education. This shift focuses on accountability, specifically through the expectation of the effective utilization of evaluative-focused efforts to guide and support decisions about educational program implementation. In…

This paper proposes ten steps to make evaluations matter. The ten steps are a combination of the usual recommended practice such as developing program theory and implementing rigorous evaluation designs with a stronger focus on more unconventional steps including developing learning frameworks, exploring pathways of evaluation influence, and…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

The definition of a system of care (SOC) can guide those intending to develop and sustain SOCs. Hodges, Ferreira, Israel, and Mazza [Hodges, S., Ferreira, K., Israel, N., & Mazza, J. (in press). "Systems of care, featherless bipeds, and the measure of all things." "Evaluation and Program Planning"] have emphasized contexts in which services are…

For more than 20 years, the system of care philosophy has comprised a central strategy of service reform in children's mental health at the federal, state, tribal, and local levels. System of care terminology has become widely used in many different service sectors but often without a shared understanding of what a system of care is. This…

Recent reform efforts in the child welfare system have called for child welfare agencies to provide community-based services and to increase the involvement of external stakeholders in identifying and developing services within the community. At the same time, child welfare agencies are faced with the challenge of providing services to an…

My Environmental Education Evaluation Resource Assistant or "MEERA" is a web-site designed to support environmental educators' program evaluation activities. MEERA has several characteristics that set it apart from other self-directed learning evaluation resources. Readers are encouraged to explore the site and to reflect on the role that…

A framework of operating models for interdisciplinary research programs in clinical service organizations is presented, consisting of a "clinician-researcher" skill development model, a program evaluation model, a researcher-led knowledge generation model, and a knowledge conduit model. Together, these models comprise a tailored, collaborative…

There are many psychosocial interventions for children and adolescents. The effects of these interventions in day-to-day practice are nevertheless often unclear. Researchers typically take the randomized controlled trial (RCT) as the "gold standard" for the supply of evidence regarding the effectiveness of an intervention. However, such trials are…

Describes an evaluability assessment of the Georgia Research Alliance (GRA), a technology development program. Presents the steps involved in conducting an evaluability assessment, including development of an understanding of the program and its stakeholders. Analyzes and compares different methods by which the GRA could be evaluated. (SLD)

Describes key issues related to professional competence evaluation and maintenance and presents viable alternatives for enhancing the fidelity and adequacy of professional services. There is widespread recognition that regulatory bodies need to respond to demands for continuous review of the practitioners they have credentialed. (SLD)

Makes the case that the effectiveness of the use of information systems (IS) in an organization depends on an evolving understanding of the nature of IS value and that the speed of this organization is, in large part, a function of organizational and IS leadership. Analyzes the role of leadership and its relationship to the concept of absorptive…

Describes lessons evaluators can learn from the Honda Motor Company and how an evaluation office within the Department of Health and Human Services has applied these lessons. The lessons include (1) sound market research; (2) creating top-notch production capabilities; (3) building a better mousetrap; and (4) aggressive product selling. (SLD)

Activities during the initial 18-month cycle of the Demand and Resource Evaluation (DARE) Program of the Puget Sound Power and Light Company (Washington State) are described. The role of evaluation in public utility planning is discussed. Cooperation, communication, and consensus among utility planning staff are concluded to be vital. (SLD)

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…