Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

The impetus for this paper stems from a concern about directions and progress in the measurement of the Technological Pedagogical Content Knowledge (TPACK) framework for effective technology integration. In this paper, we develop the rationale for using a seven-criterion lens, based upon contemporary validity theory, for critiquing empirical…

Purpose: The main aim of this paper is to develop guidelines on the critical issues to consider in research design in an action research (AR) environment for SME network capability development. Design/methodology/approach: The issues in research design for AR studies are developed from the authors' experience in running learning sets but, in…

This paper, commissioned by [National Postsecondary Education Cooperative] NPEC--Sample Surveys, considers issues important to any effort in which the [National Center for Education Statistics] NCES chose to engage the higher education community in a deliberative process that explores the development of data on student learning through a…

Evaluations that combine social science and law have tremendous potential to illuminate the effects of governmental policies and yield insights into how effectively policy makers' efforts achieve their aims. This potential is infrequently achieved, however, because such interdisciplinary research contains often overlooked substantive and…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

In recent years, the interest grew in research on measuring the "quality of life" (QOL) in cities. This interest comes from the success QOL measurement achieved in understanding communities' needs, tracking changes in different aspects of life and assessing the most desired types of future development among citizens. This research…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Measurement of change is essential for documenting the effects of social programs, for refining social-educational programs, and for guiding policy decisions about resource allocation. (CJ)

This document answers the question, "What has been learned about evaluation methodology from the decade of compensatory education"? Ten issues dealing with the evaluation of Title I were identified within a general theoretical framework of evaluation. For each issue it was the aim of this document to do the following: 1)to clarify the…

Every public university is engaged now in serious and ongoing accountability appraisal with significant time and resources dedicated to the task. The academy's commitment to accountability is real. Focusing on accountability for undergraduate education, one of several important functions of public universities satisfies a need, but it should not…

One of a series of instructional booklets designed to introduce adult education program planners to the basic concepts integral to and alternative strategies for conducting needs assessments, this instructional booklet deals with determining what information to collect when conducting a needs assessment. Described first is the relationship of the…

As resources become more constrained in the library community, many organizations are finding that they need to have a better understanding of their costs. To this end, this article will present one approach to conducting a cost analysis (including questions to ask yourself, project team makeup, organizational support, and data organization). We…