With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

In this article, we critique two recent theoretical developments about collaborative inquiry in evaluation--using logic models as a means to understand theory, and efforts to compartmentalize versions of collaborative inquiry into discrete genres--as a basis for considering future direction for the field. We argue that collaborative inquiry in…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Over the past two decades, preparation of LIS professionals to conduct credible research has been both scrutinized and encouraged by a variety of scholars. The conclusion of these researchers has been that there is a paucity of courses and that opportunities for students to participate in authentic field research are few. There is a resulting need…

Regular evaluation of archival reference services is essential to ensure that users have appropriate access to the information they need. Archives New Zealand has been measuring customer satisfaction for many years using self-completion questionnaires but recently trialed two new methods of evaluation, using external research companies. One…

This article describes how to design program assessment for mathematics departments, in two-year and four-year colleges across the Midwest, based on a set of components that was generated from a Delphi survey. An example is provided to illustrate how this was done at a small four-year college. There is an alignment between these components and a…

Rapidly declining response rates and the associated threat of nonresponse bias call into question the validity of data obtained through telephone surveys, a tool often used in evaluation. This article explores changes in nonresponse bias over time by examining three data points (1991, 1996, and 2002) from an annual household telephone survey…

The findings from recent Canadian research indicate that while agency managers and front-line workers agree that evaluation is important, they seldom evaluate their work with clients. With the current emphasis on evidence-based practice and outcome-focused intervention, it is important to be able to demonstrate the value of career services in a…

With a focus on the use of technology when evaluating programs for Aboriginal people, this article explores the possibility of using visual and oral computer technology to enhance the incorporation of Aboriginal worldviews in program evaluation. The author situates Aboriginal worldviews, including methods of communication and transmission of…

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…

An invitation to explore innovative practices in program and system evaluation in a medium-sized school jurisdiction of approximately 11,000 students has resulted in a model with generative characteristics. This paper will describe the process, and several of the outcomes, when a generative evaluation approach is used to assess the effectiveness…

A mixed-method conceptual framework was developed from the literature and refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluation are identified (triangulation, complementarity, development, initiation, and expansion) and analyzed using the framework of 7 design characteristics. (TJH)

AN EVALUATION OF ADULT EDUCATION RESEARCH ON SPECIFIC FUNCTIONS CONDUCTED AT CERTAIN INSTITUTIONS WAS REPORTED. IDENTIFICATION AND ANALYSIS WERE CONDUCTED FOR OCCUPATIONAL, LIBERAL, RELATIONAL, AND LITERACY EDUCATION FUNCTIONS. RESEARCH PROCEDURES WERE (1) TO IDENTIFY, SELECT, AND OBTAIN RESEARCH STUDIES, (2) TO MAKE CRITICAL ANALYSES AND…

This article explores the utilization of qualitative methodologies in program evaluation, the rationale for using these approaches, and the potential qualitative applications within evaluation. It also describes the "scientific" and "artistic" qualitative methodologies, suggests practical qualitative application, and calls for…

Evaluators who perform formative evaluations would be well served to apprise themselves of recent survey research in framing formative evaluations. Illustrative examples are used from research into such diverse areas of activity as: the development of identities attached to different forms of modern rock and roll; the rationales that juvenile…