The paper examines the benefits claimed for action learning at individual, organisational and inter-organisational levels. It goes on to identify both generic difficulties in evaluating development programmes and action learning specifically. The distinction between formative and summative evaluation is considered and a summative evaluation…

The value of a program can be understood as referring not only to outcomes, but also to how those outcomes compare to the types and amounts of resources expended to produce the outcomes. Major potential mistakes and biases in assessing the worth of resources consumed, as well as the value of outcomes produced, are explored. Most of these occur…

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

As a result of the federal No Child Left Behind Act (NCLB) of 2002, the field of education has seen a heavy emphasis on the use of "scientifically based research" for designing and testing the effectiveness of new and existing educational programs. According to NCLB, when addressing basic cause and effect questions scientifically based…

Although the need for evaluation of prevention programs is clear, the implementation of evaluation, particularly for large, complex projects with multiple investigators, poses numerous challenges. Program evaluators in these circumstances do not have the same degree of control as, say, experimental psychologists and must find ways to obtain data…

The evaluator's roles--change agent, manager, resource person, interpreter, and liaison between the project and the funding agency--are described, concerning the evaluation of innovative projects in education. Difficulties in obtaining desired commitments (i.e., a project's financial commitments and its positive attitude toward the evaluation…

This chapter addresses the problems encountered in the formative evaluation of instructional development projects and the instructional development process. Three types of formative evaluation--component, convergent, and contextual--are distinguished, and the consequences of using the wrong type of evaluation in a particular situation or project…

Rather than automatically presuming explicit conditions exist when designing an evaluation to fit the summative or formative mold, evaluators should think of an evaluation design as fitting between endpoints on an evaluation process continuum. Evaluators can blend techniques from both the formative and summative evaluation, matching actual program…

The chapters in this book address four major concerns in the field of curriculum evaluation. The first chapter focuses on the formative evaluation of educational programs, concentrating on the link between program development and formative evaluation. The second chapter--"Evaluating Curriculum Implementation"--presents a classification scheme for…

Events that brought independent evaluators together to address common problems and issues in the area of Acquired Immune Deficiency Syndrome (AIDS) education are described, focusing on development and accomplishments of the collaboration. The foundation stemmed from the funding agency's insistence that each program identify an evaluator. (SLD)

Some special problems associated with evaluating intelligent computer-assisted instruction (ICAI) programs are addressed. This paper intends to describe alternative approaches to the assessment and improvement of such applications and to provide examples of efforts undertaken and shortfalls. Issues discussed stem chiefly from the technical demands…

The general decline in public resources has encouraged government agencies to consolidate job functions, and the internal program evaluator is becoming a scarce commodity. This paper briefly describes a case study about the circumstances and implications of merging two formally antagonistic job roles: program administrator and program evaluator.…

The problems and accomplishments of a program to evaluate the Writing Across the Curriculum (WAC) program at Walsh College in Canton (Ohio) are described. The college-wide writing program began in 1987 with training workshops for faculty. Stage 1 of the program ended in 1988 with a summative evaluation and the development of a handbook to be used…