Discusses the problematic future of program evaluation, especially in the field of education, in the context of testing and politics and with regard to epistemology. Evaluators must learn to focus on the complex knowledge of program coping and merit, rather than merely tracking simplistic indicator variables. (SLD)

Explores the effects evidence-based practice and the guideline movement will have on evaluation in the future and discusses the impact on evaluation of three aspects of the current information revolution: (1) e-government; (2) new approaches to data access; and (3) real-time evaluation. Also considers the sources of evaluation innovation and the…

Responses from 573 of 3,000 business schools indicated that case studies were the most frequently used method to assess learning and are perceived to be effective. Group process observation and multiple-choice were less used and perceived as less effective. Faculty often use methods appropriate for grading but make less use of effective methods…

Examines the evaluation of teaching in entire programs, departments, and institutions. Discusses the varying levels of evaluation and their corresponding methodologies, asserting that these indicate the broadening context in which the evaluation of teaching is now taking place. (EV)

A modified Delphi process was used to survey program directors and medical residents to identify indicators of quality in internal medicine residency training. Items rated important by both groups included faculty characteristics such as stability, supervision, clinical skills, and teaching commitment; institutional support; and amount of resident…

Describes the conceptual design, research framework, evaluation components, and analytic strategies that are guiding the evaluation of a demonstration-research effort, the American Stop Smoking Intervention Study (ASSIST). The ASSIST evaluation is a unique analysis of the relationships among social context, public-health activity, tobacco use, and…

Explores some opportunities open to evaluators as practitioners of organizational development and the advantages and competencies evaluators can bring to such initiatives. Presents eight examples of such opportunities. (SLD)

Educational interventions based on the principles of behavior analysis are highly effective for establishing skills in young children with autism. As a first step in program development, the child's current skill level is determined by evaluating performance on tasks drawn from a preestablished curriculum. However, few specific guidelines have…

Embarking on a high-stakes online testing program is a major enterprise that requires planning, teamwork, communication, flexibility and good problem-solving skills. It is important to be aware of the issues that one may confront and what hurdles might have to be overcome to be successful in the job. The Virginia Department of Education…

Many of us have an intuitive understanding of physics that works surprisingly well to guide everyday action, but we would not attempt to send a rocket to the moon with it. Unfortunately, the authors argue, our policy makers are not as cautious when it comes to basing our school accountability system on intuitive test theory. Intuitive physics…

In this study, 18 teachers and 32 of their students who had reading difficulties were randomly assigned to one of two assessment conditions. In the functional assessment condition, consultants identified functional relationships among environmental events and targeted reading behaviors to develop an intervention plan. In the empiric condition,…

Values inquiry refers to systematic investigation of the values relevant to a program, including understanding those outcomes most prized by stakeholders. Although much attention has been given to stakeholder involvement, the literature on value inquiries per se as an approach is limited. This paper demonstrates how several of the steps used in…

This article introduces the assessment and deployment contexts of the Networking Performance Skill System (NetPASS) project and the articles in this section that report on findings from this endeavor. First, the educational context of the Cisco Networking Academy Program is described. Second, the basic outline of Evidence Centered Design is…

Functional analysis methodology is an assessment strategy that identifies sources of reinforcement that maintain problem behavior and prescribes individualized interventions that directly alter the conditions under which behavior occurs. In this article we describe the environmental determinants of problem behavior, methods for conducting…

This article describes the incorporation of humanistic strategies and interactive activities for counselor educators who teach counseling courses in assessment or appraisal. This information helps demonstrate the utility of practical humanistic knowledge and skills for this important Council for Accreditation of Counseling and Related Educational…