Presents a model for developing a strategy for training evaluation, according to the purpose of the evaluation or who is being evaluated. (MF)

Problems associated with current expertise in evaluation are discussed. Since evaluators are not always able to reliably achieve all levels of an evaluation project, these tasks are categorized into five levels of complexity. The author suggests a more accurate label for evaluators, "descriptive inquiry specialists," and includes guidelines for…

While technically accurate, the "Standards for Evaluation of Educational Programs, Projects and Materials" embodies unrealistic and untenable assumptions about policy, its implementation, its development, and the evaluator's role. Three educational evaluation studies in the United Kingdom and Pakistan are used to illustrate the author's…

Raters judged essays on two occasions making it possible to address the question of whether multiple ratings, however obtained, represent the same true scores. Multiple ratings of a given rater did represent the same true scores, but ratings of different raters did not. Reliability, validity, and invalidity coefficients were computed. (Author/DWH)

Three schools of moral thought are presented to illustrate differences in moral reasoning and the assignment of value claims. Several educational program alternatives are used as illustrations of moral reasoning within, and across, the schools of thought. (Author/DWH)

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)

An interview with the Illinois State director of research and evaluation, covers issues related to commissioning and using evaluators. Pancrazio's position is with the State Board of Education. Focus is on the preparation of research reports to facilitate decision making and policy making. (TJH)

Job-naive raters provided with job descriptive information made Position Analysis Questionnaire (PAQ) ratings which were validated against ratings of job analysts who were also job content experts. None of the reduced job descriptive information conditions enabled job-naive raters to obtain either acceptable levels of convergent validity with…

This paper focuses on evaluation-related behaviors of school principals. The role of principals as clients of professional evaluation is examined. Research that views principals as evaluators is reported. Concepts drawn from the literature are used to explore ways of studying the rationality that principals employ to make decisions. (Author/JAZ)

Although evaluation practice in Israel is strongly influenced by American thinking, it is also a unique local response to societal, political, academic, cultural, and interpersonal pressures. In this interview Arieh Lewy discusses educational evaluation in Israel and the cultural context in which it operates. (Author/BS)

An overview of educational evaluation literature is followed by summaries of research on both the perceptions of school principals about their awareness and use of evaluation in decision-making and their evaluation behavior. New lines of research on evaluation for decision-making as a learning process are offered. (MLF)

Suggests a four-step method for reconstructing evaluation offices originally established for federal funding programs so that they can provide information for local decision making: (1) review past work, (2) identify necessary projects, (3) establish joint priorities, and (4) develop action plan. (TE)

Two examples illustrate effective use of evaluation offices. The first, a centralized approach, involves goal setting, followed by measurement techniques and improvement based on data. The second, decentralized approach involves reduction of data to six profiles, which form the basis of planning. Similarities and differences are discussed. (TE)

On March 11 and 12, 2004, the United States Department of Education (ED) and the Character Education and Civic Engagement Technical Assistance Center (CETAC) hosted a meeting to discuss the challenges in evaluating the Partnerships in Character Education grant. The meeting goals were to: (1) Receive information regarding the implementation of…