Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

While measurement precision is relatively easy to establish for single tests and assessments, it is much more difficult to determine for decision making with multiple tests on different subjects. This latter is the situation in the system of final examinations for secondary education in the Netherlands and is used as an example in this paper. This…

Available designs and instruments for evaluation are not adequate to meet the varied needs of evaluation. Therefore, evaluation needs to be reshaped in terms of 1) consideration of how and where currently available theories, designs, and instruments are proving useful, 2) identification of needs that cannot be met ith currently available…

This paper discusses the principles of an effective faculty evaluation system that are repeatedly recommended in the literature. These principles include the following: (1) clarify institutional goals; (2) decide on the purposes of the data to be collected; (3) use pilot programs when appropriate; (4) significantly involve participants in the…

Evaluation is data gathering, analysis, and interpretation that leads to decisions about practices and goals. Relatively simple analytical techniques can suffice for many evaluation purposes. Evaluation of inservice education may be viewed as an operating system where input is provided, processes are implemented, and products are generated. When…

In this paper, problems with testing as a method of educational evaluation are discussed and suggestions are made to schools with respect to strategies for more effective evaluation procedures. Various evaluation processes, their uses, and their limitations, are described. (WI)

Using the Derbyshire Project as an example, describes the adaptation for use in public libraries of Benefit Assessment and System Change (BASYC), which was developed as a decision-support framework coordinating subjective and objective factors that influence management decisions to change policies or systems. Three data tables are included.…

This report submitted by Advocate Team No. 2 to the U.S. Office of Education, Division of Research and Development Resources (formerly Division of Manpower and Institutions) presents a proposed evaluation system for regional labs and R&D centers consisting of a two-tiered panel organization. The tiers are: (1) A Master Panel--a blue-ribbon…

The ultimate goal of continuing education programs is to bring about improvement in health education. Evaluations of these programs rarely indicate significant change. Problems with evaluations and with continuing education programs are discussed. (JN)

This paper proposes an evaluation design for Mercer County, West Virginia's state funded early childhood education program, which was initiated to replace independent kindergarten programs. An introductory discussion lists the broad goals of the program, three data collection time schedules, program variables that define the model of the program,…

A number of issues related to the development of evaluation methodology are discussed. These issues are as follows: the definition of the purpose, general strategies for the development of methodology, and methodological research. The evaluation methodology developed is for the purpose of providing data for decision making. Some specific…

Based on Strasser and Deniston's guidelines (TM 504 251), the author discusses pre-planned and post-planned program evaluation decisions based on: (1) attitude of the organization being evaluated; (2) availability of resources; and (3) usefulness of the findings for programmatic decision making. (MH)

Current thinking and research on the nature of formative evaluation of replicable forms of instruction are summarized. Methodologies appropriate for other evaluation roles (e.g. summative) are shown to be often inappropriate for the formative role. This paper attempts to classify sources of information concerning the merit of educational materials…