Data comparison problems are used in teaching and science education research that focuses on students' ability to compare datasets and their conceptual understanding of measurement uncertainties. However, the evaluation of students' decisions in these problems can pose a problem: e.g., students making a correct decision for the wrong reasons.…

The long-term goal of the State Systemic Improvement Plan (SSIP) and other federal and state early intervention and early childhood education initiatives is improved child and family outcomes. States play a critical role in supporting practitioners in the use of evidence-based practices to improve child and family outcomes. When practitioners…

When President Obama took office in 2009, his administration quickly seized on teacher evaluations as an important public-policy problem. Today, much of his legacy on K-12 education rests on efforts to revamp evaluations in the hopes of improving teaching across the country, which his administration pursued via a series of incentives for states.…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

In recent years, researchers and practitioners in the behavioral sciences have profited from a growing literature on delay discounting. The purpose of this article is to provide readers with a brief tutorial on how to use Microsoft Office Excel 2010 and Excel for Mac 2011 to analyze discounting data to yield parameters for both the hyperbolic…

While measurement precision is relatively easy to establish for single tests and assessments, it is much more difficult to determine for decision making with multiple tests on different subjects. This latter is the situation in the system of final examinations for secondary education in the Netherlands and is used as an example in this paper. This…

In the last two and half decades, much has been learned about conceptualizing and developing measures for use by practitioners designed to inform their intervention decision making, such as when a child would benefit from receiving additional instructional support (universal screening) and whether the child is responding positively to the…

Available designs and instruments for evaluation are not adequate to meet the varied needs of evaluation. Therefore, evaluation needs to be reshaped in terms of 1) consideration of how and where currently available theories, designs, and instruments are proving useful, 2) identification of needs that cannot be met ith currently available…

This paper discusses the principles of an effective faculty evaluation system that are repeatedly recommended in the literature. These principles include the following: (1) clarify institutional goals; (2) decide on the purposes of the data to be collected; (3) use pilot programs when appropriate; (4) significantly involve participants in the…

Evaluation is data gathering, analysis, and interpretation that leads to decisions about practices and goals. Relatively simple analytical techniques can suffice for many evaluation purposes. Evaluation of inservice education may be viewed as an operating system where input is provided, processes are implemented, and products are generated. When…

In this paper, problems with testing as a method of educational evaluation are discussed and suggestions are made to schools with respect to strategies for more effective evaluation procedures. Various evaluation processes, their uses, and their limitations, are described. (WI)

This reply to William A. Mehrens argues that although some psychometricians are reluctant to endorse the use of test data for educational decision making, it is desirable that measurement specialists provide decision makers with practical, understandable ways to use test data. (JAZ)

Using the Derbyshire Project as an example, describes the adaptation for use in public libraries of Benefit Assessment and System Change (BASYC), which was developed as a decision-support framework coordinating subjective and objective factors that influence management decisions to change policies or systems. Three data tables are included.…

This article shows how microcomputer software can help in overcoming key methological problems in program/policy evaluation by: (1) paired comparisons; (2) sensitivity analysis to deal with missing information; (3) allocation percentages to deal with multiple alternatives; (4) sub-optimizing to deal with conflicting constraints; and (5) decision…

This report submitted by Advocate Team No. 2 to the U.S. Office of Education, Division of Research and Development Resources (formerly Division of Manpower and Institutions) presents a proposed evaluation system for regional labs and R&D centers consisting of a two-tiered panel organization. The tiers are: (1) A Master Panel--a blue-ribbon…