This paper illustrates the application of existing guidelines to develop a test grounded in theoretical perspectives and empirical findings in the area of problem solving. By documenting this process, the paper outlines the challenges test developers face when seeking to construct a theory/research-driven test, discusses the decisions made at…

Two well-accepted ideas among educators are (a) performance assessment is an effective means of assessing higher-order thinking skills and (b) data-driven instruction planning is a valuable tool for optimizing student learning. This article describes a locally developed performance task (LDPT) designed to measure critical thinking, problem…

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate…

The purpose of this study is to evaluate, using a randomized experimental design, the efficacy of TERC's "Using Data" program to change teacher behavior and improve student learning outcomes. The "Using Data" intervention provides professional development and technical assistance to teachers to help them use data…

Within an RtI problem-solving context, assessment and decision making generally center around the tasks of problem identification, problem analysis, progress monitoring, and program evaluation. We use this framework to discuss the current state of the literature regarding curriculum based measurement, its technical properties, and its utility for…

This paper considers the setting of evaluation from the perspective of the situations and stages of problem solving in which institutional leaders might call for the assistance of evaluators. This discussion should provide evaluators with a framework to understand and adjust their interactions with the environmental context of the evaluation. R.…

Ten functions of program theory are reviewed: contributing to social science knowledge; assisting policymakers, discriminating between theory failure and program failure, identifying the problem and target group, providing program implementation description, uncovering unintended effects, specifying intervening variables, improving formative use…

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…

Tellado's evaluation of a problem-solving skills training program (TM 510 179) needs to be defined in terms of a client for the evaluation. It may also have implications for earlier intervention in problem-solving skills. Further research about the role of linguistic skills in developing problem-solving skills seems warranted. (Author/BW)

Two main themes are found in the previous critiques (TM 510 180, TM 510 181, and TM 510 182) of the Tellado evaluation (TM 510 179): that Tellado lacked a clear audience for his evaluation and that he lacked an appropriate change orientation. A major problem with utilization-focused and stakeholder-based approaches to evaluation is revealed.…

A comparative evaluation of two underground coal mines identified the reasons why one was the most productive and the other was the least productive mine operated by the company. The vested interests of contending groups provide a partial explanation. The problem-solving process evolving out of the evaluation is described. (SLD)

Three consumer groups--physicians, hospital administrators, and patients--that would benefit most from evaluation of health care are described. Problems each group has in understanding and supporting the use of evaluation in the delivery of health care services are discussed. Strategies to improve acceptance of evaluation are presented. (SLD)

A project to increase group decision making at a Wyoming secondary school is described in this practicum report. The intervention was designed to improve the group decision-making skills of members of the faculty advisory council and of department chairs. A skill development model based on training, practicing, monitoring, receiving feedback, and…

A utilization-focused approach in evaluating a problem-solving skills training program (see TM 510 179) would have placed more emphasis on identifying evaluation users, their information needs, and likely use of findings. Other methods options are also discussed, along with how to prepare decision makers for utilization. (Author/BW)

Discusses applications of the Problem Solving Inventory for counseling and managed health care, career and industrial/organizational issues, training, and academic performance. Examines the role of problem solving in psychological health and describes the inventory, how to administer it, and previous research findings. (RJM)