This report makes recommendations for the development of middle-school assessment in mathematics, based on a synthesis of scientific findings in cognitive psychology and mathematics education. The focus is on background research, rather than test specifications or example tasks. Readers interested in early development and pilot efforts associated…

Cognitive task analysis grew out of efforts by cognitive psychologists to understand problem-solving in a lab setting. It has proved a useful tool for describing expert performance in complex problem solving domains. This review considers two general models of cognitive task analysis and examines the procedures and results of analyses in three…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

This document provides specific examples of what is involved in applying intellectual criteria and standards to students' reasoning, focusing on elements of reasoning (EORs). The significance of reasoning having elements and the need for standards in assessing reasoning are described. The following are the EORs: (1) purpose, goal, or end in view…

This paper discusses systemic problems with testing and outlines two scenarios for reformulating testing based on intelligent tutoring systems. Five desiderata are provided to underpin the type of testing proposed: (1) tests should emphasize learning and thinking; (2) tests should require generation as well as selection; (3) tests should be…

This paper describes the development, implementation, and effects of new approaches to cognitive assessment within an undergraduate engineering course at the U.S. Air Force Academy. The course, ENGR 110, "Introduction to Engineering," was designed to be a problem-based learning environment in which cadets worked in teams to solve…

This paper discusses how concepts and procedural skills in problem-solving tasks, as well as affects and emotions, can be subjected to meaningful measurement (MM), based on a multisource model of learning and a constructivist information-processing theory of knowing. MM refers to the quantitative measurement of conceptual and procedural knowledge…

Issues in the development of assessments of higher order thinking skills for college graduates are discussed in the order in which they were presented when this series of papers was commissioned. With regard to Issue 1, it is generally agreed that the development of these skills is a desirable goal, but there is little consensus on how they should…

This document provides a model for the national assessment of higher order thinking and consists of a preface and four main sections. The preface discusses the problem of lower order learning, summarizes the state of research into critical thinking and instructional reform, and explains the structure of the paper. Section 1 of the paper describes…

Discusses two methods for developing and assessing fluid abilities. In the first method, students are asked to solve increasingly unfamiliar problems in a domain; and in the second, students are required to organize knowledge in new ways or view it from different perspectives. (SLD)

Goal five of the National Education Goals of America 2000 calls for dramatic improvement in the educational attainment of the nation's adult population. Encompassed in the goal is a charge to increase the number of college graduates who can think critically, communicate effectively, and solve problems. This paper focuses on measures that can be…

College-level assessment efforts in New Jersey are described. For more than a dozen years, students in public colleges and universities in New Jersey have been assessed using a common statewide instrument, the New Jersey College Basic Skills Placement Test. This test assesses reading, writing, and mathematics skills of entering college students as…

Gender differences in level and pattern of cognitive abilities were examined in 49 learning-disabled college students. Females were stronger in visual-motor abilities and verbal conceptualization, whereas the males' highest abilities were nonverbal visual-spatial. Both groups showed weaknesses in memory for digits and factual knowledge and in…

For a national program assessing college graduates to succeed, it must be institutionalized at the majority of colleges and universities in the nation. The information generated must play a clear and key role in formulating state and institutional higher education policy, college matriculation standards, and degree-granting decisions. Such an…

Four presentations from the 1985 Annual Michigan School Testing Conference on "Assessing Higher Order Skills" are offered in this paper, and the chairman of the First General Session provides an introductory section. The papers individually and collectively address the problem of defining higher order thinking skills. A second major…