Cognitive diagnosis models (CDMs) have been studied as a means of providing detailed diagnostic information about the skills that have been mastered, and the skills that have not, by examinees. Prior research has examined the use of automated test assembly (ATA) alongside CDMs; however, no previous study has investigated how to perform ATA when a…

This study aimed to address the need for a comprehensive assessment tool to evaluate the mathematical abilities of first-grade students through cognitive diagnostic assessment (CDA). The primary challenge involved in this endeavor was to delineate the specific cognitive skills and sub-skills pertinent to first-grade mathematics (FG-M) and to…

Although much research has been conducted on the psychometric properties of cognitive diagnostic models, they are only recently being used in operational settings to provide results to examinees and other stakeholders. Using this newer class of models in practice comes with a fresh challenge for diagnostic assessment developers: effectively…

We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

The number of students engaged in Massive Open Online Courses (MOOCs) is increasing rapidly. Due to the autonomy of students in this type of education, students in MOOCs are required to regulate their learning to a greater extent than students in traditional, face-to-face education. However, there is no questionnaire available suited for this…

Marked gender differences in three-dimensional mental rotation have been broadly reported in the literature in the last few decades. Various theoretical models and accounts were used to explain the observed differences. Within the framework of linking item design features of mental rotation tasks to cognitive component processes associated with…

The purpose of this study was to demonstrate how cognitive and measurement principles can be integrated to create an essentially unidimensional test. Two studies were conducted. In Study 1, test questions were created by using the feature integration theory of attention to develop a cognitive model of performance and then manipulating complexity…

This paper discusses questions pertinent to a definition of cognitive structure as the knowledge one possesses and the manner in which it is arranged, and considers how to select or devise methods of describing cognitive structure. The main purpose in describing cognitive structure is to see whether differences in memory (or cognitive structure)…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

The renewed attention to assessments that attempt to capture complex aspects of educational attainments of students is explored. The definition and impetus for attention of the measurement community to higher order thinking skills are examined. Through a detailed description, a model assessment development process is presented. The process relies…

Conceptual foundations of a process for assessing higher-order thinking are reviewed, and a viable model for carrying out the process is presented. The first section of the paper formulates 21 criteria that should be met by any process adequate to the task. The second section outlines the basic concept of critical thinking on which the paper is…

Issues in the development of assessments of higher order thinking skills for college graduates are discussed in the order in which they were presented when this series of papers was commissioned. With regard to Issue 1, it is generally agreed that the development of these skills is a desirable goal, but there is little consensus on how they should…

Content and task dimensions of social studies items were studied using factor analytic techniques. These items were developed to measure concept attainment using a completely crossed design with 30 concepts and 12 tasks. Conventional factor analyses were performed, separately for boys and girls, for concept scores and for task scores. Three-mode…

The Model of Conceptual Learning and Development (CLD) is an analytical, descriptive model. It defines four levels of concept attainment and the possible uses and extensions of attained concepts, specifies the cognitive operations involved in learning concepts at each of the four levels, and postulates internal and external conditions of learning…