Despite substantial evidence for the link between an individual's intelligence and successful life outcomes, questions about what defines intelligence have remained the focus of heated dispute. The most common approach to understanding intelligence has been to investigate what performance on tests of intellect is and is not associated with. This…

Computational thinking (CT) is a set of cognitive skills that every child should acquire. K-12 classrooms are expected to provide students opportunities (tasks) to think computationally. We introduce a CT competency assessment for middle school students. The assessment design process started by establishing a cognitive model of CT domain mastery,…

The Gain-Loss model is a probabilistic skill multimap model for assessing learning processes. In practical applications, more than one skill multimap could be plausible, while none corresponds to the true one. The article investigates whether constraining the error probabilities is a way of uncovering the best skill assignment among a number of…

The study challenged the current practices in cognitive load measurement involving complex problem solving by manipulating the presence of pictures in multiple rule-based problem-solving situations and examining the cognitive load resulting from both off-line and online measures associated with complex problem solving. Forty-eight participants…

According to dual-process accounts of thinking, belief-based responses on reasoning tasks are generated as default but can be intervened upon in favor of logical responding, given sufficient time, effort, or cognitive resource. In this article, we present the results of 5 experiments in which participants were instructed to evaluate the…

The purpose of this study is to apply the attribute hierarchy method (AHM) to a sample of SAT algebra items administered in March 2005. The AHM is a psychometric method for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. An…

The aims of this paper are to affirm the importance of developing sequential models of psychological process-particularly of such complex psychological phenomena of prime concern to theory and application as learning, problem solving, and creativity-and to argue that factor analysis has delineated component processes for these sequential models.…

Advances have been made in testing optometrists' clinical skills, particularly with the use of simulation techniques. Further research into these techniques will probably receive the most attention, although a shift in research emphasis from correlational studies of test validity and reliability to test development studies is needed. (MSE)

Three developments over the past 15 years--our understanding of cognition, new techniques in technical psychometrics, and the computer explosion--form the basis for a proposal for new intelligence tests. These developments are reviewed, and both leaps and steps in intellectual assessment are proposed. (Author/RD)

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

Recent theoretical developments in cognitive psychology imply both a need and a possibility for methodological development. In particular, the theory of problem solving proposed by Allen Newell and Herbert A. Simon (1972) provides the rationale for a new empirical method for the processing of think-aloud protocols--trace analysis. A detailed…

A historical review of educational literature concerning measurement of cognitive skills is provided, with reference to test construction. Focus is on assessing abilities beyond recall of information. In light of interest in assessing critical thinking in the California Assessment Program, it must be noted that concern with critical thinking is…

The construction of cognitive tests is largely based on a Thurstonian model of the structure of the intellect, with test content described in terms of loadings on broad constructs called factors. Knowledge of factorial content of a test does not necessarily correspond to knowledge of mental activities elicited by test performance. Modern cognitive…

The aim of this study was to investigate the strategies leading to test item responses in 60 young (20-25 years) and 60 middle-aged (35-40 years) adults, whose highest level of education had been either secondary, technical or university. Subjects were individually administered a 12 item test similar to Raven's Progressive Matrices, and were…

A pilot study on the development and administration of a test using a spatial reasoning problem, the 15-puzzle, is described. The test utilizes on-line capabilities of a real-time computer to record an examinee's progress on each problem through a sequence of problem-solving "moves", and to collect additional on-line data that might be…