We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

The purpose of this study was to evaluate the adequacy of three cognitive models, one developed by content experts and two generated from student verbal reports for explaining examinee performance on a grade 3 diagnostic mathematics test. For this study, the items were developed to directly measure the attributes in the cognitive model. The…

It is important that teachers test not only knowledge, but also comprehension, application, synthesis, and evaluation. Several suggestions for test items in physical education are presented. (CJ)

In this study 6,942 items from two standardized achievement test batteries--the Stanford (Early School Achievement Battery, Achievement Battery, and Test of Academic Skills) and the Comprehensive Test of Basic Skills--were analyzed. Focus was on determining: (1) the extent to which these test batteries included general cognitive operations (GCOs)…

The complex and multi-faceted nature of the cognitive process of reasoning is discussed. The factor-analytic history of the isolation and definition of the three most important currently recognized reasoning factors (general reasoning, induction, and logical or deductive reasoning) is traced through the psychometric literature, and the…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

Simple arithmetic word problems are often featured in elementary school education. One type of problem, "compare with unknown reference set," ranks among the most difficult to solve. Differences in item difficulty for compare problems with unknown reference set are observed depending on the direction of the relational statement (more than vs. less…

Examines traditional psychometric approaches to measuring intelligence and recent work by cognitive psychologists to develop a rationale for a non-verbal reasoning test for 10- to 11-year-olds. Recent studies providing basis for analyzing structure of test items are outlined, and benefits of analyzing items at a sub-type level are discussed.…

This study explored the relationship between traditional item difficulty and cognitive complexity as measured by response time. Rural students (n=43) responded to computer-based tests of the Individualized Study by Technology General Mathematics Course developed by Alaska's Department of Education. Results indicated that mean response times were…

Educators are now focusing on the improvement of reasoning skills. A key to success in improving such skills will be the ability of the individual teacher to measure skills in a valid and reliable manner. This guide will help teachers acquire the needed assessment skills. Major topics include measuring thinking skills, learning to plan an…

This document accompanies the Conceptual Learning and Development Assessment Series III: Tree, a test constructed to chart the conceptual development of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and statistical data for…

This document accompanies the Conceptual Learning and Development Assessment Series IV: Noun, a test constructed to chart the conceptual development of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and statistical data for…

This document accompanies the Conceptual Learning and Development Assessment Series I: Equilateral Triangle, a test constructed to chart the conceptual developemnt of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and…

This document accompanies Conceptual Learning and Development Assessment Series II: Cutting Tool, a test constructed to chart the conceptual development of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and statistical data…