We provide evidence of validity for a newly developed diagnostic competence model of operation sense, by both (a) describing the theoretically substantiated development of the competence model in close association with its use within a large-scale formative assessment and (b) providing empirical evidence for the theoretically described cognitive…

Purpose: The purpose of this investigation was to develop an instrument that has scores that are valid and reliable for measuring students' attitudes toward fitness testing. Method: The method involved the following steps: (a) an elicitation study, (b) item development, (c) a pilot study, and (d) a validation study. The pilot study included 427…

The attribute hierarchy method (AHM) is a psychometric procedure for classifying examinees' test item responses into a set of structured attribute patterns associated with different components from a cognitive model of task performance. Results from an AHM analysis yield information on examinees' cognitive strengths and weaknesses. Hence, the AHM…

We determined the recommendations for preparing and scoring constructed-response (CR) test items in 25 sources (textbooks and chapters) on educational and psychological measurement. The project was similar to Haladyna's (2004) analysis for multiple-choice items. We identified 12 recommendations for preparing CR items given by multiple sources,…

The purpose of this study was to demonstrate how cognitive and measurement principles can be integrated to create an essentially unidimensional test. Two studies were conducted. In Study 1, test questions were created by using the feature integration theory of attention to develop a cognitive model of performance and then manipulating complexity…

Five types of multiple-choice items that can be used to assess higher-order educational objectives are examined. The item types do not exhaust the possibilities, but they are standard forms found helpful in writing items to measure more than recognitive memory. (Author/CM)

The special case of the Piagetian model is discussed in relation to test theory. Problems connected with the construction and analysis of a test based on Piaget and Inhelder's The Child's Construction of Quantities are presented, and related to a method of representing the item discrimination which is consonant with Piagetian theory. Loevinger and…

It is important that teachers test not only knowledge, but also comprehension, application, synthesis, and evaluation. Several suggestions for test items in physical education are presented. (CJ)

This study encompassed the collection of teacher reported (N=326) testing practices and the direct assessment of teacher-made tests (N=175) for item cognitive functioning levels and construction errors. Focus was on assessing the nature and quality of teacher-made tests used in public school classrooms and describing the classroom teachers'…

Constructed-response formats are desired for measuring complex and dynamic response processes that require the examinee to understand the structures of problems and micro-level cognitive tasks. These micro-level tasks and their organized structures are usually unobservable. This study shows that elementary graph theory is useful for organizing…

Examines traditional psychometric approaches to measuring intelligence and recent work by cognitive psychologists to develop a rationale for a non-verbal reasoning test for 10- to 11-year-olds. Recent studies providing basis for analyzing structure of test items are outlined, and benefits of analyzing items at a sub-type level are discussed.…

This module, one in a series of 127 performance-based teacher education learning packages focusing upon specific professional competencies of vocational teachers, deals with assessing student performance. Addressed in the individual learning experiences are the following topics: understanding the considerations involved in assessing student…

The goal of test item writing is to create measures of the true achievement dimensions desired, not extraneous abilities or related skills. To encourage university instructors to apply newer test item writing technologies to test construction for course examinations, this paper: (1) sets forth basic principles for quality item writing; (2) reviews…

Educators are now focusing on the improvement of reasoning skills. A key to success in improving such skills will be the ability of the individual teacher to measure skills in a valid and reliable manner. This guide will help teachers acquire the needed assessment skills. Major topics include measuring thinking skills, learning to plan an…

This document accompanies the Conceptual Learning and Development Assessment Series III: Tree, a test constructed to chart the conceptual development of individuals. As a technical manual, it contains information on the rationale, development, standardization, and reliability of the test, as well as essential information and statistical data for…