Research on the potential effects of different item arrangement schemes on item statistics is reviewed for three separate periods. Earliest studies investigated the simple main effect of item order on test performance. The late 1960s emphasized interactions between item order and examinees' characteristics. Current concern focuses on item…

Discusses features of a microcomputer program, SCOREIT, used at New Orleans' Loyola University and several high schools to score and analyze test results. Benefits and dimensions of the program's automated test and item analysis are outlined, and several examples illustrating test and item analyses by SCOREIT are presented. (MBR)

Description of an objective method for assigning weights to questions on examinations includes discussions of classical test theory, knowledge organization, and how task analysis can be used to identify knowledge elements required to solve specific problems, rank them, and assign objective weights to exam questions using a Pareto distribution (7…

Discusses criticism leveled at intelligence tests, including cultural and ethnic bias, charges related to content validity, and the ongoing debate of the relative influence of heredity and environment. Many popular attacks are misguided. (RM)

Describes development of a test using slides and corresponding multiple-choice questions for second-year occupational therapy students in child studies course. Reasons for choosing the test format are discussed and an outline of test construction procedures is given. An evaluation of the test indicates problems encountered and benefits gained.…

PLANA is a training program for subject matter analysis and construction of instructional objectives. This investigation tries to find out whether education students in the PLANA program differ from other students on planning instruction processes. (BW)

The Regression Model, popular in selection bias research, is proposed for use in item bias detection, providing a common framework for both types of bias. An empirical test of this new method, now called the Regression Bias method, and a comparison with other commonly used item bias detection methods are presented. (Author/BS)

Examined the pattern of verbal subscale scores on the Wechsler Adult Intelligence Scale and Wechsler Intelligence Scale for Children-Revised given to college students (N=129) and elementary students (N=383). Results showed a triangle pattern (Comprehension scores higher than both Vocabulary and Information) that begins to appear at the…

Research support for providing a read-aloud accommodation (i.e., having an individual read test items and directions aloud) to students with disabilities has been somewhat limited, particularly when merely examining effects of the accommodation on overall test scores for general groups of students with disabilities. The authors examined data on…

The sample assessment items in this volume are sorted according to the strands of number and operations, algebra, geometry, measurement, and data analysis and probability. Because one goal of assessment is to determine students' abilities to communicate mathematically, the writing team suggests ways to extend or modify multiple-choice and…

The primary purpose of this study was to identify potential sources of gender differential item bias (DIF) in a high school exit examination composed of both selected-response and constructed-response items in the content areas of English, social studies, mathematics, and biology. A secondary purpose was to determine the agreement between the…

This research sought to examine the link between different situational demands, in this case three different types of science achievement tests (multiple-choice, constructed response, and performance assessments), and perceptions, beliefs, and performance of 491 high school students. The students were characterized by three well-established…

Because NAEP estimates of state-level achievement play an important role in the evaluation of strategies for improving the nation's educational system, it is important that these estimates have as small a standard error as possible. NAEP estimates for state-level achievement are based on measurement of the performance of a random sample of…

The ability to recognize equivalent algebraic expressions quickly and confidently is important for doing mathematics in an intelligent partnership with computer algebra. It is also a key aspect of algebraic expectation, the algebraic skill that parallels numeric estimation. The progress in this ability of 50 students learning mathematics with CAS…

This paper describes major concepts related to item analysis for criterion-referenced tests including validity, reliability, item difficulty, and item discrimination, particularly in relation to criterion-referenced tests. The paper discussed how these concepts can be used to revise and improve items and listed suggestions regarding general…