The shortcomings of the conventional way of using and interpreting multiple-choice tests are summarized. Some theories and methodologies that can be applied for better use multiple-choice test items are described. Empirical facts are introduced to support the theoretical observations. New strategies are proposed that will reduce "noise"…

The purpose of this study was to compare empirical and subjective procedures for identifying science test items which discriminate against males or females in a fifth grade population (n=926). Techniques such as the Mantel-Haenszel procedure enable test developers to use both a priori and ex post facto procedures to identify specific items that…

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the reading selections portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, novel, and drama, the…

As part of an examination required by the Alberta (Canada) Department of Education in order for 12th grade students to receive a diploma in French, this booklet contains the 80 multiple choice questions portion of Part B, the language and literature component of the January 1987 tests. Representing the genres of poetry, short story, the novel, and…

This document provides an overview of the 1980 and 1981 Illinois Inventory of Educational Progress (IIEP) in mathematics. Development of the IIEP is discussed, and results and analyses of the tests administered to students in grades 4, 8, and 11 are presented. Test items are included. Factor analysis identified two factors, "knowledge of…

In 1975, a joint committee on physical fitness, composed of the Measurement and Evaluation, Physical Fitness, and Research Councils of the American Alliance for Health, Physical Education, Recreation and Dance (AAHPERD) studied its Youth Fitness Test to determine the need for revision. Study results called for: (1) alteration in traditional…

This report explores an approach to item development and psychometric modeling which explicitly incorporates knowledge about the mental models used by examinees in the solution of items into a psychometric model that characterize performances on a test, as well as incorporating that knowledge into the item development process. The paper focuses on…

This study examined agreement rates between identified strengths and weaknesses in shared abilities and influences on the Wechsler Intelligence Scale for Children-Revised (WISC-R) and the Kaufman Assessment Battery for Children (K-ABC). Sixty-seven students in the first through seventh grades referred for learning disabilities (LD) evaluation were…

The Texas Educational Assessment of Minimum Skills (TEAMS) test was administered to pupils in grade 1 for the first time, at state level, in April 1986. Students with certain disabilities and those with limited English proficiency were exempted from this testing cycle. This 84-item test measured 21 objectives: 8 for mathematics, 9 for reading, and…

These instructor materials for an aviation maintenance technology course contain five instructional modules. The modules cover the following topics: determining the relationship of voltage, current, resistance, and power in electrical circuits; computing and measuring capacitance and inductance; measuring voltage, current, resistance, and…

This paper presents an introduction to the use of latent trait models for the estimation of domain scores. It was shown that these models provided an advantage over classical test theory and binomial error models in that unbiased estimates of true domain scores could be obtained even when items were not randomly selected from a universe of items.…

Multidimensional item difficulty (MID) is proposed as a means of describing test items which measure more than one ability. With mathematical story problems, for instance, both mathematical and verbal skills are required to obtain a correct answer. The proposed measure of MID is based upon three general assumptions: (1) the probability of…

This report contains two tests designed to assess the level of technological literacy for a 12th-grade student in the United States in the 1980s. The tests are based on a literature review and on nine criteria for technological literacy that were established using the Delphi technique. This report contains a 27-item test, a list of works examined…

Specific questions addressed in this study include how time limits affect a test's construct and predictive validities, how time limits affect an examinee's time allocation and test performance, and whether the assumption about how examinees answer items is valid. Interactions involving an examinee's sex and age are studied. Two parallel forms of…

The work presented in this paper defined conceptually the concepts of multidimensional discrimination and information, derived mathematical expressions for the concepts for a particular multidimensional item response theory (IRT) model, and applied the concepts to actual test data. Multidimensional discrimination was defined as a function of the…