The arrangement of response options in multiple-choice (MC) items, especially the location of the most attractive distractor, is considered critical in constructing high-quality MC items. In the current study, a sample of 496 undergraduate students taking an educational assessment course was given three test forms consisting of the same items but…

Andersen (1995, 2002) proves a theorem relating variances of parameter estimates from samples and subsamples and shows its use as an adjunct to standard statistical analyses. The authors show an application where the theorem is central to the hypothesis tested, namely, whether random guessing to multiple choice items affects their estimates in the…

We report on the development of an item test bank and associated instruments based on the National Research Council (NRC) K-8 life sciences content standards. Utilizing hundreds of studies in the science education research literature on student misconceptions, we constructed 476 unique multiple-choice items that measure the degree to which test…

This paper discusses the development and use of "item shells" in constructing multiple-choice tests. An item shell is a "hollow" item that contains the syntactic structure and context of an item without specific content. Item shells are empirically developed from successfully used items selected from an existing item pool. Use…

The "Test Development Notebook" is a resource designed for the preparation of tests of literal comprehension for students in grades 1 through 12. This volume contains 120 multiple-choice cloze exercises taken from front page stories, feature stories, and editorials of newspapers; and the accompanying answer key. Each exercise carries the code…

The "Test Development Notebook" is a resource designed for the preparation of tests of literal comprehension for students in grades 1 through 12. This volume contains 120 multiple-choice cloze exercises taken from news magazines, and the accompanying answer key. Each exercise carries the code letter of the section to which it belongs.…

The test items in this booklet are sample life skill items representative of those found in the California Adult Student Assessment System (CASAS) Item Bank. The items are arranged in four sections--A, B, C, and D-- from easy to difficult. A four-digit coding system is used to define each item. The first digit represents the content area: consumer…

Analyses of student responses to Introductory Psychology test questions were discussed. The publisher supplied a two thousand item test bank on computer tape. Instructors selected questions for fifteen item tests. The test questions were labeled by the publisher as factual or conceptual. The semester course used a mastery learning format in which…

An item analysis study was conducted for two multiple-choice tests of introductory psychology created from a publisher's test bank. A 47-item multiple-choice test was administered to 247 students, and 433 students took a different 42-item multiple-choice test. Participants were from a large northeastern suburban community college. The difficulty…

This study compared the item difficulty and item discrimination of three multiple choice item formats. The multiple choice formats studied were: a complex alternative (none of the above) as the correct answer; a complex alternative as a foil, and the one-correct answer format. One hundred four graduate students were randomly assigned to complete…

A 1992 study by R. Gershon found discrepancies when comparing the theoretical Rasch item characteristic curve with the average empirical curve for 1,304 vocabulary items administered to 7,711 students. When person-item mismatches were deleted (for any person-item interaction where the ability of the person was much higher or much lower than the…

The "Test Development Notebook" is a resource designed for the preparation of tests of literal comprehension for students in grades 1 through 12. This volume contains 100 multiple-choice cloze exercises taken from test instructions, instructional magazines, encyclopedias, reference books, and children's magazines; and the accompanying answer key.…

The "Test Development Notebook" is a resource designed for the preparation of tests of literal comprehension for students in grades 1 through 12. This volume contains 100 multiple-choice cloze exercises taken from consumer magazines, catalogs, instructions, advertisements, and contracts; and the accompanying answer key. Each exercise…

The development of the emerging technology of item writing was motivated in part by the desire to reduce potential subjectivity and bias between different item writers who attempt to construct parallel achievement tests. The present study contrasts four test forms constructed by the combined efforts of six item writers using four methods of item…

Two frequently cited guidelines for writing multiple choice test item stems are: (1) the stem can be written in either a question or statement-to-be-completed format; and (2) only positively worded stems should be used. These guidelines were evaluated in a survey of the test item banks of 13 nationally administered examinations in the physician…