The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

We introduce a specific type of item for knowledge tests, confidence-weighted true-false (CTF) items, and review experiences of its application in psychology courses. A CTF item is a statement about the learning content to which students respond whether the statement is true or false, and they rate their confidence level. Previous studies using…

Suggests methods for developing higher level objective test questions. Taxonomies that define learning outcomes are discussed; and examples for various test types are presented, including multiple correct answers; more complex forms, including classification and multiple true-false; relations and correlates; and interpretive exercises. (LRW)

Many textbooks in educational measurement and classroom assessment have chapters devoted to specific item formats. There may be attempts to relate one item format to another, but the chapters and item formats are largely seem as distinct entities with only loose and uncertain connections. This paper synthesizes these discussions. An item format…

A taxonomy of 43 rules for writing multiple-choice test items is presented, based on a consensus of 46 textbooks. These guidelines are presented as complete and authoritative, with solid consensus apparent for 33 of the rules. Four rules lack consensus, and 5 rules were cited fewer than 10 times. (SLD)

Recognition memory for sentences from a classroom lecture was tested as a function of lecture instructions, length of retention interval, and item type. With immediate testing, subjects differentiated original sentences from reworded and inferential statements similar in meaning. Only inferences were recognized as not having been presented after…

Two-option multiple-choice vocabulary test items are compared with comparably written true-false test items. Results from a study with 111 high school students suggest that multiple-choice items provide a significantly more reliable measure than the true-false format. (SLD)

Research on true-false (TF), multiple-choice, and alternate-choice (AC) tests is reviewed, discussing strengths, weaknesses, and the usefulness in classroom and large-scale testing of each. Recommendations are made for improving use of AC items to overcome some of the problems associated with TF items. (SLD)

The first of three sequels to the booklet "Student Assessment," this booklet begins by describing and providing examples of four different forms that objective questions can take: (1) conventional multiple choice questions; (2) true/false questions; (3) assertion/reason items; and (4) matching items. Guidance is offered on how to decide which type…

This report describes the design and field testing of a 50-item objective test designed to measure high school students' understanding of the state of Georgia's history, geography, government, econcomics, and culture. A copy of the test is included in the appendix. (AM)

The criterion-related validity evidence and other psychometric characteristics of multiple-choice and multiple true-false (MTF) items in medical specialty certification examinations were compared using results from 21,346 candidates. Advantages of MTF items and implications for test construction are discussed. (SLD)

Describes the modification of an already existing computer-assisted testing system at the University of Mississippi School of Health Related Professions to include test questions of the matching variety. (JJD)

This fastback concentrates on writing technically correct test items that are compatible with the teacher's instructional objectives. The introductory chapter touches on some of the problems associated with preparing classroom tests. The second chapter outlines five steps in preparing a test according to the "Plan-Write" System: (1) prepare a…

The Multi-Digit (MDT) testing procedure is a computer-scored testing innovation conceptualized in 1982. It is fully compatible with multiple choice and true/false tests well suited for the testing of discreet terms and concepts such as in fill-in-the-blank examinations. The student reads the question and selects the appropriate response from an…