The definition, nature, limitations, and strengths of multiple-choice test items are reviewed; and recommendations on the development and use of such items are presented. Many teacher-made multiple-choice tests can be significantly improved. Suggestions for layout organization and an interpretive approach to relationships among items on one test…

College undergraduates (n=38) were administered identical multiple choice tests with randomly presented answer-sheets numbered either vertically or horizontally. Of the originally-scheduled four tests during the semester, tests one and three were retested with entirely different test questions, also multiple choice, resulting in scores from tests,…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

In this paper 45 item-writing rules for multiple-choice tests presented in textbooks on educational measurement in a previous study are identified. The current study presents a quantitative review of the literature with respect to the empirical and theoretical evaluation of these principles of item-writing. Fifty-six studies that addressed at…

The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…

This paper reports a multi-method approach for examining the cognitive level of multiple-choice items used in a medical pathology course at a large midwestern medical school. Analysis of the standard item analysis data and think-out-loud reports of a sample of students completing a 66 item examination were used to test assumptions related to the…

A multiple choice achievement test was constructed in which both cognitive level and degree of abstractness were controlled. Subjects were 75 students from a major university in the Southwest. A group of 13 judges, also university students, classified the concepts for degree of abstractness. Results indicated that both cognitive level and degree…

A procedure which may be used to project the frequency distribution of one test onto that of another test is described and illustrated. The procedure is useful when a test developer wishes to construct an alternate form with preferred distributional characteristics. For example, the test developer may wish to construct a new test form with a…

The objective of this project was to develop a valid and reliable multiple choice test of six basic science process skills for students in grades 4 to 8 (ages 8 to 14 years). Seven criteria were outlined for the test: an emphasis on the six most widely used science process skills (observation, inference, prediction, measurement, communication, and…

This study compared student performance on language-usage test items presented in two different formats: as discrete sentences and as items embedded in passages. American College Testing (ACT) Program's Assessment experimental units were constructed that presented 40 items in the two different formats. Results suggest item presentation may not…

When test questions are not intended to measure language skills, it is important to know if language is an extraneous characteristic that affects item performance. This study investigates whether certain stylistic changes in the way items are presented affect item performance on examinations for a health profession. The subjects were medical…

Test scores were compared for two types of objective achievement tests--multiple choice tests and the recently developed Multi-Digit Test (MDT) procedure. MDT is an approximation of the fill-in-the-blank technique. Students select their answers from long lists of alphabetized terms, with each answer corresponding to a number from 001 to 999. The…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

Teacher-made mastery tests were administered in a classroom-sized sample to study their decision consistency. Decision-consistency of criterion-referenced tests is usually defined in terms of the proportion of examinees who are classified in the same way after two test administrations. Single-administration estimates of decision consistency were…