Free-response (FR) item formats, such as essay questions, are popular in educational assessment. The criticisms against FR items are that they are more expensive to score, take up more testing time, provide less content coverage, and are less reliable than multiple-choice (MC) items. For these reasons, FR items are often combined with MC items.…

The traditional indicator of test speededness, missing responses, clearly indicates a lack of time to respond (thereby indicating the speededness of the test), but it is inadequate for evaluating speededness in a multiple-choice test scored as number correct, and it underestimates test speededness. Conventional item response theory (IRT) parameter…

A study was conducted to determine to what extent college teacher-made multiple-choice tests contain test-wiseness clues that can be used to identify correct answers. A sample of 43 undergraduate teacher-made examinations was obtained from two colleges and three universities. The sample included midterm and final examinations and quizzes. The…

The technique of nonmetric multidimensional scaling (MDS) was applied to real item response data obtained from a multiple-choice achievement test of unknown dimensionality. The goal was to classify the 50 items into the various subtests from which they were drawn originally, the latter being unknown to the investigator. Issues addressed in the…

Describes a study of the validity of a multiple-choice test intended to pinpoint the manner in which a concept is misunderstood. (BR)

Following a discussion of the pros and cons of multiple choice tests, concludes that they are a valid means of determining literary knowledge. (RB)

This document reviews studies that investigated certain inadequacies of English as a Second Language (ESL) reading comprehension tests. The first study examined whether three ESL reading comprehension tests required information principally from the text or from background knowledge. Results indicated that background knowledge differentially…

This study applied one-parameter latent trait measurement theory to investigate the measurement characteristics of both forms of a multiple-choice measure of field-independence--the Finding Embedded Figures Test (FEFT). The FEFT has a multiple-choice format that may facilitate administration and scoring in comparison with use of supply-format…

A study was undertaken to develop a checklist of desirable characteristics of mail questionnaires. The checklist was to reflect some degree of consensus among experts in survey research and to be used as a general guide by novice questionnaire designers. A second objective was to take a first step toward development of an objective measure of…

Do choice-type tests (multiple-choice, true-false, etc.) measure the same abilities or traits as free response (essay, recall, completion, etc.) tests? A large number of studies conducted with several different methodologies and spanning a long period of time have addressed this question. In this review, attention will be focused almost…

This study attempted to determine if the differentiated achievement results for high questioning and low questioning instructional that emerged in a previous study would be replicated if student involvement were extended, as manifested in an increase in the number of student responses solicited. (Author/RK)

The purpose of the present study was to investigate the effects on various aspects of test performance of the information about the relative merits of guessing in relation to such characteristics as sex and intellectual or achievement level of the individual. (Author)

Describes the test item analysis used in test construction. (JR)