Students in an introductory college course (n=275) responded to equivalent 20-item halves of a test under number-right and formula-scoring instructions. Formula scores of those who omitted items overaged about one point lower than their comparable (formula adjusted) scores on the test half administered under number-right instructions. In contrast,…

This paper reviews the research literature regarding the importance of Witkin's theory of psychological differentiation, particularly the research on measures of field independence using perceptual disembedding tasks. The first phase of development of a multiple-choice perceptual disembedding measure, the Finding Embedded Figures Test, is…

The Alberta Canada Social Studies examination for grade 12 contains 70 multiple choice questions and two essay questions. The multiple choice questions cover political ideologies, economics, world geography, world history, and current events. The questions are often related to political cartoons, charts, maps or a series of quotations reproduced…

Specific steps for applying the Angoff method are described. In the Angoff method, judges are asked to estimate the probabilities of minimally competent candidates' answering multiple choice test items correctly. Initial information must be obtained for designing the standard-setting process, beginning with the purpose of the examination and any…

In this practical, easy-to-use guide, suggestions are made for setting educational objectives and preparing a teacher-made test. Specific suggestions are made for selecting items for essay tests, multiple choice tests, completion tests, matching tests, and true-false tests. (BW)

The test scores of some examinees on a multiple-choice test may not provide adequate measures of their abilities. The goal of appropriateness measurement is to identify such individuals. Earlier theoretical and experimental work considered examinees answering all, or almost all, test items. This article reports research that extends…

A new item type was developed, incorporating features of "ill-structured" problems in a multiple-choice format. The problems are similar to previously developed scientific thinking tasks in requiring the examinee to go beyond the information provided; they resemble a variant of the logical reasoning item type, but demand somewhat more structuring…

A study examined the effect of verbal reporting of students' thinking on their performance during an examination. Subjects, 343 high school seniors, were randomly divided into 4 experimental groups, and a different procedure for eliciting students' thinking during a critical thinking test was used for each group. A control group took the same test…

This report describes a methodology for using verbal reports of thinking to develop and validate multiple-choice tests of critical thinking. These verbal reports of individuals' thinking on draft items of multiple-choice critical thinking tests can be used systematically to provide evidence of the thinking processes elicited by such tests, and in…

This test booklet contains 50 multiple choice items testing sixth grade social studies achievement. The test was administered by the Alberta (Canada) Department of Education in June 1985. The items concern early civilizations, Southeast Asia, and regulation by the government. Fifty minutes are allowed to complete this test. (GDC)

For over 50 years, the overwhelming weight of evidence has been that subjects are able to make use of partial information when responding to multiple-choice items. The subject chooses the alternative which has given rise to the lowest mismatch, except that if this minimum mismatch is larger than some threshold, the question is left unanswered.…

Traditional test scoring does not allow the examination of differences among subjects obtaining identical raw scores on the same test. A configuration scoring paradigm for identical raw scores, which provides for such comparisons, is developed and illustrated. (Author)

In defense of retaining the "latent trait theory" term, instead of replacing it with "item response theory" as some recent research would have it, the following objectives are outlined: (1) investigation of theory and method for estimating the operating characteristics of discrete item responses using a minimum number of…

As one in a series of test item collections developed by the Assessment and Evaluation Unit of the Directorate of Studies, items of value from past tests are made available to teachers for the construction of unit tests, term examinations or as a basis for class discussion. Each collection is reviewed for content validity and reliability. The test…