The precision of item parameter estimates can be increased by taking advantage of dependencies between the latent proficiency variable and auxiliary examinee variables such as age, courses taken, and years of schooling. Score gains roughly equivalent to two to six additional item responses can be expected in typical educational and psychological…

In this paper 45 item-writing rules for multiple-choice tests presented in textbooks on educational measurement in a previous study are identified. The current study presents a quantitative review of the literature with respect to the empirical and theoretical evaluation of these principles of item-writing. Fifty-six studies that addressed at…

The item difficulty and item discrimination of three multiple-choice item formats were compared in experimental and non-experimental settings. In the experimental study, 104 graduate students were randomly assigned to complete one of three forms of a multiple-choice test: (1) a complex alternative ("none of the above") as the correct answer; (2) a…

The use of new extension of standard Item Response Theory (IRT) modeling of dichotomous items to include external variables is proposed. External variables may appear both as categorical grouping variables and as continuous variables; this requires the formulation of a model for the relationships between the external variables and the response…

This paper reports the results of a behavioral anchoring analysis of the Iowa Tests of Basic Skills (Form G, Level 12) vocabulary (41 items) and reading comprehension (56 items) tests. Subjects were 82 sixth-grade students enrolled at the Carterville (Illinois) Grade School. More specifically, a curriculum-referenced interpretation of the ability…

Reasons for administering tests fall into two categories--decision-making and promoting learning. The two bases of tests are learning objectives and the level of learning at which training is developed. Test development involves a number of steps. The best way to tie objectives to test items is through the use of a table of specifications, which…

Despite the popularity of both multiple-choice (MC) and true-false (TF) items, most investigations comparing the two formats have done so to determine the optimum number of choices to be given to students within a given time period. The purpose of this investigation was to compare the reliabilities and the validities of both formats when the items…

An empirical item characteristic curve shows the probability of a correct response as a function of the student's total test score. These curves can be estimated from large-scale pretest data. They enable test developers to select items that discriminate well in the score region where decisions are made. A similar set of curves can be used to…

This initial study phase deals with the accuracy of the information provided by students on the newly revised Student Descriptive Questionnaire (SDQ). The SDQ, an optional part of the College Board's Admissions Testing Program, is intended to supplement the information base to improve the quality of decisions made by college admissions personnel,…

An item format incorporating pattern recognition was designed to assess medical students' abilities in the area of clinical diagnosis. A group of approximately 20 faculty members of five New England medical schools met in Worcester for half of a day to develop pattern recognition items. Teams of four to six physicians were assigned to work on…

This preliminary investigation explored a means of maximizing the use of standardized test results. In addition to the usual package of alpha and ranked norm-referenced test reports, a special series of reports by the California Test Bureau/McGraw-Hill was generated for remedial reading and mathematics teachers. These reports displayed primarily…

In order to evaluate our methods and approaches of estimating the operating characteristics of discrete item responses, it is necessary to try other comparable methods on similar sets of data. LOGIST 5 was taken up for this reason, and was tried upon the hypothetical test items, which follow the normal ogive model and were used frequently in…

The progress of modern mental test theory depends very much on the techniques of maximum likelihood estimation, and many popular applications make use of likelihoods induced by logistic item response models. While, in reality, item responses are nonreplicate within a single examinee and the logistic models are only ideal, practitioners make…

A detailed description of five latent structure models of achievement measurement is presented. The first project paper, by David L. McArthur, analyzes the history of mental testing to show how conventional item analysis procedures were developed, and how dissatisfaction with them has led to fragmentation. The range of distinct conceptual and…

On well-constructed multiple-choice tests, the most serious threat to measurement is not variation in item discrimination, but the guessing behavior that may be adopted by some students. Ways of ameliorating the effects of guessing are discussed, especially for problems in latent trait models. A new item response model, including an item parameter…