Whether specification of focal group membership based on ethnicity as well as educational opportunity affects differential item functioning (DIF) of test items was studied. Subjects were 4,342 freshmen admitted to a large midwestern university who completed the 40-item Advanced Mathematics Placement Examination in the spring of 1991. There were…

The importance of the presentation order of items on Likert-type scales was studied. It was proposed that subjects tend to choose the first alternative acceptable to them from among the response categories, so that a primacy effect can be predicted. The effects of reversing the order of the response scale on the latent factor structure underlying…

Test item selection techniques based on traditional item analysis methods were compared to techniques based on item response theory. The consistency of mastery classifications in criterion referenced reading tests was examined. Pretest and posttest data were available for 945 first and second grade students and for 1796 fourth to sixth grade…

A study of the effectiveness of teaching science to 2 classes of 15 and 20 ninth-graders, respectively, illustrates 5 aspects of educational evaluation: age factors in teachability, test unidimensionality, comparison of 2 classes of students regarding mean ability, objective difficulty of test items, and objective ability of individual students.…

Examinees in a regular administration of the quantitative portion of the Graduate Record Examination responded to particular items in a machine-scannable multiple-choice format. Volunteers (n=364) used a computer to answer open-ended counterparts of these items. Scores for both formats demonstrated similar correlational patterns. (SLD)

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

Figural response items (FRIs) in science were administered to 347 fourth graders, 365 eighth graders, and 322 twelfth graders. Item and test statistics from parallel FRIs and multiple-choice questions illustrate FRIs' more difficult and more discriminating nature. Relevance of guessing to FRIs and diagnostic value of the item type are highlighted.…

The impact of personalizing mathematical word problems and rewording them for explicitness was tested with 68 second and 59 fifth graders. Second graders benefited from personalization and rewording in combination; fifth graders benefited from personalization, not rewording. Personalization makes problems more motivating and easier to represent…

The performance of 254 Israeli twelfth graders on multiple-choice tests with positive or negative item stems was studied. For items requiring low cognitive reasoning, performance does not differ, but, for items requiring high cognitive reasoning, the negative mode is more difficult. Implications for test construction are discussed. (SLD)

The purpose of this study was to examine the nature and degree of differences in expert versus novice knowledge structures, both before and after training, when judging the similarity of multiple-choice test items within a statistics and test theory (STT) domain. Subjects were employees of the Testing Division of the New York State Department of…

Since 1971, nearly four million adults have qualified for a high school equivalency credential based on General Educational Development (GED) test results. During Spring 1980 two major studies were undertaken by the GED Testing Service: (1) the U.S. High School Norming Study involving the administration of the GED Tests to a representative sample…

A comparison is presented of alternate-choice and true-false item forms used in an undergraduate natural science course. The alternate-choice item is a modified two-choice multiple-choice item in which the two responses are included within the question stem. This study (1) compared the difficulty level, discrimination level, reliability, and…

The reliability of Mantel-Haenszel (MH) indexes across samples of examinees and sample sizes and their robustness to item context effects were investigated with data for 670 African-American and 5,015 white students from the Second International Mathematics Study. MH procedures can be used to detect differential item functioning. (SLD)

Evaluates the measurement equivalence of an English-language version of the Trier Personality Inventory, using statistical methods based on item response theory to identify items displaying differential item functioning (DIF). Results with 295 U.S. and 213 West German undergraduates and 203 U.S. college students indicate significant agreement in…

Writers of mathematics test items, especially those who write for standardized tests, are often advised to arrange the answer options in logical order, usually ascending or descending numerical order. In this study, 32 mathematics items were selected for inclusion in four experimental pretest units, each consisting of 16 items. Two versions…