Two new indices to detect answer copying on a multiple-choice test, S(1) and S(2) (subscripts), are proposed. The S(1) index is similar to the K-index (P. Holland, 1996) and the K-overscore(2), (K2) index (L. Sotaridona and R. Meijer, in press), but the distribution of the number of matching incorrect answers of the source (examinee s) and the…

The effects of skewed theta distributions on indices of differential item functioning (DIF) were studied, comparing Mantel Haenszel (N. Mantel and W. Haenszel, 1959) and DFIT (N. S. Raju, W. J. van der Linden, and P. F. Fleer) (noncompensatory DIF). The significance of the study is that in educational and psychological data, the distributions one…

Item response theory models arose from the inherent limitations of classical test theory methods of test analysis. A brief description of those limitations and the corresponding enhancements provided by item response models is provided. Further, an examination of the popular Rasch one-parameter latent trait model is undertaken. Specific…

The purpose of this study was to determine the extent and magnitude of differential item functioning (DIF) between males and females in existing attitudinal data sets. The focus was on the approximate proportion of items that show statistically significant DIF in selected data sets concerning attitude scales, the magnitude of this DIF, and whether…

The types and frequency of markings students made on multiple choice tests were studied as an indication of students' metacognitive test-taking strategies. Also studied was whether instruction in test-taking strategies affected students' fluency and flexibility of strategy use as demonstrated through the marks they made on tests. Participants were…

This paper presents an application of the bookmark procedure to a test comprised of increasing text difficulty levels. The Test of English Proficiency for Adults (TEPA) was used for this study. Three forms of the TEPA were field tested in 1999 with approximately 1,000 non-native English speaking students enrolled in English-as-a-Second-Language…

The multistage alpha-stratified computerized adaptive testing (CAT) design advocated a new philosophy of pool management and item selection using low discriminating items first. It has been demonstrated through simulation studies to be effective both in reducing item overlap rate and enhancing pool utilization with certain pool types. Based on…

Several analyses of the construct validity of the fourth-grade, eighth-grade, and commencement-level English and Mathematics examinations of New York state were performed. The analyses present construct and differential construct elaboration both across tests and within tests. Results show strong relationships among different question types,…

As part of the test development process, this document provides the released mathematics items and student responses to some questions from the Michigan High School Proficiency Test (HSPT) in mathematics. This packet is designed for teachers and students who are interested in understanding how the open-ended items from the HSPT in Mathematics are…

This paper proposes an item selection algorithm that can be used to neutralize the effect of time limits in computer adaptive testing. The method is based on a statistical model for the response-time distributions of the test takers on the items in the pool that is updated each time a new item has been administered. Predictions from the model are…

A common practice in some certification fields (e.g., information technology) is to draw items from an item pool randomly and apply a common passing score, regardless of the items administered. Because these tests are commonly used, it is important to determine how accurate the pass/fail decisions are for such tests and whether fairly small,…

Judgmental standard setting methods, such as the W. H. Angoff (1971) method, use item performance estimates as the basis for determining the minimum passing score (MPS). Therefore, the accuracy of these item performance estimates is crucial to the validity of the resulting MPS. Recent researchers, (L. A. Shephard 1994; J. Impara, 1997) have called…

This study investigated whether equating accuracy improves with an anchor test that is more representative of its corresponding total test and whether such content effect depends on the particular equating method used. Scoring outcomes of a professional examination for a medical specialty were used. A total of 1,092 examinees took one form, and…

This paper provides both logical and empirical evidence to justify the use of an item mapping method for establishing passing scores for multiple-choice licensure and certification examinations. After describing the item-mapping standard setting process, the paper discusses the theoretical basis and rationale for this newly developed method and…

This study applied nonparametric bootstrapping to test null hypotheses for selected statistics (KR-20, difficulty, and discrimination) derived from a student-made test. The test, administered to 21 students enrolled in a graduate-level educational assessment class, contained 42 items, 33 of which were analyzed. Random permutations of the data…