In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Test Theory and Likelihood Ratio Test method based on Item Response Theory). In this regard, on the data acquired from 1046…

Two of the standards contained in the third draft of the new Joint Technical Standards for Test Development and Revision are discussed: Standard 3.13, mandating the use of multicultural material and the avoidance of material offensive to any major ethnic, cultural, or gender group; and Standard 3.14, mandating research and subsequent test revision…

This presentation is a review of the literature on the assessment of standardized test scores in black colleges. Divergent points of view exist relative to the misuse and use of standardized test scores for the sole purpose of admission of black students. Some misuses of the American College Test (ACT) and Scholastic Aptitude Test (SAT) are noted,…

An historical overview is presented of criticisms arising during an early period of large-scale standardized testing in the United States: the post World War II period when the Educational Testing Service was established. Not only is a brief description of the controversy provided, but the fact that many problems of assessment are not transient…

This paper is an overview of some points made at the Annual Meeting of the American Educational Research Association in April of 1987. Gender effects were computed on 82 nationally standardized tests designed to determine precocity among youth. The effect sizes ranged from a magnitude of 0.50 (favoring females) for spelling in grade 12 on the…

The definition of differential item performance (DIP), often referred to as item bias, is discussed. DIP is suggested as a comprehensive term to encompass item bias (item invalidity which is unfair to certain population subgroups) and instructional bias (a valid reflection of group differences in instruction or background). This study investigated…

A new approach to assessing unexpected differential item performance (item bias or item fairness) is introduced and applied to the item responses of different subpopulations of Scholastic Aptitude Test (SAT) takers. The essential features of the standardization approach are described. The primary goal of the standardization approach is to control…

This report stems from the misunderstanding of what general standardized tests and standardized admission tests can and were designed to do, and an uneasiness with certain discoveries concerning biases in the tests. Important issues such as margin of error, predictive value, social and racial bias, and the effects of coaching are the very issues…

Certain conditions are investigated as to whether they are necessary or sufficient to indicate the fairness of a test, or predictor, in its role in the college admissions procedure. Eight general positions are considered that have claimed to provide sufficient conditions for the unbiasedness of a standardized test or predictor: (1) equal test…

This qualitative study focused on African American and Latino high school students perceptions of standardized admission tests, including the Scholastic Assessment Tests (I and II) and the ACT Assessment. Students enrolled in college preparatory classes were interviewed about these tests individually and in focus groups in fall 1998 in their…

The purpose of this study was to evaluate the use of log-linear models in detecting test item bias. The evaluation of the log-linear approach in this regard will focussed on the following: (1) the stability of the procedure across replications--the effect of sampling error across random samples of ethnic groups; (2) the amount of artifactual…

Many researchers have suggested that the cause of differential item functioning (DIF) can in part be due to the misspecification of the supporting trait distribution (STD). This paper demonstrates how a unidimensional item response theory (IRT) calibration of response data, generated from a two-dimensional IRT model, results in DIF when the…

At present, college entrance examinations unfortunately determine only those students who will achieve good grades at the university level, thus ignoring the individual and social needs of minority students by avoiding an estimation of their knowledge and ability to do the reading and writing necessary outside the university. Both the Scholastic…

Suggestions are provided for future research in item bias detection, reduction of essay-reader variation in setting cut-score levels, and limitations of equating theory. (TJH)

Medical College Admission Test (MCAT) score differences were examined for Black and White examinees who entered American medical schools in 1978 and 1979. The incidence of academic difficulty resulting in delayed graduation, withdrawal, or dismissal was also examined. The MCAT provides six scores: biology, chemistry, physics, science problems,…