This study critically examines the biases and methodological shortcomings in studies comparing deaf and hearing populations, demonstrating their implications for both the reliability and ethics of research in deaf education. Upon reviewing the 20 most-cited deaf-hearing comparison studies, we identified recurring fallacies such as the presumption…

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

Evidence of comparability is generally needed whenever there are variations in the conditions of an assessment administration, including variations introduced by the administration of an assessment on multiple digital devices (e.g., tablet, laptop, desktop). This article is meant to provide a comprehensive examination of issues relevant to the…

The International Test Commission's "Guidelines for Translating and Adapting Tests" (2010) provide important guidance on developing and evaluating tests for use across languages. These guidelines are widely applauded, but the degree to which they are followed in practice is unknown. The objective of this study was to perform a…

The performance of disabled and non-disabled students on college admissions test were compared. Performance of learning disabled and hearing impaired students appears most discrepant from the norm. Evidence relating to validity and reliability of admissions tests for handicapped and nondisabled examinees suggests no dependable differences in…

Research on assessing the cultural fairness of individual test items is reviewed, with emphasis on Birnbaum's three-parameter logistic model. As defined in this review, differential item characteristics are exhibited when examinees from one group have a lower probability of answering correctly than do examinees of equal ability from another group.…

Determines the accuracy of teacher judgment of the oral proficiency of pupils in French and Spanish high school classes. Results indicate that (1) teachers consistently overrate pupil performance and (2) the letter grade of the student in the foreign language class severely biases the accuracy of the teacher's judgment regardless of actual oral…

The efficacy of use of the Raven Progressive Matrices Test (RPM) in the selection of gifted children from traditionally underrepresented groups was investigated in a large-scale study with a diverse population. A total of 16,985 subjects were given the Raven Progressive Matrices Test. These included 22.7 percent Latinos, 37 percent Whites, 14…

This pair of studies investigated the psychometric adequacy of the Wechsler Intelligence Scale for Children - Revised (WISC-R) with a population of 8,396 potentially gifted elementary children of diverse ethnic and cultural backgrounds as well as diverse emotional and social environments. Study I showed subjects' profiles differed strikingly from…