A study investigated observable differences in results, not attributable to student competence, in administrations of the same 16-station clinical skills screening examination (Ontario International Medical Graduates Program) to approximately 200 foreign medical graduates and University of Toronto fourth-year medical students. Results indicated items functioned differently between test administrations, and differences were greater with longer times between administrations. (MSE)