In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

This paper presents results of a study examining the relationship between the American Board of Surgery's In-Training Examination and its Qualifying Examination. 1982 Test scores on both examinations of 764 candidates in their fifth year of training as Chief Residents were analyzed. Descriptive statistics, correlations, and standard errors were…