There is steadily accumulating evidence of the misuse or overuse of ratings data, but this does not invalidate their usefulness. The research literature has been concerned almost exclusively with the construction of ratings instruments. There has been little systematic study about creating evaluation systems that truly respond to the needs of…

What users of student ratings of instruction know about ratings and what they need to know to make valid and reliable use of ratings data were studied. An item bank of 153 multiple-choice items was developed from sources of information about student ratings. The full item bank had five subsets: (1) knowledge of ratings concepts; (2) knowledge of…