The aim of this study was to identify and classify the student's concept image and its influence on the reasoning of the problem-solving of the derivative. The research used a qualitative description approach and used eight research subjects. From the answers collected upon the given problems, we obtained several variations of students' concept images, thus it showed how students' concept image influenced the reasoning. In order to clarify and classify the characteristic of the obtained answers, we summarized there were three categories of the concept image of the derivative, namely symbolically related to a basic formula of the derivative of a function, limit of the ratio of difference value of the functions, and the properties of the derivative of the functions. Furthermore, our study suggested that each student's concept image affecting the reasoning of the derivative. In addition, we found some misperceptions in answering the problem and misconception in the use of the basic formula of the derivative of the functions among the students' answers.