Aspects that influences mathematics learning is widely studied and language factors have been identified as a key backer to difficulties in learning Mathematics. It is evidenced that not only cognitive factors but also affective factors have vital role in learning mathematics. Such affective beliefs sources from various aspects of mathematics teaching learning process. This study explored influence of linguistic challenges that students encounter while learning mathematics on their attitude towards mathematics learning. A descriptive survey in a sample of 200 students in 7th standard in Kozhikode and Malappuram districts of Kerala with a mathematical language test provided categories of language related difficulties in mathematics learning among Malayalam medium students. The test contained items on 21 areas of difficulties. Students rated their like towards Mathematics learning on a 3 point scale, which is later dichotomised for chi-square analyses. Analysis of association between Difficulties in components of mathematics language and Attitude towards mathematics learning revealed that difficulty in terms- Discipline specific terms, common terms, common terms with specific meaning and Morphology of mathematics terms influences students' attitude towards Mathematics learning. Difficulties related to Mathematical symbols also influences student's attitude towards mathematics whereas mathematical statements are influencing the same to a lesser extent. Giving attention to terminology, symbols and syntactic structures in mathematical statements whether in common or mathematical language should be part of mathematics teaching-learning. This will help to develop positive attitude towards mathematics learning among younger learners which is an important goal of mathematics instruction.