Language anxiety was continuously reported to greatly influence learner's progress in mastering the target language. This study reports a survey investigating the level of language anxiety among non-English major students living in rural area along with its perceived causes. Based on the finding it further discussed some alternatives to alleviate students' language anxiety. The participants were 114 non-English major students studying in State Islamic College of Teungku Dirundeng Meulaboh, West Aceh. Data were collected employing FLCAS from Horwitz, Horwitz, and Cope, (1986). The average mean score of FLCAS from all the participants were 102.7, exceeding the medium score. It indicated that the students in general exhibited a fairly high level of language anxiety. In regard of gender, the female group appeared to be more anxious than their male counterpart. The biggest cause of language anxiety was attributed to fear of negative evaluation with the highest average mean 3.5 followed by communication apprehension and test anxiety in the second and third rank with the average mean 3,3 and 3.1 respectively. On another hand, English classroom items were perceived to contribute the least to the students' anxiety experience given the average mean 2.7. Taking account on the finding, some alternatives were discussed.