This study revisits the roles of different aspects of phonological vocabulary knowledge in second language (L2) listening. Japanese learners of English (n = 114) completed the TOEIC Listening test and three phonological vocabulary tests assessing (a) ability to recognize the meanings of aural forms (meaning recognition), (b) ability to recall the meanings of aural forms (meaning recall), and (c) ability to spontaneously judge the appropriate use of word meanings in sentential contexts (lexicosemantic judgment task [LJT]). Among the three measures, the LJT best predicted the participants' ability to access the target words during real-life L2 listening comprehension of monologues and conversations (measured via TOEIC). Structural equation modeling demonstrated that the LJT was distinct from both meaning recognition and recall and revealed their different associations with listening comprehension scores. In line with the skill acquisition theory, we propose that the LJT reflects automatized knowledge, whereas meaning recognition and recall represent declarative knowledge.