Researchers have long supported the use of dictation as a test for language learners (Fountain & Nation, 2000), and dictation has been used as a test for learners of English as a foreign language (EFL). With the advantages of productive learning and reinforcing short-term memory, dictation is a commonly used technique to develop language skills, and it can be considered to be an assessment of foreign language learning (Kazazoglu, 2013). However, the previous research has not fully explored how technology, such as text-to-speech (TTS), can be used in EFL classrooms. To address this issue, the researcher explored the use of traditional teacher-led dictation (TLD) and TTS dictation to compare the vocabulary performance of EFL learners. Forty-two college students participated in the study. The results indicated a significant difference between TTS and TLD on the participants' vocabulary performance. Additionally, there was a correlation between the scores with TTS and TLD: the students who performed better with TLD also obtained higher grades with TTS. Based on the results, future studies and pedagogical suggestions are presented.