The role of social media in the global society and economy has increased substantially over the years across different populations, age groups, and contexts. Using social media can be both beneficial and risky. People's ability to navigate it safely and effectively largely depends on their social media literacy skills, which has significant implications for individuals and society. Drawing on the critical literacy and affordances-in-practice frameworks, we explore the concept of critical social media literacy (CSML) through a systematic literature review to determine whether and how its components--users' goals, use context, inquiry, reflection, and action--have been addressed in the literature. Twenty out of the 50 publications identified reflected all the components of the CSML framework at different levels. We focused on empirical studies to identify instructional approaches and recommendations to support the development of CSML skills. Implications for research and practice, including curriculum connections, are also discussed.