Mathematically speaking, a "difference" is the result of a subtraction. However, when the number domain is extended from natural numbers to integers, the separation of the magnitude of a number from its value creates "different differences," where the connection to subtraction is no longer straightforward. Based on video-recorded lessons and individual student interviews with 21 students in a Swedish year 8 class, a conceptual metaphor analysis of the discourse shows how ambiguous the term "difference" can be and how an implicit use of metaphors can create confusion in relation to addition and subtraction with integers. [For the complete volume, "Exploring the Integer Addition and Subtraction Landscape: Perspectives on Integer Thinking. Research in Mathematics Education," see ED612853.]