In four experiments the behavioral consequences of an involuntary attentional distraction concerning memory performance was investigated. The working memory model of Cowan (1995) predicts a performance deficit for memory representations that are held in an active state when the focus of attention is distracted by a change in physical properties. In the first experiment, the distraction was realized by an irrelevant tone, which was repeatedly presented and exchanged by another tone unexpectedly. Further experiments explored an analogous effect of irrelevant visual-spatial stimuli. The experiments demonstrated a domain-specific distraction effect: an irrelevant tone change impaired performance in verbal but not in spatial serial recall, whereas a change of position of an irrelevant object disrupted spatial but not verbal memory performance. The results are discussed in the context of several memory models that offer accounts for the effect of irrelevant changing state sounds.