From Sensory to Long-Term Memory
Evidence from Auditory Memory Reactivation Studies
Abstract
Abstract. Everyday experience tells us that some types of auditory sensory information are retained for long periods of time. For example, we are able to recognize friends by their voice alone or identify the source of familiar noises even years after we last heard the sounds. It is thus somewhat surprising that the results of most studies of auditory sensory memory show that acoustic details, such as the pitch of a tone, fade from memory in ca. 10-15 s. One should, therefore, ask (1) what types of acoustic information can be retained for a longer term, (2) what circumstances allow or help the formation of durable memory records for acoustic details, and (3) how such memory records can be accessed. The present review discusses the results of experiments that used a model of auditory recognition, the auditory memory reactivation paradigm. Results obtained with this paradigm suggest that the brain stores features of individual sounds embedded within representations of acoustic regularities that have been detected for the sound patterns and sequences in which the sounds appeared. Thus, sounds closely linked with their auditory context are more likely to be remembered. The representations of acoustic regularities are automatically activated by matching sounds, enabling object recognition.
References
(1997). Perceptual magnet effect in the light of behavioral and psychophysiological data. Journal of the Acoustical Society of America, 101, 1090– 1106
(2000). Evidence for spatial tuning in informational masking using the probe-signal method. Journal of the Acoustical Society of America, 108, 1803– 1810
(2002). Stepping out of the spotlight: MMN attenuation as a function of distance from the attended location. NeuroReport, 13, 2209– 2212
(1968). Human memory: A proposed system and its control processes. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory (Vol. 2, pp. 89-195). New York: Academic Press.
(1986). Working memory. Oxford Psychology Series #11. Oxford: Clarendon Press.
(2000). The episodic buffer: a new component of working memory?. Trends in Cognitive Sciences, 4, 417– 423
(1986). Voice-specific information and the 20-second delayed suffix effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12, 509– 516
(1981). Structural and strategic factors in the stimulus suffix effect. Journal of Verbal Learning and Verbal Behavior, 20, 346– 357
(1999). Two-component theory of the suffix effect: Contrary findings. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 1452– 1475
(1990). Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge, MA: MIT Press.
(1958). Perception and communication. New York: Pergamon Press.
(2001). Effects of attention and unilateral neglect on auditory stream segregation. Journal of Experimental Psychology: Human Perception and Performance, 27, 115– 127
(1984). On short and long auditory stores. Psychological Bulletin, 96, 341– 370
(1988). Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. Psychological Bulletin, 104, 163– 191
(1995). Attention and memory. An integrated framework. Oxford: Oxford University Press.
(1999). An embedded-processes model of working memory. In A. Miyake & P. Shah (eds.), Models of Working Memory: Mechanisms of active maintenance and executive control (pp. 62-101). Cambridge, UK: Cambridge University Press.
(2000). Persistence of memory for ignored lists of digits: Areas of developmental constancy and change. Journal of Experimental Child Psychology, 76, 151– 172
(2002). Deconfounding serial recall. Journal of Memory and Language, 46, 153– 177
(1997). The role of absolute and relative amounts of time in forgetting within immediate memory: The case of tone pitch comparisons. Psychonomic Bulletin & Review, 4, 393– 397
(2001). The ravages of absolute and relative amounts of time on memory. In H. L. Roediger III, J. S. Nairne, I. Neath, & A. Surprenant (eds.), The nature of remembering: Essays in honor of Robert G. Crowder (pp. 315-330). Washington, DC: American Psychological Association.
(1993). Short- and long-term prerequisites of the mismatch negativity in the auditory event-related potential (ERP). Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 909– 921
(1974). The effect of speaker’s voice on word recognition. Quarterly Journal of Experimental Psychology, 26, 274– 284
(1989). Imagery for musical timbre. Journal of Experimental Psychology: Human Perception and Performance, 15, 472– 478
(1969). Precategorical acoustic storage. Perception & Psychophysics, 5, 365– 373
(1975). The organization of short-term memory for a single acoustic attribute. In D. Deutsch & J. A. Deutsch (eds.), Short-term memory (pp. 107-151). New York: Academic Press.
(1973). Rhythmic groups and subjective chunks in memory for melodies. Perception & Psychophysics, 14, 37– 40
(1969). Intensity perception: I. Preliminary theory of intensity resolution. Journal of the Acoustical Society of America, 46, 372– 383
(1985). Modality-specific grouping effects in short-term memory. Journal of Memory and Language, 24, 200– 209
(1971). A model of the mechanisms for speech perception - quantitative analysis of categorical effects in discrimination. Annual Report of the Engineering Research Institute of the Faculty of Engineering, University of Tokyo, 30, 59– 68
(2001). The effect of perceptual grouping on the mismatch negativity. Psychophysiology, 38, 316– 324
(2003). Modality effects. In J. H. Byrne, H. Eichenbaum, H. Roediger III, & R. F. Thompson (eds.), Learning and Memory (2nd edition) (pp. 397-400). New York: Macmillan.
(1984). A retrieval account of the long-term modality effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 10, 16– 31
(1992). Attentional influence on the P50 component of the auditory event-related brain potential. International Journal of Psychophysiology, 12, 197– 209
(1995). Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe. Electroencephalography & Clinical Neurophysiology, 94, 191– 220
(2001). Simultaneously active pre-attentive representations of local and global rules for sound sequences. Cognitive Brain Research, 12, 131– 144
(1995). Can auditory memory for tone pitch be rehearsed?. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 635– 645
(1999). Prefrontal cortex regulates inhibition and excitation in distributed neural networks. Acta Psychologica, 101, 159– 178
(2003). Processing abstract auditory features in the human auditory cortex. Neuroimage, 20, 2245– 2258
(1970). Perceptual processes and forgetting in memory tasks. Psychological Review, 85, 411– 417
(1995). Shifting and focusing auditory spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 21, 387– 409
(1971). Experiments with the stimulus suffix effect. Journal of Experimental Psychology, 91, 169– 190
(1990). The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function. Behavioral and Brain Sciences, 13, 201– 288
(1997). Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature, 385, 432– 434
(2001). ‘Primitive intelligence’ in the auditory cortex. Trends in Neurosciences, 24, 283– 288
(1999). The concept of auditory stimulus representation in cognitive neuroscience. Psychological Bulletin, 125, 826– 859
(2002). Remembering over the short-term: The case against the standard model. Annual Review of Psychology, 53, 53– 81
(2002). Differential contribution of frontal and temporal cortices to auditory change detection: fMRI and ERP results. Neuroimage, 15, 167– 174
(1999). Neuronal populations extracting invariant relationships from acoustic variance. Neuroscience Letters, 265, 179– 182
(2001). Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN). Psychophysiology, 38, 359– 365
(2000). Mismatch negativity: different water in the same river. Audiology and Neuro-Otology, 5, 111– 139
(1973). Auditory and phonetic memory codes in the discrimination of consonants and vowels. Perception & Psychophysics, 13, 253– 260
(2001). Mismatch negativity is unaffected by top-down predictive information. NeuroReport, 12, 2209– 2213
(1995). The mismatch negativity of event-related potentials as a probe of transient auditory memory: A review. Ear and Hearing, 16, 52– 67
(1998). Reactivation of a dormant representation of an auditory stimulus feature. Journal of Cognitive Neuroscience, 10, 605– 614
(2002). Memory reactivation or reinstatement and the mismatch negativity. Psychophysiology, 39, 158– 165
(2001). Spatial deployment of attention within and across hemifields in an auditory task. Experimental Brain Research, 137, 487– 496
(1987). Reactivation of infant memory: Implications for cognitive development. Advances in Child Development & Behavior, 20, 185– 238
(1992). Representation of abstract attributes of auditory stimuli in the human brain. NeuroReport, 3, 1149– 1151
(1989). A source analysis of the late human auditory evoked potentials. Journal of Cognitive Neuroscience, 1, 336– 355
(1998). Predictability of stimulus deviance and the mismatch negativity. NeuroReport, 9, 4167– 4170
(2003a). Representation of the standard: stimulus context effects on the process generating the mismatch negativity component of event-related brain potentials. Psychophysiology, 40, 465– 471
(2002). Top-down effects on stimulus-driven auditory organization. Cognitive Brain Research, 13, 393– 405
(2003b). MMN and attention: Competition for deviance detection. Psychophysiology, 40, 430– 435
(1999). Spatial attention to central and peripheral auditory stimuli as indexed by event-related potentials. Cognitive Brain Research, 8, 213– 227
(1996). Necessary and sufficient conditions for the elicitation of the mismatch negativity. In C. Ogura, Y. Koga, & M. Shimokochi (Eds.) Recent Advances in Event-related Brain Potential Research (pp. 36-44). Amsterdam: Elsevier.
(2003). Change detection in complex auditory environment: Beyond the oddball paradigm. In J. Polich (Ed.), Detection of Change: Event-Related Potential and fMRI Findings (pp. 61-81). Boston: Kluwer Academic Publishers.
(1996). Interactions between transient and long-term auditory memory as reflected by the mismatch negativity. Journal of Cognitive Neuroscience, 8, 403– 415
(1998). Mismatch negativity: deviance detection or the maintenance of the “standard.”. NeuroReport, 9, 3809– 3813
(1996b). Adaptive modeling of the unattended acoustic environment reflected in the mismatch negativity event-related potential. Brain Research, 742, 239– 252
(2002). Temporary and longer retention of acoustic information. Psychophysiology, 39, 530– 534
(1999). Pre-attentive detection of vowel contrasts utilizes both phonetic and auditory memory representations. Cognitive Brain Research, 7, 357– 369
(2001). The role of large-scale perceptual organization in the mismatch negativity event-related brain potential. Journal of Cognitive Neuroscience, 13, 59– 71
(2003). Pre-attentive auditory context effects. Cognitive, Affective, & Behavioral Neuroscience, 3, 57– 77