Skip to main content
Top

2018 | OriginalPaper | Chapter

35. Sonic Object Cognition

Author : Rolf Inge Godøy

Published in: Springer Handbook of Systematic Musicology

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We evidently have features at different timescales in music, ranging from the sub-millisecond timescale of single vibrations to the timescale of a couple of hundred milliseconds, manifesting perceptually salient features such as pitch, loudness, timbre, and various transients. At the larger timescales of several hundred milliseconds, we have features such as the overall dynamic and timbral envelopes of sonic events, and at slightly larger timescales, also of various rhythmic, textural, melodic, and harmonic patterns. And at still larger timescales, we have phrases, sections, and whole works of music, often lasting several minutes, and in some cases, even hours.
Features at these different timescales all contribute to our experience of music, however the focus in the present chapter is on the salient features of what has been called sonic objects, meaning on holistically perceived chunks of musical sound in the very approximately 0.5 − 5 s duration range. A number of known constraints in the production and perception of musical sound as well as in human behavior and perception in general, seem to converge in designating this timescale as crucial for our experience of music.
The aim of this chapter is then to try to understand how sequentially unfolding and ephemeral sound and sound-related body motion can somehow be transformed in our minds to sonic objects.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
35.1
go back to reference E. Husserl: On the Phenomenology of the Consciousness of Internal Time, 1893–1917 (Kluwer, Doredrecht 1991), English translation by John Barnett BroughCrossRef E. Husserl: On the Phenomenology of the Consciousness of Internal Time, 1893–1917 (Kluwer, Doredrecht 1991), English translation by John Barnett BroughCrossRef
35.2
go back to reference R.I. Godøy: Thinking now-points in music-related movement. In: Concepts, Experiments and Fieldwork. Studies in Systematic Musicology and Ethnomusicology, ed. by R. Bader, C. Neuhaus, U. Morgenstern (Peter Lang, Frankfurt 2010) pp. 245–260 R.I. Godøy: Thinking now-points in music-related movement. In: Concepts, Experiments and Fieldwork. Studies in Systematic Musicology and Ethnomusicology, ed. by R. Bader, C. Neuhaus, U. Morgenstern (Peter Lang, Frankfurt 2010) pp. 245–260
35.3
go back to reference R.I. Godøy: Sound-action awareness in music. In: Music and Consciousness, ed. by D. Clarke, E. Clarke (Oxford Univ. Press, Oxford 2011) pp. 231–243 R.I. Godøy: Sound-action awareness in music. In: Music and Consciousness, ed. by D. Clarke, E. Clarke (Oxford Univ. Press, Oxford 2011) pp. 231–243
35.4
go back to reference T.D. Griffiths, J.D. Warren: What is an auditory object?, Nat. Rev. Neurosci. 5(11), 887–892 (2004)CrossRef T.D. Griffiths, J.D. Warren: What is an auditory object?, Nat. Rev. Neurosci. 5(11), 887–892 (2004)CrossRef
35.5
go back to reference P. Schaeffer: Traité des Objets Musicaux (Éditions du Seuil, Paris 1966) P. Schaeffer: Traité des Objets Musicaux (Éditions du Seuil, Paris 1966)
35.6
go back to reference P. Schaeffer: Solfège de l’objet Sonore (INA/GRM, Paris 1998), with sound examples by Reibel, G. and Ferreyra, B. 1967 P. Schaeffer: Solfège de l’objet Sonore (INA/GRM, Paris 1998), with sound examples by Reibel, G. and Ferreyra, B. 1967
35.7
go back to reference M. Chion: Guide des Objets Sonores (INA/GRM Buchet/Chastel, Paris 1983) M. Chion: Guide des Objets Sonores (INA/GRM Buchet/Chastel, Paris 1983)
35.8
go back to reference J.-C. Risset: Timbre analysis by synthesis: Representations, imitations and variants for musical composition. In: Representations of Musical Signals, ed. by G. De Poli, A. Piccialli, C. Roads (MIT Press, Cambridge 1991) pp. 7–43 J.-C. Risset: Timbre analysis by synthesis: Representations, imitations and variants for musical composition. In: Representations of Musical Signals, ed. by G. De Poli, A. Piccialli, C. Roads (MIT Press, Cambridge 1991) pp. 7–43
35.9
go back to reference R.I. Godøy: Formalization and Epistemology (Scandinavian Univ. Press, Oslo 1997) R.I. Godøy: Formalization and Epistemology (Scandinavian Univ. Press, Oslo 1997)
35.10
go back to reference J. Petitot: Morphogenèse du Sens I (Presses Universitaires de France, Paris 1985) J. Petitot: Morphogenèse du Sens I (Presses Universitaires de France, Paris 1985)
35.11
go back to reference J. Petitot: Forme in Encyclopædia Universalis (Encyclopædia Universalis, Paris 1990) J. Petitot: Forme in Encyclopædia Universalis (Encyclopædia Universalis, Paris 1990)
35.12
go back to reference A.R. Jensenius, R.I. Godøy: Sonifying the shape of human body motion using motiongrams, Empir. Musicol. Rev. 8(2), 73–83 (2013)CrossRef A.R. Jensenius, R.I. Godøy: Sonifying the shape of human body motion using motiongrams, Empir. Musicol. Rev. 8(2), 73–83 (2013)CrossRef
35.13
go back to reference A. Hunt, M. Wanderley, M. Paradis: The importance of parameter mapping in electronic instrument design, J. New Music Res. 32(4), 429–440 (2003)CrossRef A. Hunt, M. Wanderley, M. Paradis: The importance of parameter mapping in electronic instrument design, J. New Music Res. 32(4), 429–440 (2003)CrossRef
35.14
go back to reference A. Bregman: Auditory Scene Analysis (MIT Press, Cambridge 1990) A. Bregman: Auditory Scene Analysis (MIT Press, Cambridge 1990)
35.15
go back to reference J.K. Bizley, Y.E. Cohen: The what, where and how of auditory-object perception, Nat. Rev. Neurosci. 14, 693–707 (2013)CrossRef J.K. Bizley, Y.E. Cohen: The what, where and how of auditory-object perception, Nat. Rev. Neurosci. 14, 693–707 (2013)CrossRef
35.16
go back to reference I. Winkler, T.L. van Zuijen, E. Sussman, J. Horváth, R. Näätänen: Object representation in the human auditory system, Eur. J. Neurosci. 24(2), 625–634 (2006)CrossRef I. Winkler, T.L. van Zuijen, E. Sussman, J. Horváth, R. Näätänen: Object representation in the human auditory system, Eur. J. Neurosci. 24(2), 625–634 (2006)CrossRef
35.17
go back to reference R.I. Godøy: Gestural-sonorous objects: Embodied extensions of Schaeffer’s conceptual apparatus, Organ. Sound 11(2), 149–157 (2006)CrossRef R.I. Godøy: Gestural-sonorous objects: Embodied extensions of Schaeffer’s conceptual apparatus, Organ. Sound 11(2), 149–157 (2006)CrossRef
35.18
go back to reference R.I. Godøy, M. Leman: Musical Gestures: Sound, Movement and Meaning (Routledge, New York 2010) R.I. Godøy, M. Leman: Musical Gestures: Sound, Movement and Meaning (Routledge, New York 2010)
35.19
go back to reference V. Gallese, T. Metzinger: Motor ontology: The representational reality of goals, actions and selves, Philos. Psychol. 16(3), 365–388 (2003)CrossRef V. Gallese, T. Metzinger: Motor ontology: The representational reality of goals, actions and selves, Philos. Psychol. 16(3), 365–388 (2003)CrossRef
35.20
go back to reference M. Wilson, G. Knoblich: The case for motor involvement in perceiving conspecifics, Psychol. Bull. 131(3), 460–473 (2005)CrossRef M. Wilson, G. Knoblich: The case for motor involvement in perceiving conspecifics, Psychol. Bull. 131(3), 460–473 (2005)CrossRef
35.21
go back to reference V. Gallese, G. Lakoff: The brain’s concepts: The role of the sensory-motor system in conceptual knowledge, Cogn. Neuropsychol. 22(3/4), 455–479 (2005)CrossRef V. Gallese, G. Lakoff: The brain’s concepts: The role of the sensory-motor system in conceptual knowledge, Cogn. Neuropsychol. 22(3/4), 455–479 (2005)CrossRef
35.22
go back to reference A. Berthoz: Le Sense du Mouvement (Odile Jacob, Paris 1997) A. Berthoz: Le Sense du Mouvement (Odile Jacob, Paris 1997)
35.23
go back to reference A.M. Liberman, I.G. Mattingly: The motor theory of speech perception revised, Cognition 21, 1–36 (1985)CrossRef A.M. Liberman, I.G. Mattingly: The motor theory of speech perception revised, Cognition 21, 1–36 (1985)CrossRef
35.24
go back to reference B. Galantucci, C.A. Fowler, M.T. Turvey: The motor theory of speech perception reviewed, Psychon. Bull. Rev. 13(3), 361–377 (2006)CrossRef B. Galantucci, C.A. Fowler, M.T. Turvey: The motor theory of speech perception reviewed, Psychon. Bull. Rev. 13(3), 361–377 (2006)CrossRef
35.25
go back to reference J. Haueisen, T.R. Knösche: Involuntary motor activity in pianists evoked by music perception, J. Cogn. Neurosci. 13(6), 786–792 (2001)CrossRef J. Haueisen, T.R. Knösche: Involuntary motor activity in pianists evoked by music perception, J. Cogn. Neurosci. 13(6), 786–792 (2001)CrossRef
35.26
go back to reference E. Kohler, C. Keysers, M.A. Umiltà, L. Fogassi, V. Gallese, G. Rizzolatti: Hearing sounds, understanding actions: Action representation in mirror neurons, Science 297, 846–848 (2002)CrossRef E. Kohler, C. Keysers, M.A. Umiltà, L. Fogassi, V. Gallese, G. Rizzolatti: Hearing sounds, understanding actions: Action representation in mirror neurons, Science 297, 846–848 (2002)CrossRef
35.27
go back to reference M. Bangert, E.O. Altenmüller: Mapping perception to action in piano practice: A longitudinal DC-EEG study, BMC Neuroscience 4, 26 (2003)CrossRef M. Bangert, E.O. Altenmüller: Mapping perception to action in piano practice: A longitudinal DC-EEG study, BMC Neuroscience 4, 26 (2003)CrossRef
35.28
go back to reference H. McGurk, J. MacDonald: Hearing lips and seeing voices, Nature 264, 746–748 (1976)CrossRef H. McGurk, J. MacDonald: Hearing lips and seeing voices, Nature 264, 746–748 (1976)CrossRef
35.29
go back to reference R.I. Godøy: Imagined action, excitation and resonance. In: Musical Imagery, ed. by R.I. Godøy, H. Jorgensen (Swets and Zeitlinger, Lisse 2001) pp. 237–250 R.I. Godøy: Imagined action, excitation and resonance. In: Musical Imagery, ed. by R.I. Godøy, H. Jorgensen (Swets and Zeitlinger, Lisse 2001) pp. 237–250
35.30
go back to reference R.I. Godøy: Motor-mimetic music cognition, Leonardo 36(4), 317–319 (2003)CrossRef R.I. Godøy: Motor-mimetic music cognition, Leonardo 36(4), 317–319 (2003)CrossRef
35.31
35.32
go back to reference R.I. Godøy, E. Haga, A.R. Jensenius: Playing air instruments: Mimicry of sound-producing gestures by novices and experts. In: GW2005, LNAI 3881, ed. by S. Gibet, N. Courty, J.-F. Kamp (Springer, Berlin, Heidelberg 2006) pp. 256–267 R.I. Godøy, E. Haga, A.R. Jensenius: Playing air instruments: Mimicry of sound-producing gestures by novices and experts. In: GW2005, LNAI 3881, ed. by S. Gibet, N. Courty, J.-F. Kamp (Springer, Berlin, Heidelberg 2006) pp. 256–267
35.33
go back to reference K. Nymoen, R.I. Godøy, A.R. Jensenius, J. Torresen: Analyzing correspondence between sound objects and body motion, ACM Trans. Appl. Percept. 10(2), 9 (2013)CrossRef K. Nymoen, R.I. Godøy, A.R. Jensenius, J. Torresen: Analyzing correspondence between sound objects and body motion, ACM Trans. Appl. Percept. 10(2), 9 (2013)CrossRef
35.34
go back to reference B.C.J. Moore: Hearing (Academic, San Diego 1995) B.C.J. Moore: Hearing (Academic, San Diego 1995)
35.35
go back to reference R. Gjerdingen, D. Perrott: Scanning the dial: The rapid recognition of music genres, J. New Music Res. 37(2), 93–100 (2008)CrossRef R. Gjerdingen, D. Perrott: Scanning the dial: The rapid recognition of music genres, J. New Music Res. 37(2), 93–100 (2008)CrossRef
35.36
go back to reference E. Pöppel: A hierarchical model of time perception, Trends Cogn. Sci. 1(2), 56–61 (1997)CrossRef E. Pöppel: A hierarchical model of time perception, Trends Cogn. Sci. 1(2), 56–61 (1997)CrossRef
35.37
go back to reference R.I. Godøy: Reflections on chunking in music. In: Systematic and Comparative Musicology: Concepts, Methods, Findings, ed. by A. Schneider (Peter Lang, Frankfurt 2008) pp. 117–132 R.I. Godøy: Reflections on chunking in music. In: Systematic and Comparative Musicology: Concepts, Methods, Findings, ed. by A. Schneider (Peter Lang, Frankfurt 2008) pp. 117–132
35.38
go back to reference N. Hogan, D. Sternad: On rhythmic and discrete movements: Reflections, definitions and implications for motor control, Exp. Brain Res. 181, 13–30 (2007)CrossRef N. Hogan, D. Sternad: On rhythmic and discrete movements: Reflections, definitions and implications for motor control, Exp. Brain Res. 181, 13–30 (2007)CrossRef
35.39
go back to reference S.T. Klapp, R.J. Jagacinski: Gestalt principles in the control of motor action, Psychol. Bull. 137(3), 443–462 (2011)CrossRef S.T. Klapp, R.J. Jagacinski: Gestalt principles in the control of motor action, Psychol. Bull. 137(3), 443–462 (2011)CrossRef
35.40
go back to reference H. Haken, J. Kelso, H. Bunz: A theoretical model of phase transitions in human hand movements, Biol. Cybern. 51(5), 347–356 (1985)MathSciNetCrossRef H. Haken, J. Kelso, H. Bunz: A theoretical model of phase transitions in human hand movements, Biol. Cybern. 51(5), 347–356 (1985)MathSciNetCrossRef
35.41
go back to reference R.I. Godøy: Understanding coarticulation in musical experience. In: In: Sound, Music and Motion Lecture Notes in Computer Science, ed. by M. Aramaki, M. Derrien, R. Kronland-Martinet, S. Ystad (Springer, Berlin 2014) pp. 535–547 R.I. Godøy: Understanding coarticulation in musical experience. In: In: Sound, Music and Motion Lecture Notes in Computer Science, ed. by M. Aramaki, M. Derrien, R. Kronland-Martinet, S. Ystad (Springer, Berlin 2014) pp. 535–547
35.42
go back to reference S.T. Grafton, A.F. Hamilton: Evidence for a distributed hierarchy of action representation in the brain, Hum. Mov. Sci. 26, 590–616 (2007)CrossRef S.T. Grafton, A.F. Hamilton: Evidence for a distributed hierarchy of action representation in the brain, Hum. Mov. Sci. 26, 590–616 (2007)CrossRef
35.43
go back to reference R.I. Godøy: Quantal elements in musical experience. In: Sound–Perception–Performance. Current Research in Systematic Musicology, ed. by R. Bader (Springer, Berlin, Heidelberg 2013) pp. 113–128CrossRef R.I. Godøy: Quantal elements in musical experience. In: Sound–Perception–Performance. Current Research in Systematic Musicology, ed. by R. Bader (Springer, Berlin, Heidelberg 2013) pp. 113–128CrossRef
35.44
go back to reference S.T. Klapp, J.M. Nelson, R.J. Jagacinski: Can people tap concurrent bimanual rhythms independently?, J. Motor Behav. 30(4), 301–322 (1998)CrossRef S.T. Klapp, J.M. Nelson, R.J. Jagacinski: Can people tap concurrent bimanual rhythms independently?, J. Motor Behav. 30(4), 301–322 (1998)CrossRef
35.45
go back to reference R.I. Godøy: Gestural affordances of musical sound. In: Musical Gestures: Sound, Movement and Meaning, ed. by R.I. Godøy, M. Leman (Routledge, New York 2010) pp. 103–125 R.I. Godøy: Gestural affordances of musical sound. In: Musical Gestures: Sound, Movement and Meaning, ed. by R.I. Godøy, M. Leman (Routledge, New York 2010) pp. 103–125
35.46
go back to reference D. Rocchesso, F. Fontana: The Sounding Object (Edizioni di Mondo Estremo, Firenze 2003) D. Rocchesso, F. Fontana: The Sounding Object (Edizioni di Mondo Estremo, Firenze 2003)
35.47
35.48
go back to reference R. Cogan: New Images of Musical Sound (Harvard Univ. Press, Cambridge 1984) R. Cogan: New Images of Musical Sound (Harvard Univ. Press, Cambridge 1984)
35.49
go back to reference B. Schäffer: Introduction to Composition (PWM, Warsaw 1976) B. Schäffer: Introduction to Composition (PWM, Warsaw 1976)
35.50
go back to reference A.R. Jensenius: Some video abstraction techniques for displaying body movement in analysis and performance, Leonardo: J. Int. Soc. Arts Sci. Technol. 46(1), 53–60 (2013)CrossRef A.R. Jensenius: Some video abstraction techniques for displaying body movement in analysis and performance, Leonardo: J. Int. Soc. Arts Sci. Technol. 46(1), 53–60 (2013)CrossRef
35.51
go back to reference R. Thom: Paraboles et Catastrophes (Flammarion, Paris 1983)MATH R. Thom: Paraboles et Catastrophes (Flammarion, Paris 1983)MATH
35.52
go back to reference I. Xenakis: Formalized Music (Pendragon, Stuyvesant 1992) I. Xenakis: Formalized Music (Pendragon, Stuyvesant 1992)
35.53
go back to reference L. Van Noorden: The functional role and bio-kinetics of basic and expressive gestures in activation and sonification. In: Musical Gestures: Sound, Movement and Meaning, ed. by R.I. Godøy, M. Leman (Routledge, New York 2010) pp. 154–179 L. Van Noorden: The functional role and bio-kinetics of basic and expressive gestures in activation and sonification. In: Musical Gestures: Sound, Movement and Meaning, ed. by R.I. Godøy, M. Leman (Routledge, New York 2010) pp. 154–179
35.54
go back to reference F. Delalande, M. Formosa, M. Frémiot, P. Gobin, P. Malbosc, J. Mandelbrojt, E. Pedler: Les Unités Sémiotiques Temporelles: Éléments Nouveaux d’analyse Musicale (Marseille, Édition MIM-Documents Musurgia 1996) F. Delalande, M. Formosa, M. Frémiot, P. Gobin, P. Malbosc, J. Mandelbrojt, E. Pedler: Les Unités Sémiotiques Temporelles: Éléments Nouveaux d’analyse Musicale (Marseille, Édition MIM-Documents Musurgia 1996)
Metadata
Title
Sonic Object Cognition
Author
Rolf Inge Godøy
Copyright Year
2018
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-55004-5_35

Premium Partners