Skip to main content

2018 | OriginalPaper | Buchkapitel

DIGIT: A Digital Foley System to Generate Footstep Sounds

verfasst von : Luis Aly, Rui Penha, Gilberto Bernardes

Erschienen in: Music Technology with Swing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present DIGItal sTeps (DIGIT), a system for assisting in the creation of footstep sounds in a post-production foley context—a practice that recreates all diegetic sounds for a moving image. The novelty behind DIGIT is the use of the acoustic (haptic) response of a gesture on a tangible interface as means for navigating and retrieving similar matches from a large database of annotated footstep sounds. While capturing the tactile expressiveness of the traditional sound foley practice in the exploration of physical objects, DIGIT streamlines the workflow of the audio post production environment for film or games by reducing its costly and time-consuming requirements.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
https://​lesound.​io (accessed January 12, 2018).
 
4
https://​cycling74.​com (accessed January 12, 2018).
 
6
MKL stands for Modified Kullback-Leibler, a descriptor that measures the difference between two probability distributions as defined in [14].
 
7
A SUS score above a 68 should be considered above average and anything below 68 is below average [3].
 
Literatur
1.
Zurück zum Zitat Ament, V.T.: The Foley Grail: The Art of Performing Sound for Film, Games, and Animation. CRC Press, Abingdon (2014) Ament, V.T.: The Foley Grail: The Art of Performing Sound for Film, Games, and Animation. CRC Press, Abingdon (2014)
2.
Zurück zum Zitat Bernardes, G., Guedes, C., Pennycook, B.: EarGram: an application for interactive exploration of concatenative sound synthesis in pure data. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 110–129. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41248-6_7CrossRef Bernardes, G., Guedes, C., Pennycook, B.: EarGram: an application for interactive exploration of concatenative sound synthesis in pure data. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 110–129. Springer, Heidelberg (2013). https://​doi.​org/​10.​1007/​978-3-642-41248-6_​7CrossRef
3.
Zurück zum Zitat Brooke, J., et al.: SUS - a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996) Brooke, J., et al.: SUS - a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)
4.
Zurück zum Zitat Camic, P.: From trashed to treasured: a grounded theory analysis of the found object. Psychol. Aesthetics Creativity Arts 4(2), 81 (2010)CrossRef Camic, P.: From trashed to treasured: a grounded theory analysis of the found object. Psychol. Aesthetics Creativity Arts 4(2), 81 (2010)CrossRef
5.
Zurück zum Zitat Chion, M., Murch, W.: Audio-Vision: Sound on Screen. Columbia University Press, New York (1994) Chion, M., Murch, W.: Audio-Vision: Sound on Screen. Columbia University Press, New York (1994)
6.
Zurück zum Zitat De Götzen, A., Sikström, E., Grani, F., Serafin, S.: Real, foley or synthetic? An evaluation of everyday walking sounds. In: Proceedings of SMC (2013) De Götzen, A., Sikström, E., Grani, F., Serafin, S.: Real, foley or synthetic? An evaluation of everyday walking sounds. In: Proceedings of SMC (2013)
8.
Zurück zum Zitat Dunn, J.C.: A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J. Cybern. 3(3), 32–57 (1973)MathSciNetCrossRef Dunn, J.C.: A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J. Cybern. 3(3), 32–57 (1973)MathSciNetCrossRef
9.
Zurück zum Zitat Fontana, F., Morreale, F., Regia-Corte, T., Lécuyer, A., Marchal, M.: Auditory recognition of floor surfaces by temporal and spectral cues of walking. International Community for Auditory Display (2011) Fontana, F., Morreale, F., Regia-Corte, T., Lécuyer, A., Marchal, M.: Auditory recognition of floor surfaces by temporal and spectral cues of walking. International Community for Auditory Display (2011)
11.
Zurück zum Zitat Mitrovic, D., Zeppelzauer, M., Eidenberger, H.: Analysis of the data quality of audio descriptions of environmental sounds. J. Digital Inf. Manag. 5(2), 48 (2007) Mitrovic, D., Zeppelzauer, M., Eidenberger, H.: Analysis of the data quality of audio descriptions of environmental sounds. J. Digital Inf. Manag. 5(2), 48 (2007)
12.
Zurück zum Zitat Nordahl, R., Berrezag, A., Dimitrov, S., Turchet, L., Hayward, V., Serafin, S.: Preliminary experiment combining virtual reality haptic shoes and audio synthesis. In: Kappers, A.M.L., van Erp, J.B.F., Bergmann Tiest, W.M., van der Helm, F.C.T. (eds.) EuroHaptics 2010. LNCS, vol. 6192, pp. 123–129. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14075-4_18CrossRef Nordahl, R., Berrezag, A., Dimitrov, S., Turchet, L., Hayward, V., Serafin, S.: Preliminary experiment combining virtual reality haptic shoes and audio synthesis. In: Kappers, A.M.L., van Erp, J.B.F., Bergmann Tiest, W.M., van der Helm, F.C.T. (eds.) EuroHaptics 2010. LNCS, vol. 6192, pp. 123–129. Springer, Heidelberg (2010). https://​doi.​org/​10.​1007/​978-3-642-14075-4_​18CrossRef
13.
Zurück zum Zitat Nordahl, R., Turchet, L., Serafin, S.: Sound synthesis and evaluation of interactive footsteps and environmental sounds rendering for virtual reality applications. IEEE Trans. Vis. Comput. Graph. 17(9), 1234–1244 (2011)CrossRef Nordahl, R., Turchet, L., Serafin, S.: Sound synthesis and evaluation of interactive footsteps and environmental sounds rendering for virtual reality applications. IEEE Trans. Vis. Comput. Graph. 17(9), 1234–1244 (2011)CrossRef
14.
Zurück zum Zitat Peeters, G., Giordano, B.L., Susini, P., Misdariis, N., McAdams, S.: The timbre toolbox: extracting audio descriptors from musical signals. J. Acoust. Soc. Am. 130(5), 2902–2916 (2011)CrossRef Peeters, G., Giordano, B.L., Susini, P., Misdariis, N., McAdams, S.: The timbre toolbox: extracting audio descriptors from musical signals. J. Acoust. Soc. Am. 130(5), 2902–2916 (2011)CrossRef
16.
Zurück zum Zitat Roads, C.: Microsound. MIT Press, Cambridge (2004) Roads, C.: Microsound. MIT Press, Cambridge (2004)
17.
Zurück zum Zitat Schwarz, D., Beller, G., Verbrugghe, B., Britton, S.: Real-time corpus-based concatenative synthesis with cataRT. In: 9th International Conference on Digital Audio Effects (DAFx), pp. 279–282 (2006) Schwarz, D., Beller, G., Verbrugghe, B., Britton, S.: Real-time corpus-based concatenative synthesis with cataRT. In: 9th International Conference on Digital Audio Effects (DAFx), pp. 279–282 (2006)
18.
Zurück zum Zitat Sonnenschein, D.: Sound Design: The Expressive Power of Music, Voice, and Sound Effects in Cinema. Michael Wiese Productions, Studio City (2001) Sonnenschein, D.: Sound Design: The Expressive Power of Music, Voice, and Sound Effects in Cinema. Michael Wiese Productions, Studio City (2001)
19.
Zurück zum Zitat Turchet, L., Nordahl, R., Serafin, S., Berrezag, A., Dimitrov, S., Hayward, V.: Audio-haptic physically-based simulation of walking on different grounds. In: 2010 IEEE International Workshop on Multimedia Signal Processing (MMSP), pp. 269–273. IEEE (2010) Turchet, L., Nordahl, R., Serafin, S., Berrezag, A., Dimitrov, S., Hayward, V.: Audio-haptic physically-based simulation of walking on different grounds. In: 2010 IEEE International Workshop on Multimedia Signal Processing (MMSP), pp. 269–273. IEEE (2010)
20.
Zurück zum Zitat Turchet, L., Serafin, S., Cesari, P.: Walking pace affected by interactive sounds simulating stepping on different terrains. ACM Trans. Appl. Percept. (TAP) 10(4), 23 (2013) Turchet, L., Serafin, S., Cesari, P.: Walking pace affected by interactive sounds simulating stepping on different terrains. ACM Trans. Appl. Percept. (TAP) 10(4), 23 (2013)
21.
Zurück zum Zitat Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Physically based sound synthesis and control of footsteps sounds. In: Proceedings of Digital Audio Effects Conference, vol. 11 (2010) Turchet, L., Serafin, S., Dimitrov, S., Nordahl, R.: Physically based sound synthesis and control of footsteps sounds. In: Proceedings of Digital Audio Effects Conference, vol. 11 (2010)
Metadaten
Titel
DIGIT: A Digital Foley System to Generate Footstep Sounds
verfasst von
Luis Aly
Rui Penha
Gilberto Bernardes
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-01692-0_28

Neuer Inhalt