Top

Published in:

2021 | OriginalPaper | Chapter

Exploring Design Cognition in Voice-Driven Sound Sketching and Synthesis

Authors : Stefano Delle Monache, Davide Rocchesso

Published in: Perception, Representations, Image, Sound, Music

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Conceptual design and communication of sonic ideas are critical, and still unresolved aspects of current sound design practices, especially when teamwork is involved. Design cognition studies in the visual domain represent a valuable resource to look at, to better comprehend the reasoning of designers when they approach a sound-based project. A design exercise involving a team of professional sound designers is analyzed, and discussed in the framework of the Function-Behavior-Structure ontology of design. The use of embodied sound representations of concepts fosters team-building and a more effective communication, in terms of shared mental models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter How Would You Reproduce a Synthetic Sound of an Ellipse in Water? A Phenomenological Investigation of Pre-reflexive Contents of Consciousness

next chapter Morphing Musical Instrument Sounds with the Sinusoidal Model in the Sound Morphing Toolbox

The symposium, organized by Frédérique Guyot (LAPS-design) and Patrick Susini (Ircam) in collaboration with the French Acoustical Society, took place at Centre Pompidou, Paris, France, in 2004 (https://www.centrepompidou.fr/cpv/resource/cazjxnn/rLLRyR).

The tool in action: https://vimeo.com/271826511.

LiNKODER, a design protocol analysis tool: https://sites.google.com/a/linkoder.com/linkoder/home.

Barbot, B., Webster, P.R.: Creative thinking in music. In: Lubart, T. (ed.) The Creative Process: Perspectives from Multiple Domains, pp. 255–273. Palgrave Macmillan UK, London (2018)CrossRef

Barney, A., Voegelin, S.: Collaboration and consensus in listening. Leonardo Music J. 28, 82–87 (2018)CrossRef

Barrass, S.: Sonic information design. J. Sonic Stud. (2018). Special Issue on Sonic Information Design. https://www.researchcatalogue.net/view/558606/558686

Brazil, E.: A review of methods and frameworks for sonic interaction design: exploring existing approaches. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds.) CMMR/ICAD - 2009. LNCS, vol. 5954, pp. 41–67. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-12439-6_3CrossRef

Brun, J., Le Masson, P., Weil, B.: Designing with sketches: the generative effects of knowledge preordering. Design Sci. 2, e13 (2016)CrossRef

Caramiaux, B., Altavilla, A., Pobiner, S.G., Tanaka, A.: Form follows sound: designing interactions from sonic memories. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 3943–3952. ACM, New York (2015)

Carron, M., Rotureau, T., Dubois, F., Misdariis, N., Susini, P.: Speaking about sounds: a tool for communication on sound features. J. Design Res. 15(2), 85–109 (2017)CrossRef

Cash, P., Maier, A.: Prototyping with your hands: the many roles of gesture in the communication of design concepts. J. Eng. Des. 27(1–3), 118–145 (2016)CrossRef

Collins, D.: A synthesis process model of creative thinking in music composition. Psychol. Music 33(2), 193–216 (2005)CrossRef

10.

Delle Monache, S., et al.: Interactive prototypes realized with the SkAT-VG tool. Deliverable, SkAT-VG project (2017)

11.

Delle Monache, S., Rocchesso, D.: Cooperative sound design: a protocol analysis. In: Proceedings of the Audio Mostly, AM 2016, pp. 154–161. ACM, New York (2016)

12.

Delle Monache, S., Rocchesso, D.: To embody or not to embody: a sound design dilemma. In: Fontana, F., Gulli, A. (eds.) Machine Sounds, Sound Machines - Proceedings of the XXII CIM Colloquium on Music Informatics, pp. 93–100, November 2018

13.

Delle Monache, S., Rocchesso, D.: Sketching sonic interactions. In: Filimowicz, M. (ed.) Foundations in Sound Design for Embedded Media, A Multidisciplinary Approach, pp. 79–101. Routledge, New York (2019)

14.

Delle Monache, S., Rocchesso, D., Bevilacqua, F., Lemaitre, G., Baldan, S., Cera, A.: Embodied sound design. Int. J. Hum. Comput. Stud. 118, 47–59 (2018)CrossRef

15.

Dinar, M., et al.: Empirical studies of designer thinking: past, present, and future. J. Mech. Des. 137(2), 021101–0211013 (2015)CrossRef

16.

Erkut, C., Serafin, S., Hoby, M., Sårde, J.: Product sound design: form, function, and experience. In: Proceedings of the Audio Mostly 2015 on Interaction With Sound, AM 2015, pp. 10:1–10:6. ACM, New York (2015)

17.

Filimowicz, M.: Foundations in Sound Design for Embedded Media: A Multidisciplinary Approach. Routledge, London (2019)CrossRef

18.

Franinović, K., Serafin, S.: Sonic Interaction Design. MIT Press, Cambridge (2013)CrossRef

19.

Gero, J.S., Jiang, H., Williams, C.B.: Design cognition differences when using unstructured, partially structured, and structured concept generation creativity techniques. Int. J. Design Creat. Innov. 1(4), 196–214 (2013)CrossRef

20.

Goel, A.K., Vattam, S., Wiltgen, B., Helms, M.: Cognitive, collaborative, conceptual and creative-four characteristics of the next generation of knowledge-based cad systems: a study in biologically inspired design. Comput. Aided Des. 44(10), 879–900 (2012)CrossRef

21.

Goel, V.: Creative brains: designing in the real world. Front. Hum. Neurosci. 8, 241 (2014)CrossRef

22.

Goldschmidt, G.: The backtalk of self-generated sketches. Des. Issues 19(1), 72–88 (2003)CrossRef

23.

Goldschmidt, G.: Linkography: Unfolding The Design Process. MIT Press, Cambridge (2014)CrossRef

24.

Grimshaw, M.: Game Sound Technology and Player Interaction: Concepts and Developments. IGI Global (2010)

25.

Hay, L., Duffy, A.H.B., McTeague, C., Pidgeon, L.M., Vuletic, T., Grealy, M.: A systematic review of protocol studies on conceptual design cognition: Design as search andÂ exploration. Design Sci. 3, e10 (2017)CrossRef

26.

Hay, L., Duffy, A.H.B., McTeague, C., Pidgeon, L.M., Vuletic, T., Grealy, M.: Towards a shared ontology: a generic classification of cognitive processes in conceptual design. Design Sci. 3, e7 (2017)CrossRef

27.

Hubbard, T.L.: Auditory imagery: empirical findings. Psychol. Bull. 136(2), 302 (2010)CrossRef

28.

Jiang, H., Gero, J.S., Yen, C.-C.: Exploring designing styles using a problem–solution division. In: Gero, J.S. (ed.) Design Computing and Cognition 2012, pp. 79–94. Springer, Dordrecht (2014). https://doi.org/10.1007/978-94-017-9112-0_5CrossRef

29.

Kan, J.W., Gero, J.S.: Quantitative Methods for Studying Design Protocols. Springer, Heidelberg (2017). https://doi.org/10.1007/978-94-024-0984-0CrossRef

30.

Kan, J.W., Gero, J.S., Tang, H.H.: Measuring cognitive design activity changes during an industry team brainstorming session. In: Gero, J.S. (ed.) Design Computing and Cognition 2010, pp. 621–640. Springer, Dordrecht (2011). https://doi.org/10.1007/978-94-007-0510-4_33CrossRef

31.

Kiefer, M., Sim, E.J., Herrnberger, B., Grothe, J., Hoenig, K.: The sound of concepts: four markers for a link between auditory and conceptual brain systems. J. Neurosci. 28(47), 12224–12230 (2008)CrossRef

32.

Lemaitre, G., Houix, O., Visell, Y., Franinović, K., Misdariis, N., Susini, P.: Toward the design and evaluation of continuous sound in tangible interfaces: the Spinotron. Int. J. Hum. Comput. Stud. 67(11), 976–993 (2009)CrossRef

33.

Lemaitre, G., Jabbari, A., Houix, O., Misdariis, N., Susini, P.: Vocal imitations of basic auditory features. J. Acoust. Soc. Am. 139(1), 290–300 (2016)CrossRef

34.

Lemaitre, G., Scurto, H., Françoise, J., Bevilacqua, F., Houix, O., Susini, P.: Rising tones and rustling noises: metaphors in gestural depictions of sounds. PLoS One 12(7), e0181786 (2017)CrossRef

35.

Leman, M., Maes, P.J., Nijs, L., Van Dyck, E.: What is embodied music cognition? In: Bader, R. (ed.) Springer Handbook of Systematic Musicology, pp. 747–760. Springer, Heidelberg (2018). https://doi.org/10.1007/978-3-662-55004-5_34CrossRef

36.

Lyon, R.H.: Product sound quality-from perception to design. Sound vibr. 37(3), 18–23 (2003)

37.

Meelberg, V., Özcan, E.: Editorial: Designing our sonic lives. J. Sonic Stud. (6) (2018). Special Issue on Sound Design. https://www.researchcatalogue.net/view/239747/239748/0/0

38.

Özcan, E., van Egmond, R.: Product sound design: an inter-disciplinary approach? In: Undisciplined! Design Research Society Conference (2009). http://shura.shu.ac.uk/531/

39.

Pauletto, S.: Perspectives on sound design. The New Soundtrack 4(2), v–vi (2014)CrossRef

40.

Pedersen, T.H., Zacharov, N.: How many psycho-acoustic attributes are needed. J. Acoust. Soc. Am. 123(5), 3163 (2008)CrossRef

41.

Pourmohamadi, M., Gero, J.S.: LINKOgrapher: an analysis tool to study design protocols based on FBS coding scheme. In: Culley, S., Hicks, B., McAloone, T., Howard, T., Clarkson, J. (eds.) ICED 2011 Proc. of the 18th International Conference on Engineering Design, Impacting Society through Engineering Design. Design Theory and Research Methodology, vol. 2, pp. 294–303 (2011)

42.

Purcell, A., Gero, J.S.: Drawings and the design process: a review of protocol studies in design and other disciplines and related research in cognitive psychology. Des. Stud. 19(4), 389–430 (1998)CrossRef

43.

Rocchesso, D., Delle Monache, S., Barrass, S.: Interaction by ear. Int. J. Hum.-Comput. Stud. (2019). Accepted for publication

44.

Rocchesso, D., Polotti, P., Delle Monache, S.: Designing continuous sonic interaction. Int. J. Design 3(3), 13–25 (2009)

45.

Roddy, S., Bridges, B.: Sound, ecological affordances and embodied mappings in auditory display. In: Filimowicz, M., Tzankova, V. (eds.) New Directions in Third Wave Human-Computer Interaction: Volume 2 - Methodologies. HIS, pp. 231–258. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73374-6_12CrossRef

46.

Sander, H.: Listen! Improving the cooperation between game designers and audio designers. In: DiGRA 2011 - Proceedings of the 2011 DiGRA International Conference: Think Design Play. DiGRA/Utrecht School of the Arts, January 2011

47.

Sanz Segura, R., Manchado Pérez, E.: Product sound design as a valuable tool in the product development process. Ergon. Design 26(4), 20–24 (2018)CrossRef

48.

Schon, D.A.: The Reflective Practitioner: How Professionals Think in Action. Basic Books (1984)

49.

Serafin, S., Franinović, K., Hermann, T., Lemaitre, G., Rinott, M., Rocchesso, D.: Sonic interaction design. In: Hermann, T., Hunt, A., Neuhoff, J.G. (eds.) The Sonification Handbook, chap. 5, pp. 87–110. Logos Publishing House, Berlin (2011)

50.

Susini, P., Houix, O., Misdariis, N.: Sound design: an applied, experimental framework to study the perception of everyday sounds. New Soundtrack 4(2), 103–121 (2014)CrossRef

51.

Tajadura-Jiménez, A., Väljamäe, A., Bevilacqua, F., Bianchi-Berthouze, N.: Body-centered auditory feedback. In: Norman, K.L., Kirakowski, J. (eds.) The Wiley Handbook of Human Computer Interaction, pp. 371–403. Wiley, Hoboken (2017)CrossRef

52.

Zattra, L., Misdariis, N., Pecquet, F., Donin, N., Fierro, D.: Analysis of sound design practices [ASDP]. Research methodology. In: Fontana, F., Gulli, A. (eds.) Machine sounds, Sound machines - Proceedings of the XXII CIM Colloquium on Music Informatics, pp. 168–175, November 2018

Title: Exploring Design Cognition in Voice-Driven Sound Sketching and Synthesis
Authors: Stefano Delle Monache
Davide Rocchesso
Publisher: Springer International Publishing
Book: Perception, Representations, Image, Sound, Music
Print ISBN: 978-3-030-70209-0

Electronic ISBN: 978-3-030-70210-6

Copyright Year: 2021
DOI: https://doi.org/10.1007/978-3-030-70210-6_30

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"