Skip to main content
Top

20-11-2019 | Original Paper

Comparison of spatial and temporal interaction techniques for 3D audio trajectory authoring

Authors: Justin D. Mathew, Stéphane Huot, Brian F. G. Katz

Published in: Journal on Multimodal User Interfaces

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the popularity of immersive media, developing usable tools for content development is important for the production process. In the context of 3D audio production, user interfaces for authoring and editing 3D audio trajectories enable content developers, composers, practitioners, and recording and mixing engineers to define how audio sources travel in time. However, common interaction techniques in 3D audio production tools can make the workflow of this task tedious and difficult to accomplish. This study investigates this problem by classifying the atomic tasks (spatially and temporally) of a general composite task of authoring 3D audio trajectories and then evaluating different interaction techniques across these tasks. Common graphical user interfaces were compared with input devices having varying degrees-of-freedom for spatial atomic tasks in order to investigate the effect of direct manipulation and integrality of interaction techniques. Continuous and discrete interaction techniques were compared for temporal tasks in order to investigate the effect of direct manipulation. Results suggest that interaction techniques with high degrees of integrality and direct manipulation reduce task completion time compared to standard GUI techniques. The design of temporal tasks can create a visual bias, and discrete-time controls can be a suitable method for traversing a small number of control points. These results and further observations provide directions on the study of interaction technique design for 3D audio tools, which in turn should improve workflows of 3D audio content creation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aceituno J (2015) Direct and expressive interaction on the desktop: increasing granularity, extent, and dimensionality. Ph.D. thesis, Université Lille 1 - Sciences et Technologies Aceituno J (2015) Direct and expressive interaction on the desktop: increasing granularity, extent, and dimensionality. Ph.D. thesis, Université Lille 1 - Sciences et Technologies
2.
go back to reference Aceituno J, Potier L (2014) The secret life of computers. In: CHI’14 extended abstracts on human factors in computing systems. ACM, pp 151–152 Aceituno J, Potier L (2014) The secret life of computers. In: CHI’14 extended abstracts on human factors in computing systems. ACM, pp 151–152
3.
go back to reference Beaudouin-Lafon M (2000) Instrumental interaction: an interaction model for designing post-wimp user interfaces. In: SIGCHI conference on human factors in computing systems, ACM, New York, NY, USA, CHI ’00, pp 446–453 Beaudouin-Lafon M (2000) Instrumental interaction: an interaction model for designing post-wimp user interfaces. In: SIGCHI conference on human factors in computing systems, ACM, New York, NY, USA, CHI ’00, pp 446–453
4.
go back to reference Bergstrom T, Karahalios K (2007) Conversation clock: visualizing audio patterns in co-located groups. In: 40th Annual Hawaii international conference on system sciences, 2007. HICSS 2007. IEEE, pp 78–78 Bergstrom T, Karahalios K (2007) Conversation clock: visualizing audio patterns in co-located groups. In: 40th Annual Hawaii international conference on system sciences, 2007. HICSS 2007. IEEE, pp 78–78
5.
go back to reference Bresson J, Schumacher M (2011) Representation and interchange of sound spatialization data for compositional applications. In: International computer music conference, pp 1–5 Bresson J, Schumacher M (2011) Representation and interchange of sound spatialization data for compositional applications. In: International computer music conference, pp 1–5
7.
go back to reference Cumming G (2014) The new statistics: why and how. Psychol Sci 25(1):7–29 CrossRef Cumming G (2014) The new statistics: why and how. Psychol Sci 25(1):7–29 CrossRef
8.
go back to reference Cumming G, Finch S (2005) Inference by eye: confidence intervals and how to read pictures of data. Am Psychol 60(2):170CrossRef Cumming G, Finch S (2005) Inference by eye: confidence intervals and how to read pictures of data. Am Psychol 60(2):170CrossRef
9.
go back to reference Damaske P (1969) Directional dependence of spectrum and correlation functions of the signals received at the ears. Acta Acust United Acust 22(4):191–204 Damaske P (1969) Directional dependence of spectrum and correlation functions of the signals received at the ears. Acta Acust United Acust 22(4):191–204
10.
go back to reference De Araùjo BR, Casiez G, Jorge JA (2012) Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space. In: Graphics interface, canadian information processing society, pp 173–180 De Araùjo BR, Casiez G, Jorge JA (2012) Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space. In: Graphics interface, canadian information processing society, pp 173–180
11.
go back to reference Dragicevic P (2016) Fair statistical communication in HCI. In: Modern statistical methods for HCI. Springer, pp 291–330 Dragicevic P (2016) Fair statistical communication in HCI. In: Modern statistical methods for HCI. Springer, pp 291–330
12.
go back to reference Dragicevic P, Huot S (2002) Spiraclock: a continuous and non-intrusive display for upcoming events. In: CHI’02 extended abstracts on Human factors in computing systems. ACM, pp 604–605 Dragicevic P, Huot S (2002) Spiraclock: a continuous and non-intrusive display for upcoming events. In: CHI’02 extended abstracts on Human factors in computing systems. ACM, pp 604–605
13.
go back to reference Favory X, Garcia J, Bresson J (2015) Trajectoires: a mobile application for controlling and composing sound spatialization. In: 27ème conférence francophone sur l’Interaction Homme-Machine. ACM, Toulouse, France, pp 1–4 Favory X, Garcia J, Bresson J (2015) Trajectoires: a mobile application for controlling and composing sound spatialization. In: 27ème conférence francophone sur l’Interaction Homme-Machine. ACM, Toulouse, France, pp 1–4
14.
go back to reference Garcia J, Bresson J, Carpentier T (2015) Towards interactive authoring tools for composing spatialization. In: IEEE 10th Symposium on 3D user interfaces, Arles, France, pp 1–2 Garcia J, Bresson J, Carpentier T (2015) Towards interactive authoring tools for composing spatialization. In: IEEE 10th Symposium on 3D user interfaces, Arles, France, pp 1–2
15.
go back to reference Jacob RJK, Sibert LE, McFarlane DC, Mullen MP Jr (1994) Integrality and separability of input devices. ACM Trans Comput Hum Interact 1(1):3–26CrossRef Jacob RJK, Sibert LE, McFarlane DC, Mullen MP Jr (1994) Integrality and separability of input devices. ACM Trans Comput Hum Interact 1(1):3–26CrossRef
16.
go back to reference Jacquemin G, Coduys T, Ranc M (2012) Iannix 0.8. Actes des Journées d’Informatique Musicale (JIM 2012), pp 107–115 Jacquemin G, Coduys T, Ranc M (2012) Iannix 0.8. Actes des Journées d’Informatique Musicale (JIM 2012), pp 107–115
17.
go back to reference Kirby KN, Gerlanc D (2013) Bootes: an R package for bootstrap confidence intervals on effect sizes. Behav Res Methods 45(4):905–927CrossRef Kirby KN, Gerlanc D (2013) Bootes: an R package for bootstrap confidence intervals on effect sizes. Behav Res Methods 45(4):905–927CrossRef
18.
go back to reference Martinet A, Casiez G, Grisoni L (2010) The design and evaluation of 3D positioning techniques for multi-touch displays. In: 2010 IEEE symposium on 3D user interfaces (3DUI), pp 115–118 Martinet A, Casiez G, Grisoni L (2010) The design and evaluation of 3D positioning techniques for multi-touch displays. In: 2010 IEEE symposium on 3D user interfaces (3DUI), pp 115–118
19.
go back to reference Martinet A, Casiez G, Grisoni L (2012) Integrality and separability of multitouch interaction techniques in 3D manipulation tasks. IEEE Trans Vis Comput Graph 18(3):369–380 CrossRef Martinet A, Casiez G, Grisoni L (2012) Integrality and separability of multitouch interaction techniques in 3D manipulation tasks. IEEE Trans Vis Comput Graph 18(3):369–380 CrossRef
21.
go back to reference Mathew JD, Huot S, Katz BFG (2017) Survey and implications for the design of new 3D audio production and authoring tools. J Multimodal User Interfaces 11(3):277–287 CrossRef Mathew JD, Huot S, Katz BFG (2017) Survey and implications for the design of new 3D audio production and authoring tools. J Multimodal User Interfaces 11(3):277–287 CrossRef
22.
go back to reference Melchior F, Pike C, Brooks M, Grace S (2013) On the use of a haptic feedback device for sound source control in spatial audio systems. In: Audio engineering society convention 134 Melchior F, Pike C, Brooks M, Grace S (2013) On the use of a haptic feedback device for sound source control in spatial audio systems. In: Audio engineering society convention 134
23.
go back to reference Metatla O, Martin F, Parkinson A, Bryan-Kinns N, Stockman T, Tanaka A (2016) Audio-haptic interfaces for digital audio workstations. J Multimodal User Interfaces 10(3):247–258CrossRef Metatla O, Martin F, Parkinson A, Bryan-Kinns N, Stockman T, Tanaka A (2016) Audio-haptic interfaces for digital audio workstations. J Multimodal User Interfaces 10(3):247–258CrossRef
24.
go back to reference Nielsen J (1993) Usability engineering. Morgan Kaufmann Publishers Inc., San FranciscoCrossRef Nielsen J (1993) Usability engineering. Morgan Kaufmann Publishers Inc., San FranciscoCrossRef
25.
go back to reference Sachs E, Roberts A, Stoops D (1991) 3-draw: a tool for designing 3D shapes. IEEE Comput Graph Appl 6(6):18–26CrossRef Sachs E, Roberts A, Stoops D (1991) 3-draw: a tool for designing 3D shapes. IEEE Comput Graph Appl 6(6):18–26CrossRef
26.
go back to reference Schumacher M, Bresson J (2010) Spatial sound synthesis in computer-aided composition. Organ Sound 15:271–289CrossRef Schumacher M, Bresson J (2010) Spatial sound synthesis in computer-aided composition. Organ Sound 15:271–289CrossRef
27.
go back to reference Selker T (2005) Fostering motivation and creativity for computer users. Intl J Hum Comput Stud 63(4):410–421CrossRef Selker T (2005) Fostering motivation and creativity for computer users. Intl J Hum Comput Stud 63(4):410–421CrossRef
28.
go back to reference Shneiderman B (1997) Direct manipulation for comprehensible, predictable and controllable user interfaces. In: 2nd international conference on intelligent user interfaces. ACM, pp 33–39 Shneiderman B (1997) Direct manipulation for comprehensible, predictable and controllable user interfaces. In: 2nd international conference on intelligent user interfaces. ACM, pp 33–39
29.
go back to reference Van Emmerik MJ (1990) A direct manipulation technique for specifying 3d object transformations with a 2d input device. Comput Graph Forum 9:355–361CrossRef Van Emmerik MJ (1990) A direct manipulation technique for specifying 3d object transformations with a 2d input device. Comput Graph Forum 9:355–361CrossRef
30.
go back to reference Veit M, Capobianco A, Bechmann D (2009) Influence of degrees of freedom’s manipulation on performances during orientation tasks in virtual reality environments. In: 16th ACM symposium on virtual reality software and technology, pp 51–58 Veit M, Capobianco A, Bechmann D (2009) Influence of degrees of freedom’s manipulation on performances during orientation tasks in virtual reality environments. In: 16th ACM symposium on virtual reality software and technology, pp 51–58
31.
go back to reference Veit M, Capobianco A, Bechmann D (2011) An experimental analysis of the impact of touch screen interaction techniques for 3-d positioning tasks. In: Virtual reality conference (VR). IEEE, pp 75–82 Veit M, Capobianco A, Bechmann D (2011) An experimental analysis of the impact of touch screen interaction techniques for 3-d positioning tasks. In: Virtual reality conference (VR). IEEE, pp 75–82
32.
go back to reference Zeleznik RC, Herndon KP, Hughes JF (2007) Sketch: an interface for sketching 3D scenes. In: ACM SIGGRAPH 2007 courses, p 19 Zeleznik RC, Herndon KP, Hughes JF (2007) Sketch: an interface for sketching 3D scenes. In: ACM SIGGRAPH 2007 courses, p 19
33.
go back to reference Zhai S, Milgram P (1998) Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. In: SIGCHI conference on human factors in computer systems, pp 320–327 Zhai S, Milgram P (1998) Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices. In: SIGCHI conference on human factors in computer systems, pp 320–327
Metadata
Title
Comparison of spatial and temporal interaction techniques for 3D audio trajectory authoring
Authors
Justin D. Mathew
Stéphane Huot
Brian F. G. Katz
Publication date
20-11-2019
Publisher
Springer International Publishing
Published in
Journal on Multimodal User Interfaces
Print ISSN: 1783-7677
Electronic ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-019-00314-x

Premium Partner