Skip to main content
Top

2022 | OriginalPaper | Chapter

Mid-Air Haptics: Future Challenges and Opportunities

Authors : Orestis Georgiou, William Frier, Euan Freeman, Claudio Pacchierotti, Takayuki Hoshi

Published in: Ultrasound Mid-Air Haptics for Touchless Interfaces

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Ultrasound mid-air haptic technology has advanced in many ways over the past decade and has found meaningful application in a plethora of use cases. As the technology matures further and progresses from lab to market, in this chapter, we take a step back and discuss three specific directions that we think could result in the greatest impact. Namely, we highlight challenges and opportunities in improving (1) the hardware platforms used, (2) the rendering algorithms employed to create rich haptic sensations, and (3) the resulting user experience and added value the technology can instill to different end-user applications. We hope that this “wish-list” inspires the mid-air haptics and human computer interaction (HCI) community and others to join our efforts toward a deeper technology understanding, integration, and readiness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Barreiro H, Sinclair S, Otaduy MA (2020) Path routing optimization for STM ultrasound rendering. IEEE Trans Haptics 13(1):45–51CrossRef Barreiro H, Sinclair S, Otaduy MA (2020) Path routing optimization for STM ultrasound rendering. IEEE Trans Haptics 13(1):45–51CrossRef
go back to reference Berger CC et al (2018) The uncanny valley of haptics. Sci Robot 3(17) Berger CC et al (2018) The uncanny valley of haptics. Sci Robot 3(17)
go back to reference Carter T et al (2013) UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In: Proceedings of the 26th annual ACM symposium on user interface software and technology Carter T et al (2013) UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In: Proceedings of the 26th annual ACM symposium on user interface software and technology
go back to reference Inoue S, Makino Y, Shinoda H (2016) Mid-air ultrasonic pressure control on skin by adaptive focusing. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham Inoue S, Makino Y, Shinoda H (2016) Mid-air ultrasonic pressure control on skin by adaptive focusing. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham
go back to reference Takahashi R, Hasegawa K, Shinoda H (2018) Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli. In International conference on human haptic sensing and touch enabled computer applications. Springer, Cham Takahashi R, Hasegawa K, Shinoda H (2018) Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli. In International conference on human haptic sensing and touch enabled computer applications. Springer, Cham
go back to reference Fan L, Song A, Zhang H (2020) Haptic interface device using cable tension based on ultrasonic phased array. IEEE Access 8:162880–162891CrossRef Fan L, Song A, Zhang H (2020) Haptic interface device using cable tension based on ultrasonic phased array. IEEE Access 8:162880–162891CrossRef
go back to reference Frier W et al (2018) Using spatiotemporal modulation to draw tactile patterns in mid-air. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham Frier W et al (2018) Using spatiotemporal modulation to draw tactile patterns in mid-air. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham
go back to reference Frier W et al (2019) Sampling strategy for ultrasonic mid-air haptics. In: Proceedings of the 2019 CHI conference on human factors in computing systems Frier W et al (2019) Sampling strategy for ultrasonic mid-air haptics. In: Proceedings of the 2019 CHI conference on human factors in computing systems
go back to reference Frier W et al (2022) Simulating airborne ultrasound vibrations in human skin for haptic applications. IEEE Access Frier W et al (2022) Simulating airborne ultrasound vibrations in human skin for haptic applications. IEEE Access
go back to reference Frutos-Pascual M et al (2019) Evaluation of ultrasound haptics as a supplementary feedback cue for grasping in virtual environments. In: 2019 international conference on multimodal interaction Frutos-Pascual M et al (2019) Evaluation of ultrasound haptics as a supplementary feedback cue for grasping in virtual environments. In: 2019 international conference on multimodal interaction
go back to reference Hajas D et al (2020) Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE Trans Haptics 13(4):806–817 (2020) Hajas D et al (2020) Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE Trans Haptics 13(4):806–817 (2020)
go back to reference Hayward N et al (2020) A novel ultrasonic haptic device induces touch sensations with potential applications in neuroscience research. In: 2020 IEEE international ultrasonics symposium (IUS). IEEE Hayward N et al (2020) A novel ultrasonic haptic device induces touch sensations with potential applications in neuroscience research. In: 2020 IEEE international ultrasonics symposium (IUS). IEEE
go back to reference Hoshi T et al (2010) Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans Haptics 3(3):155–165 (2010) Hoshi T et al (2010) Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Trans Haptics 3(3):155–165 (2010)
go back to reference Howard T et al (2019) PUMAH: pan-tilt ultrasound mid-air haptics for larger interaction workspace in virtual reality. IEEE Trans Haptics 13(1):38–44 (2019) Howard T et al (2019) PUMAH: pan-tilt ultrasound mid-air haptics for larger interaction workspace in virtual reality. IEEE Trans Haptics 13(1):38–44 (2019)
go back to reference Ito M et al (2016) High spatial resolution midair tactile display using 70 kHz ultrasound. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham Ito M et al (2016) High spatial resolution midair tactile display using 70 kHz ultrasound. In: International conference on human haptic sensing and touch enabled computer applications. Springer, Cham
go back to reference Jewitt C et al (2021) Manifesto for digital social touch in crisis. Frontiers Comput Sci 97 Jewitt C et al (2021) Manifesto for digital social touch in crisis. Frontiers Comput Sci 97
go back to reference Kim E, Schneider O (2020) Defining haptic experience: foundations for understanding, communicating, and evaluating HX. In: Proceedings of the 2020 CHI conference on human factors in computing systems Kim E, Schneider O (2020) Defining haptic experience: foundations for understanding, communicating, and evaluating HX. In: Proceedings of the 2020 CHI conference on human factors in computing systems
go back to reference Long B et al (2014) Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans Graph (TOG) 33(6):1–10 Long B et al (2014) Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Trans Graph (TOG) 33(6):1–10
go back to reference Monnai Y et al (2014) HaptoMime: mid-air haptic interaction with a floating virtual screen. In: Proceedings of the 27th annual ACM symposium on user interface software and technology Monnai Y et al (2014) HaptoMime: mid-air haptic interaction with a floating virtual screen. In: Proceedings of the 27th annual ACM symposium on user interface software and technology
go back to reference Morales R et al (2021) Generating airborne ultrasonic amplitude patterns using an open hardware phased array. Appl Sci 11(7):2981 Morales R et al (2021) Generating airborne ultrasonic amplitude patterns using an open hardware phased array. Appl Sci 11(7):2981
go back to reference Mulot L et al (2021) DOLPHIN: a framework for the design and perceptual evaluation of ultrasound mid-air haptic stimuli. In: ACM symposium on applied perception 2021 Mulot L et al (2021) DOLPHIN: a framework for the design and perceptual evaluation of ultrasound mid-air haptic stimuli. In: ACM symposium on applied perception 2021
go back to reference Obrist M et al (2015) Emotions mediated through mid-air haptics. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems Obrist M et al (2015) Emotions mediated through mid-air haptics. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems
go back to reference Ochiai Y et al (2016) Cross-field aerial haptics: rendering haptic feedback in air with light and acoustic fields. In: Proceedings of the 2016 CHI conference on human factors in computing systems Ochiai Y et al (2016) Cross-field aerial haptics: rendering haptic feedback in air with light and acoustic fields. In: Proceedings of the 2016 CHI conference on human factors in computing systems
go back to reference O'Conaill B et al (2020) Improving immersive experiences for visitors with sensory impairments to the aquarium of the pacific. In: Extended abstracts of the 2020 CHI conference on human factors in computing systems O'Conaill B et al (2020) Improving immersive experiences for visitors with sensory impairments to the aquarium of the pacific. In: Extended abstracts of the 2020 CHI conference on human factors in computing systems
go back to reference Ozkul C, Geerts D, Rutten I (2020) Combining auditory and mid-air haptic feedback for a light switch button. In: Proceedings of the 2020 international conference on multimodal interaction Ozkul C, Geerts D, Rutten I (2020) Combining auditory and mid-air haptic feedback for a light switch button. In: Proceedings of the 2020 international conference on multimodal interaction
go back to reference Pacchierotti C et al (2017) Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Trans Haptics 10(4):580–600 (2017) Pacchierotti C et al (2017) Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Trans Haptics 10(4):580–600 (2017)
go back to reference Pittera D et al (2021) “I can feel it coming in the hairs tonight”: characterising mid-air haptics on the hairy parts of the skin. IEEE Trans Haptics Pittera D et al (2021) “I can feel it coming in the hairs tonight”: characterising mid-air haptics on the hairy parts of the skin. IEEE Trans Haptics
go back to reference Plasencia DM et al (2020) GS-PAT: high-speed multi-point sound-fields for phased arrays of transducers. ACM Trans Graph (TOG) 39(4):138–1 Plasencia DM et al (2020) GS-PAT: high-speed multi-point sound-fields for phased arrays of transducers. ACM Trans Graph (TOG) 39(4):138–1
go back to reference Rakkolainen I et al (2020) A survey of mid-air ultrasound haptics and its applications. IEEE Trans Haptics 14(1):2–19 (2020) Rakkolainen I et al (2020) A survey of mid-air ultrasound haptics and its applications. IEEE Trans Haptics 14(1):2–19 (2020)
go back to reference Raza A et al (2019) Perceptually correct haptic rendering in mid-air using ultrasound phased array. IEEE Trans Ind Electron 67(1):736–745 (2019) Raza A et al (2019) Perceptually correct haptic rendering in mid-air using ultrasound phased array. IEEE Trans Ind Electron 67(1):736–745 (2019)
go back to reference Romanus T et al (2019) Mid-air haptic bio-holograms in mixed reality. In: 2019 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE Romanus T et al (2019) Mid-air haptic bio-holograms in mixed reality. In: 2019 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE
go back to reference Sand A et al (2015) Head-mounted display with mid-air tactile feedback. In: Proceedings of the 21st ACM symposium on virtual reality software and technology Sand A et al (2015) Head-mounted display with mid-air tactile feedback. In: Proceedings of the 21st ACM symposium on virtual reality software and technology
go back to reference Suzuki S et al (2020) Reducing amplitude fluctuation by gradual phase shift in midair ultrasound haptics. IEEE Trans Haptics 13(1):87–93 Suzuki S et al (2020) Reducing amplitude fluctuation by gradual phase shift in midair ultrasound haptics. IEEE Trans Haptics 13(1):87–93
go back to reference Young G et al (2020) Designing mid-air haptic gesture controlled user interfaces for cars. In: Proceedings of the ACM on human-computer interaction, vol 4(EICS), pp 1–23 Young G et al (2020) Designing mid-air haptic gesture controlled user interfaces for cars. In: Proceedings of the ACM on human-computer interaction, vol 4(EICS), pp 1–23
Metadata
Title
Mid-Air Haptics: Future Challenges and Opportunities
Authors
Orestis Georgiou
William Frier
Euan Freeman
Claudio Pacchierotti
Takayuki Hoshi
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-031-04043-6_18