Skip to main content

2021 | OriginalPaper | Buchkapitel

A Research on Sensing Localization and Orientation of Objects in VR with Facial Vibrotactile Display

verfasst von : Ke Wang, Yi-Hsuan Li, Chun-Chen Hsu, Jiabei Jiang, Yan Liu, Zirui Zhao, Wei Yue, Lu Yao

Erschienen in: Virtual, Augmented and Mixed Reality

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Tactile display technology has been widely proved to be effective to human-computer interaction. In multiple quantitative research methods to evaluate VR user experience (such as presence, immersion, and usability), multi-sensory factors are significant proportion. Therefore, the integration of VR-HMD and tactile display is a possible application and innovation trend of VR. The BIP (Break in Presence) phenomenon affects the user's spatial awareness when entering or leaving VR environments. We extracted orientation and localization tasks to discuss the influence of facial vibrotactile display on these tasks. Correlational researches are mainly focused on the parts of human body such as torso, limb, and head regions. We chose face region and to carry out the experiment, a VR-based wearable prototype “VibroMask” was built to implement facial vibrotactile perception. Firstly, the behavioral data of subjects' discrimination of vibrotactile information were tested to obtain the appropriate display paradigm. It was found that the discrimination accuracy of low-frequency vibration was higher with loose wearing status, and the delay offset of one-point vibration could better adapt to the orientation task. Secondly, the effect of facial vibrotactile display on objects’ localization and orientation discriminating task in VR was discussed. Finally, subjects’ feedback was collected by using open-ended questionnaire, it is found that users have a higher subjective evaluation of VR experience with facial vibrotactile display.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Slater, M., Usoh, M.: Presence in immersive virtual environments. In: IEEE Annual Virtual Reality International Symposium, pp. 90–96 (1993) Slater, M., Usoh, M.: Presence in immersive virtual environments. In: IEEE Annual Virtual Reality International Symposium, pp. 90–96 (1993)
3.
Zurück zum Zitat Lessiter, J., Freeman, J., Keogh, E., Davidoff, J.: A cross-media presence questionnaire: the ITC-sense of presence inventory. Presence 10(3), 282–297 (2014)CrossRef Lessiter, J., Freeman, J., Keogh, E., Davidoff, J.: A cross-media presence questionnaire: the ITC-sense of presence inventory. Presence 10(3), 282–297 (2014)CrossRef
4.
Zurück zum Zitat Nash, E.B., Edwards, G.W., Thompson, J.A., Barfield, W.: A review of presence and performance in virtual environments. Int. J. Hum.-Comput. Interact. 12(1), 1–41 (2000)CrossRef Nash, E.B., Edwards, G.W., Thompson, J.A., Barfield, W.: A review of presence and performance in virtual environments. Int. J. Hum.-Comput. Interact. 12(1), 1–41 (2000)CrossRef
6.
Zurück zum Zitat Venkatesan, L., Barlow, S., Kieweg, D.: Age- and sex-related changes in vibrotactile sensitivity of hand and face in neurotypical adults. Somatosens. Motor Res. 32 (2014) Venkatesan, L., Barlow, S., Kieweg, D.: Age- and sex-related changes in vibrotactile sensitivity of hand and face in neurotypical adults. Somatosens. Motor Res. 32 (2014)
7.
Zurück zum Zitat Mcdaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., Panchanathan, S.: Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind. IEEE International Workshop on Haptic Audio-visual Environments and Games, pp. 13–18(2008) Mcdaniel, T., Krishna, S., Balasubramanian, V., Colbry, D., Panchanathan, S.: Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind. IEEE International Workshop on Haptic Audio-visual Environments and Games, pp. 13–18(2008)
8.
Zurück zum Zitat Schwind, V., Knierim, P., Haas, N., Henze, N.: Using Presence Questionnaires in Virtual Reality (2019) Schwind, V., Knierim, P., Haas, N., Henze, N.: Using Presence Questionnaires in Virtual Reality (2019)
9.
Zurück zum Zitat Wang, C., Huang, D.-Y., Hsu, S.-W., et al.: Masque: Exploring lateral skin stretch feedback on the face with head-mounted displays. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, pp. 439–451 (2019) Wang, C., Huang, D.-Y., Hsu, S.-W., et al.: Masque: Exploring lateral skin stretch feedback on the face with head-mounted displays. In: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, pp. 439–451 (2019)
10.
Zurück zum Zitat Ranasinghe, N., Jain, P., Karwita, S., Tolley, D., Do, E.: Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions, pp. 1731–1742 (2017) Ranasinghe, N., Jain, P., Karwita, S., Tolley, D., Do, E.: Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions, pp. 1731–1742 (2017)
11.
Zurück zum Zitat Peiris, R.L., Peng, W., Chen, Z., Chan, L., Minamizawa, K.: ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays (2017) Peiris, R.L., Peng, W., Chen, Z., Chan, L., Minamizawa, K.: ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays (2017)
12.
Zurück zum Zitat Schubert, T., Friedmann, F., Regenbrecht, H.: The experience of presence: factor analytic insights. Presence 10(3), 266–281 (2001)CrossRef Schubert, T., Friedmann, F., Regenbrecht, H.: The experience of presence: factor analytic insights. Presence 10(3), 266–281 (2001)CrossRef
13.
Zurück zum Zitat Makransky, G., Lilleholt, L., Aaby, A.: Development and validation of the multimodal presence scale for virtual reality environments: a confirmatory factor analysis and item response theory approach. Comput. Hum. Behav. 72, 276–285 (2017) Makransky, G., Lilleholt, L., Aaby, A.: Development and validation of the multimodal presence scale for virtual reality environments: a confirmatory factor analysis and item response theory approach. Comput. Hum. Behav. 72, 276–285 (2017)
14.
Zurück zum Zitat Minamizawa, K., Kakehi, Y., Nakatani, M., Mihara, S., Tachi, S.: TECHTILE toolkit: a prototyping tool for designing haptic media (2012) Minamizawa, K., Kakehi, Y., Nakatani, M., Mihara, S., Tachi, S.: TECHTILE toolkit: a prototyping tool for designing haptic media (2012)
15.
Zurück zum Zitat Ujitoko, Y., Ban, Y.: Vibrotactile signal generation from texture images or attributes using generative adversarial network (2019) Ujitoko, Y., Ban, Y.: Vibrotactile signal generation from texture images or attributes using generative adversarial network (2019)
16.
Zurück zum Zitat Durlach, P.J., Fowlkes, J., Metevier, C.J.: Effect of variations in sensory feedback on performance in a virtual reaching task. Presence 14(4), 450–462 (2005)CrossRef Durlach, P.J., Fowlkes, J., Metevier, C.J.: Effect of variations in sensory feedback on performance in a virtual reaching task. Presence 14(4), 450–462 (2005)CrossRef
17.
Zurück zum Zitat Tsetserukou, D.: HaptiHug: a novel haptic display for communication of hug over a distance. In: International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, pp. 340–347 (2010) Tsetserukou, D.: HaptiHug: a novel haptic display for communication of hug over a distance. In: International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, pp. 340–347 (2010)
18.
Zurück zum Zitat Al-Sada, M.,, Jiang, K., Ranade, S., Piao, X., Höglund, T., Nakajima, T.: HapticSerpent: A Wearable Haptic Feedback Robot for VR. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). Association for Computing Machinery, Paper LBW624, pp. 1–6 (2018) Al-Sada, M.,, Jiang, K., Ranade, S., Piao, X., Höglund, T., Nakajima, T.: HapticSerpent: A Wearable Haptic Feedback Robot for VR. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). Association for Computing Machinery, Paper LBW624, pp. 1–6 (2018)
21.
Zurück zum Zitat Tsukada, K., Yasumura, M.: Activebelt: Belt-type wearable tactile display for directional navigation. In: International Conference on Ubiquitous Computing. Springer, Berlin, Heidelberg (2004) Tsukada, K., Yasumura, M.: Activebelt: Belt-type wearable tactile display for directional navigation. In: International Conference on Ubiquitous Computing. Springer, Berlin, Heidelberg (2004)
22.
Zurück zum Zitat Vyas, P., Taha, F.A., Blum, J.R., Cooperstock, J.R.: HapToes: Vibrotactile Numeric Information Delivery via Tactile Toe Display. Haptics Symposium 2020 (2020). Vyas, P., Taha, F.A., Blum, J.R., Cooperstock, J.R.: HapToes: Vibrotactile Numeric Information Delivery via Tactile Toe Display. Haptics Symposium 2020 (2020).
23.
Zurück zum Zitat Novich, S.D., Eagleman, D.M.: Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput. Exp. Brain Res. 233(10), 2777–2788 (2015)CrossRef Novich, S.D., Eagleman, D.M.: Using space and time to encode vibrotactile information: toward an estimate of the skin’s achievable throughput. Exp. Brain Res. 233(10), 2777–2788 (2015)CrossRef
24.
Zurück zum Zitat Hollins, M., Goble, A.K.: Vibrotactile adaptation on the face. 49(1), 21–30 (1991) Hollins, M., Goble, A.K.: Vibrotactile adaptation on the face. 49(1), 21–30 (1991)
25.
Zurück zum Zitat Dobrzynski, M.K.: Quantifying information transfer through a head-attached vibrotactile display: principles for design and control. IEEE Trans. Biomed. Eng. 59(7), 2011–2018 (2012)CrossRef Dobrzynski, M.K.: Quantifying information transfer through a head-attached vibrotactile display: principles for design and control. IEEE Trans. Biomed. Eng. 59(7), 2011–2018 (2012)CrossRef
26.
Zurück zum Zitat Darken, R.P., Sibert, J.L.: A toolset for navigation in virtual environments. In: Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology. ACM (1993) Darken, R.P., Sibert, J.L.: A toolset for navigation in virtual environments. In: Proceedings of the 6th Annual ACM Symposium on User Interface Software and Technology. ACM (1993)
27.
Zurück zum Zitat Borg, E., Rönnberg, J., Neovius, L.: Vibratory-coded directional analysis: evaluation of a three-microphone/four-vibrator DSP system. J. Rehabil. Res. Dev. 38 257–63 (2001) Borg, E., Rönnberg, J., Neovius, L.: Vibratory-coded directional analysis: evaluation of a three-microphone/four-vibrator DSP system. J. Rehabil. Res. Dev. 38 257–63 (2001)
28.
Zurück zum Zitat Swapp, D., Pawar, V., Loscos, C.: Interaction with co-located haptic feedback in virtual reality. Virtual Reality 10, 24–30(2006) Swapp, D., Pawar, V., Loscos, C.: Interaction with co-located haptic feedback in virtual reality. Virtual Reality 10, 24–30(2006)
29.
Zurück zum Zitat Nukarinen, T., Rantala, J., Farooq, A., Raisamo, R.: Delivering Directional Haptic Cues through Eyeglasses and a Seat (2015) Nukarinen, T., Rantala, J., Farooq, A., Raisamo, R.: Delivering Directional Haptic Cues through Eyeglasses and a Seat (2015)
30.
Zurück zum Zitat Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Designing a Vibrotactile Head-Mounted Display for Spatial Awareness in 3D Spaces. IEEE Trans. Vis. Comput. Graph. 1 (2017) Oliveira, V.A., Brayda, L., Nedel, L., Maciel, A.: Designing a Vibrotactile Head-Mounted Display for Spatial Awareness in 3D Spaces. IEEE Trans. Vis. Comput. Graph. 1 (2017)
31.
Zurück zum Zitat Kaul, O.B., Rohs, M.: HapticHead: 3D Guidance and Target Acquisition through a Vibrotactile Grid. Chi Conference Extended Abstracts. ACM (2016) Kaul, O.B., Rohs, M.: HapticHead: 3D Guidance and Target Acquisition through a Vibrotactile Grid. Chi Conference Extended Abstracts. ACM (2016)
32.
Zurück zum Zitat Oliveira, V.A.D.J., Nedel, L., Maciel, A., Brayda, L.: Spatial discrimination of vibrotactile stimuli around the head. IEEE Haptics Symposium. IEEE (2016) Oliveira, V.A.D.J., Nedel, L., Maciel, A., Brayda, L.: Spatial discrimination of vibrotactile stimuli around the head. IEEE Haptics Symposium. IEEE (2016)
Metadaten
Titel
A Research on Sensing Localization and Orientation of Objects in VR with Facial Vibrotactile Display
verfasst von
Ke Wang
Yi-Hsuan Li
Chun-Chen Hsu
Jiabei Jiang
Yan Liu
Zirui Zhao
Wei Yue
Lu Yao
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-77599-5_17