Skip to main content
Erschienen in: Neural Computing and Applications 36/2023

08.06.2023 | S.I. : Evolutionary Computation based Methods and Applications for Data Processing

Modeling the gaze point distribution to assist eye-based target selection in head-mounted displays

verfasst von: Ting Lei, Jing Chen, Jixiang Chen, Bo Liu

Erschienen in: Neural Computing and Applications | Ausgabe 36/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to its natural and fast characteristics, eye tracking, as a novel input modality, has been widely used in head-mounted displays for interaction. However, because of the inadvertent jitter of eyes and limitations of eye tracking devices, the eye-based selection often performs poorly in accuracy and stability compared with other input modalities, especially for small targets. To address this issue, we built a likelihood model by modeling the gaze point distribution and then combined it with Bayesian rules to infer the intended target from the perspective of probability as an alternative to the traditional selection criteria based on boundary judgment. Our investigation shows that using our model improves the selection performance significantly over the conventional ray-casting selection method and using the existing optimal likelihood model, especially in the selection of small targets.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Soukoreff RW, MacKenzie IS (2004) Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. Int J Hum Comput Stud 61(6):751–789CrossRef Soukoreff RW, MacKenzie IS (2004) Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. Int J Hum Comput Stud 61(6):751–789CrossRef
2.
Zurück zum Zitat MacKenzie IS (2012) Human-computer interaction: an empirical research perspective. Morgan Kaufmann, Massachusetts MacKenzie IS (2012) Human-computer interaction: an empirical research perspective. Morgan Kaufmann, Massachusetts
3.
Zurück zum Zitat Hajri AA, Fels S, Miller G, Ilich M (2011) Moving target selection in 2D graphical user interfaces. In: IFIP Conference on Human-Computer Interaction, pp 141–161. Springer, Berlin, Heidelberg Hajri AA, Fels S, Miller G, Ilich M (2011) Moving target selection in 2D graphical user interfaces. In: IFIP Conference on Human-Computer Interaction, pp 141–161. Springer, Berlin, Heidelberg
4.
Zurück zum Zitat Bohan M, Chaparro A, Scarlett D (1998) The effects of selection technique on target acquisition movements made with a mouse. In: Proceedings of the human factors and ergonomics society annual meeting, Vol. 42, No. 5, pp 473–475. Sage CA: Los Angeles, CA: SAGE Publications Bohan M, Chaparro A, Scarlett D (1998) The effects of selection technique on target acquisition movements made with a mouse. In: Proceedings of the human factors and ergonomics society annual meeting, Vol. 42, No. 5, pp 473–475. Sage CA: Los Angeles, CA: SAGE Publications
5.
Zurück zum Zitat Cockburn A, Firth A (2004) Improving the acquisition of small targets. In: People and computers XVII—designing for society, pp 181–196. Springer, London Cockburn A, Firth A (2004) Improving the acquisition of small targets. In: People and computers XVII—designing for society, pp 181–196. Springer, London
6.
Zurück zum Zitat Lee S, Seo J, Kim GJ, Park CM (2003) Evaluation of pointing techniques for ray casting selection in virtual environments. In: Third international conference on virtual reality and its application in industry, Vol. 4756, pp 38–44. SPIE Lee S, Seo J, Kim GJ, Park CM (2003) Evaluation of pointing techniques for ray casting selection in virtual environments. In: Third international conference on virtual reality and its application in industry, Vol. 4756, pp 38–44. SPIE
7.
Zurück zum Zitat Yan Y, Shi Y, Yu C, Shi Y (2020) Headcross: exploring head-based crossing selection on head-mounted displays. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 4(1), 1-22 Yan Y, Shi Y, Yu C, Shi Y (2020) Headcross: exploring head-based crossing selection on head-mounted displays. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, 4(1), 1-22
8.
Zurück zum Zitat Pietroszek, K., & Lee, N. (2019). Virtual Hand Metaphor in Virtual Reality. Pietroszek, K., & Lee, N. (2019). Virtual Hand Metaphor in Virtual Reality.
9.
Zurück zum Zitat Schjerlund J, Hornbæk K, Bergström J (2021) Ninja hands: using many hands to improve target selection in vr. In: Proceedings of the 2021 CHI conference on human factors in computing systems (pp 1–14) Schjerlund J, Hornbæk K, Bergström J (2021) Ninja hands: using many hands to improve target selection in vr. In: Proceedings of the 2021 CHI conference on human factors in computing systems (pp 1–14)
10.
Zurück zum Zitat Moore AG, Hatch JG, Kuehl S, McMahan RP (2018) VOTE: a ray-casting study of vote-oriented technique enhancements. Int J Hum Comput Stud 120:36–48CrossRef Moore AG, Hatch JG, Kuehl S, McMahan RP (2018) VOTE: a ray-casting study of vote-oriented technique enhancements. Int J Hum Comput Stud 120:36–48CrossRef
11.
Zurück zum Zitat Baloup M, Pietrzak T, Casiez G (2019) Raycursor: a 3d pointing facilitation technique based on raycasting. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–12 Baloup M, Pietrzak T, Casiez G (2019) Raycursor: a 3d pointing facilitation technique based on raycasting. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–12
12.
Zurück zum Zitat Lu Y, Yu C, Shi Y (2020). Investigating bubble mechanism for ray-casting to improve 3D target acquisition in virtual reality. In: 2020 IEEE conference on virtual reality and 3D user interfaces (VR), pp 35–43. IEEE Lu Y, Yu C, Shi Y (2020). Investigating bubble mechanism for ray-casting to improve 3D target acquisition in virtual reality. In: 2020 IEEE conference on virtual reality and 3D user interfaces (VR), pp 35–43. IEEE
13.
Zurück zum Zitat Tanriverdi V, Jacob RJ (2000) Interacting with eye movements in virtual environments. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 265–272 Tanriverdi V, Jacob RJ (2000) Interacting with eye movements in virtual environments. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 265–272
14.
Zurück zum Zitat Kytö M, Ens B, Piumsomboon T, Lee GA, Billinghurst M (2018) Pinpointing: Precise head-and eye-based target selection for augmented reality. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–14 Kytö M, Ens B, Piumsomboon T, Lee GA, Billinghurst M (2018) Pinpointing: Precise head-and eye-based target selection for augmented reality. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–14
15.
Zurück zum Zitat Hou WJ, Chen XL (2021) Comparison of eye-based and controller-based selection in virtual reality. Int J Human-Comput Interact 37(5):484–495CrossRef Hou WJ, Chen XL (2021) Comparison of eye-based and controller-based selection in virtual reality. Int J Human-Comput Interact 37(5):484–495CrossRef
16.
Zurück zum Zitat Qian YY, Teather RJ (2017) The eyes don't have it: an empirical comparison of head-based and eye-based selection in virtual reality. In: Proceedings of the 5th symposium on spatial user interaction, pp 91–98 Qian YY, Teather RJ (2017) The eyes don't have it: an empirical comparison of head-based and eye-based selection in virtual reality. In: Proceedings of the 5th symposium on spatial user interaction, pp 91–98
17.
Zurück zum Zitat Blattgerste J, Renner P, Pfeiffer T (2018) Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views. In: Proceedings of the workshop on communication by gaze interaction, pp 1–9 Blattgerste J, Renner P, Pfeiffer T (2018) Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views. In: Proceedings of the workshop on communication by gaze interaction, pp 1–9
18.
Zurück zum Zitat Miniotas D, Špakov O (2004) An algorithm to counteract eye jitter in gaze-controlled interfaces. Inf Tech Control 30(1):65–68 Miniotas D, Špakov O (2004) An algorithm to counteract eye jitter in gaze-controlled interfaces. Inf Tech Control 30(1):65–68
19.
Zurück zum Zitat Holmqvist K (2017) Common predictors of accuracy, precision and data loss in 12 eye-trackers. In: The 7th scandinavian workshop on eye tracking Holmqvist K (2017) Common predictors of accuracy, precision and data loss in 12 eye-trackers. In: The 7th scandinavian workshop on eye tracking
20.
Zurück zum Zitat Aziz S, Komogortsev O (2022) An assessment of the eye tracking signal quality captured in the HoloLens 2. In: 2022 Symposium on eye tracking research and applications, pp 1–6 Aziz S, Komogortsev O (2022) An assessment of the eye tracking signal quality captured in the HoloLens 2. In: 2022 Symposium on eye tracking research and applications, pp 1–6
21.
Zurück zum Zitat Ryu K, Lee JJ, Park JM (2019) GG Interaction: a gaze–grasp pose interaction for 3D virtual object selection. J Multimodal User Interfaces 13(4):383–393CrossRef Ryu K, Lee JJ, Park JM (2019) GG Interaction: a gaze–grasp pose interaction for 3D virtual object selection. J Multimodal User Interfaces 13(4):383–393CrossRef
22.
Zurück zum Zitat Schweigert R, Schwind V, Mayer S (2019) Eyepointing: a gaze-based selection technique. In: Proceedings of Mensch und computer 2019, pp 719–723 Schweigert R, Schwind V, Mayer S (2019) Eyepointing: a gaze-based selection technique. In: Proceedings of Mensch und computer 2019, pp 719–723
23.
Zurück zum Zitat Khamis M, Oechsner C, Alt F, Bulling A (2018) VRpursuits: interaction in virtual reality using smooth pursuit eye movements. In: Proceedings of the 2018 international conference on advanced visual interfaces, pp 1–8 Khamis M, Oechsner C, Alt F, Bulling A (2018) VRpursuits: interaction in virtual reality using smooth pursuit eye movements. In: Proceedings of the 2018 international conference on advanced visual interfaces, pp 1–8
24.
Zurück zum Zitat Sidenmark L, Clarke C, Zhang X, Phu J, Gellersen H (2020) Outline pursuits: Gaze-assisted selection of occluded objects in virtual reality. In: Proceedings of the 2020 chi conference on human factors in computing systems, pp 1–13 Sidenmark L, Clarke C, Zhang X, Phu J, Gellersen H (2020) Outline pursuits: Gaze-assisted selection of occluded objects in virtual reality. In: Proceedings of the 2020 chi conference on human factors in computing systems, pp 1–13
25.
Zurück zum Zitat Bi X, Zhai S (2013) Bayesian touch: a statistical criterion of target selection with finger touch. In: Proceedings of the 26th annual ACM symposium on user interface software and technology, pp 51–60 Bi X, Zhai S (2013) Bayesian touch: a statistical criterion of target selection with finger touch. In: Proceedings of the 26th annual ACM symposium on user interface software and technology, pp 51–60
26.
Zurück zum Zitat Zhu S, Kim Y, Zheng J, Luo JY, Qin R, Wang L, Bi X (2020) Using Bayes' theorem for command input: principle, models, and applications. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–15 Zhu S, Kim Y, Zheng J, Luo JY, Qin R, Wang L, Bi X (2020) Using Bayes' theorem for command input: principle, models, and applications. In: Proceedings of the 2020 CHI conference on human factors in computing systems, pp 1–15
27.
Zurück zum Zitat Huang J, Tian F, Li N, Fan X (2019) Modeling the uncertainty in 2D moving target selection. In: Proceedings of the 32nd annual ACM symposium on user interface software and technology, pp 1031–1043 Huang J, Tian F, Li N, Fan X (2019) Modeling the uncertainty in 2D moving target selection. In: Proceedings of the 32nd annual ACM symposium on user interface software and technology, pp 1031–1043
28.
Zurück zum Zitat Yu D, Liang HN, Lu X, Fan K, Ens B (2019) Modeling endpoint distribution of pointing selection tasks in virtual reality environments. ACM Trans Graphics (TOG) 38(6):1–13CrossRef Yu D, Liang HN, Lu X, Fan K, Ens B (2019) Modeling endpoint distribution of pointing selection tasks in virtual reality environments. ACM Trans Graphics (TOG) 38(6):1–13CrossRef
29.
Zurück zum Zitat Hülsmann, F., Dankert, T, Pfeiffer T (2011) Comparing gaze-based and manual interaction in a fast-paced gaming task in virtual reality. In: Proceedings of the Workshop Virtuelle & Erweiterte Realität 2011 Hülsmann, F., Dankert, T, Pfeiffer T (2011) Comparing gaze-based and manual interaction in a fast-paced gaming task in virtual reality. In: Proceedings of the Workshop Virtuelle & Erweiterte Realität 2011
30.
Zurück zum Zitat Welford, A. T. (1968). Fundamentals of skill Welford, A. T. (1968). Fundamentals of skill
31.
Zurück zum Zitat Murata A (1999) Extending effective target width in Fitts’ law to a two-dimensional pointing task. Int J Human-Comput Interact 11(2):137–152CrossRef Murata A (1999) Extending effective target width in Fitts’ law to a two-dimensional pointing task. Int J Human-Comput Interact 11(2):137–152CrossRef
32.
Zurück zum Zitat Bi X, Li Y, Zhai S (2013) FFitts law: modeling finger touch with fitts' law. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1363–1372 Bi X, Li Y, Zhai S (2013) FFitts law: modeling finger touch with fitts' law. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 1363–1372
33.
Zurück zum Zitat Huang J, Tian F, Fan X, Zhang X, Zhai S (2018) Understanding the uncertainty in 1D unidirectional moving target selection. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–12 Huang J, Tian F, Fan X, Zhang X, Zhai S (2018) Understanding the uncertainty in 1D unidirectional moving target selection. In: Proceedings of the 2018 CHI conference on human factors in computing systems, pp 1–12
34.
Zurück zum Zitat Hornof AJ, Halverson T (2002) Cleaning up systematic error in eye-tracking data by using required fixation locations. Behav Res Methods Instrum Comput 34(4):592–604CrossRef Hornof AJ, Halverson T (2002) Cleaning up systematic error in eye-tracking data by using required fixation locations. Behav Res Methods Instrum Comput 34(4):592–604CrossRef
35.
Zurück zum Zitat Kim J, Kane D, Banks MS (2012) Visual discomfort and the temporal properties of the vergence-accommodation conflict. In: Stereoscopic displays and applications XXIII, Vol. 8288, pp 352–360 SPIE Kim J, Kane D, Banks MS (2012) Visual discomfort and the temporal properties of the vergence-accommodation conflict. In: Stereoscopic displays and applications XXIII, Vol. 8288, pp 352–360 SPIE
36.
Zurück zum Zitat Banks MS, Kim J, Shibata T (2013) Insight into vergence/accommodation mismatch. In: Head-and helmet-mounted displays XVIII: design and applications, Vol. 8735, pp 59–70. SPIE Banks MS, Kim J, Shibata T (2013) Insight into vergence/accommodation mismatch. In: Head-and helmet-mounted displays XVIII: design and applications, Vol. 8735, pp 59–70. SPIE
37.
Zurück zum Zitat Barrera Machuca MD, Stuerzlinger W (2018) Do stereo display deficiencies affect 3D pointing?. In: Extended abstracts of the 2018 CHI conference on human factors in computing systems, pp 1–6 Barrera Machuca MD, Stuerzlinger W (2018) Do stereo display deficiencies affect 3D pointing?. In: Extended abstracts of the 2018 CHI conference on human factors in computing systems, pp 1–6
38.
Zurück zum Zitat Barrera Machuca MD, Stuerzlinger W (2019) The effect of stereo display deficiencies on virtual hand pointing. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–14 Barrera Machuca MD, Stuerzlinger W (2019) The effect of stereo display deficiencies on virtual hand pointing. In: Proceedings of the 2019 CHI conference on human factors in computing systems, pp 1–14
39.
Zurück zum Zitat Batmaz AU, Machuca MDB, Pham DM, Stuerzlinger W (2019) Do head-mounted display stereo deficiencies affect 3D pointing tasks in AR and VR?. In: 2019 IEEE conference on virtual reality and 3D user interfaces (VR), pp 585–592. IEEE Batmaz AU, Machuca MDB, Pham DM, Stuerzlinger W (2019) Do head-mounted display stereo deficiencies affect 3D pointing tasks in AR and VR?. In: 2019 IEEE conference on virtual reality and 3D user interfaces (VR), pp 585–592. IEEE
40.
Zurück zum Zitat Previc FH (1998) The neuropsychology of 3-D space. Psychol Bull 124(2):123CrossRef Previc FH (1998) The neuropsychology of 3-D space. Psychol Bull 124(2):123CrossRef
41.
Zurück zum Zitat Armbrüster C, Wolter M, Kuhlen T, Spijkers W, Fimm B (2008) Depth perception in virtual reality: distance estimations in peri-and extrapersonal space. Cyberpsychol Behav 11(1):9–15CrossRef Armbrüster C, Wolter M, Kuhlen T, Spijkers W, Fimm B (2008) Depth perception in virtual reality: distance estimations in peri-and extrapersonal space. Cyberpsychol Behav 11(1):9–15CrossRef
42.
Zurück zum Zitat Naceri A, Chellali R, Hoinville T (2011) Depth perception within peripersonal space using head-mounted display. Presence Teleop Virtual Environ 20(3):254–272CrossRef Naceri A, Chellali R, Hoinville T (2011) Depth perception within peripersonal space using head-mounted display. Presence Teleop Virtual Environ 20(3):254–272CrossRef
43.
Zurück zum Zitat Bernhard M, Stavrakis E, Hecher M, Wimmer M (2014) Gaze-to-object mapping during visual search in 3d virtual environments. ACM Trans Appl Percept (TAP) 11(3):1–17CrossRef Bernhard M, Stavrakis E, Hecher M, Wimmer M (2014) Gaze-to-object mapping during visual search in 3d virtual environments. ACM Trans Appl Percept (TAP) 11(3):1–17CrossRef
44.
Zurück zum Zitat MacKenzie IS (1992) Fitts’ law as a research and design tool in human-computer interaction. Human-Comput Interact 7(1):91–139CrossRef MacKenzie IS (1992) Fitts’ law as a research and design tool in human-computer interaction. Human-Comput Interact 7(1):91–139CrossRef
Metadaten
Titel
Modeling the gaze point distribution to assist eye-based target selection in head-mounted displays
verfasst von
Ting Lei
Jing Chen
Jixiang Chen
Bo Liu
Publikationsdatum
08.06.2023
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 36/2023
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-023-08705-8

Weitere Artikel der Ausgabe 36/2023

Neural Computing and Applications 36/2023 Zur Ausgabe

S.I.: Evolutionary Computation based Methods and Applications for Data Processing

Dynamic model averaging-based procurement optimization of prefabricated components

S.I.: TC: Evolutionary Computation based Methods and Applications for Data Processing

Structural optimization design of machine tools based on parallel artificial neural networks and genetic algorithms

S.I.: Evolutionary Computation based Methods and Applications for Data Processing

Data-Driven full waveform inversion for ultrasonic bone quantitative imaging

S.I.: Evolutionary Computation based Methods and Applications for Data Processing

X-ray PCB defect automatic diagnosis algorithm based on deep learning and artificial intelligence

S.I.: Evolutionary Computation based Methods and Applications for Data Processing

A graph-based collaborative filtering algorithm combining implicit user preference and explicit time-related feedback

S.I.: Evolutionary Computation based Methods and Applications for Data Processing

Logistic regression prediction models and key influencing factors analysis of diabetes based on algorithm design

Premium Partner