Top

Published in:

2022 | OriginalPaper | Chapter

Learning a Head-Tracking Pointing Interface

Authors : Muratcan Cicek, Roberto Manduchi

Published in: Computers Helping People with Special Needs

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

For people with poor upper limb mobility or control, interaction with a computer may be facilitated by adaptive and alternative interfaces. Visual head tracking has proven to be a viable pointing interface, which can be used when use of the mouse or trackpad is challenging. We are interested in new mechanisms to map the user’s head motion to a pointer location on the screen. Towards this goal, we collected a data set of videos of participants as they were moving their head while following the motion of a marker on the screen. This data set could be used to training a machine learning system for pointing interface. We believe that by learning on real examples, this system may provide a more natural and satisfactory interface than current systems based on pre-defined algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Pardon? An Overview of the Current State and Requirements of Voice User Interfaces for Blind and Visually Impaired Users

next chapter Cognitive Disabilities and Accessibility

Bates, R., Istance, H.O.: Why are eye mice unpopular? A detailed comparison of head and eye controlled assistive technology pointing devices. Univers. Access Inf. Soc. 2(3), 280–290 (2003)CrossRef

Betke, M., Gips, J., Fleming, P.: The camera mouse: visual tracking of body features to provide computer access for people with severe disabilities. IEEE Trans. Neural Syst. Rehabil. Eng. 10(1), 1–10 (2002)CrossRef

of Boston College, T.: Cameramouse (2018). http://www.cameramouse.org/. Accessed 31 Jan 2022

Cicek, M., Dave, A., Feng, W., Huang, M.X., Haines, J.K., Nichols, J.: Designing and evaluating head-based pointing on smartphones for people with motor impairments. In: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2020 (2020)

Cicek, M., Xie, J., Wang, Q., Piramuthu, R.: Mobile head tracking for ecommerce and beyond. Electron. Imaging 2020(3), 303–1 (2020)CrossRef

Corporation, O.I.: Headmouse nano (2017). http://www.orin.com/access/headmouse/. Accessed 31 Jan 2022

Deng, J., Guo, J., Zhou, Y., Yu, J., Kotsia, I., Zafeiriou, S.: Retinaface: single-stage dense face localisation in the wild. CoRR (2019). http://arxiv.org/abs/1905.00641

Fanelli, G., Gall, J., Van Gool, L.: Real time head pose estimation with random regression forests. In: CVPR 2011, pp. 617–624. IEEE (2011)

Gizatdinova, Y., Špakov, O., Surakka, V.: Comparison of video-based pointing and selection techniques for hands-free text entry. In: Proceedings of the ACM International Working Conference on Advanced Visual Interfaces, pp. 132–139 (2012)

10.

Glassouse: Glassouse assistive device (2018). http://glassouse.com/. Accessed 17 July 2018

11.

Guo, X., et al.: PFLD: a practical facial landmark detector. CoRR (2019). http://arxiv.org/abs/1902.10859

12.

Inc., A.: Use switch control to navigate your iphone, ipad, or ipod touch (2018). https://support.apple.com/en-us/ht201370. Accessed 15 July 2018

13.

Kytö, M., Ens, B., Piumsomboon, T., Lee, G.A., Billinghurst, M.: Pinpointing: precise head-and eye-based target selection for augmented reality. In: Proceedings of the 2018 ACM CHI Conference on Human Factors in Computing Systems, p. 81 (2018)

14.

Li, J., et al.: DSFD: dual shot face detector. CoRR (2018). http://arxiv.org/abs/1810.10220

15.

LLC, P.D.: Smylemouse (2016). https://smylemouse.com/. Accessed 31 Jan 2022

16.

Majaranta, P.: Gaze Interaction and Applications of Eye Tracking: Advances in Assistive Technologies: Advances in Assistive Technologies. IGI Global (2011). https://doi.org/10.4018/978-1-61350-098-9

17.

Mauri, C.: Enable viacam (2017). http://eviacam.crea-si.com/index.php. Accessed 31 Jan 2022

18.

Mauri, C.: Eva facial mouse (2018). https://github.com/cmauri/eva_facial_mouse. Accessed 31 Jan 2022

19.

MyGaze: Mygaze assistive (2018). http://www.mygaze.com/products/mygaze-assistive/. Accessed 16 July 2018

20.

Oy, Q.: Quha zono (2018). http://www.quha.com/products-2/zono/. Accessed 15 July 2018

21.

Polacek, O., Grill, T., Tscheligi, M.: Nosetapping: what else can you do with your nose? In: Proceedings of the 12th ACM International Conference on Mobile and Ubiquitous Multimedia (2013)

22.

Ruiz, N., Chong, E., Rehg, J.M.: Fine-grained head pose estimation without keypoints. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 2074–2083 (2018)

23.

Tang, X., Du, D.K., He, Z., Liu, J.: Pyramidbox: a context-assisted single shot face detector. CoRR (2018). http://arxiv.org/abs/1803.07737

24.

Turturici, M., Fanucci, L.: Inertial human interface device for smartphone and tablet dedicated to people with motor disability. In: Volume 33: Assistive Technology: From Research to Practice. Assistive Technology Research Series (2013). https://doi.org/10.3233/978-1-61499-304-9-494

25.

Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, pp. I-I. IEEE (2001)

26.

Wang, X., Bo, L., Li, F.: Adaptive wing loss for robust face alignment via heatmap regression. CoRR (2019). http://arxiv.org/abs/1904.07399

27.

Wu, W., Qian, C., Yang, S., Wang, Q., Cai, Y., Zhou, Q.: Look at boundary: a boundary-aware face alignment algorithm. CoRR (2018). http://arxiv.org/abs/1805.10483

28.

Yang, T.Y., Chen, Y.T., Lin, Y.Y., Chuang, Y.Y.: Fsa-net: learning fine-grained structure aggregation for head pose estimation from a single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1087–1096 (2019)

Title: Learning a Head-Tracking Pointing Interface
Authors: Muratcan Cicek
Roberto Manduchi
Publisher: Springer International Publishing
Book: Computers Helping People with Special Needs
Print ISBN: 978-3-031-08647-2

Electronic ISBN: 978-3-031-08648-9

Copyright Year: 2022
DOI: https://doi.org/10.1007/978-3-031-08648-9_46

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"