Skip to main content

2014 | OriginalPaper | Buchkapitel

Flexible Bi-modal Control Modes for Hands-Free Operation of a Wheelchair by Head Movements and Facial Expressions

verfasst von : Ericka Janet Rechy-Ramirez, Huosheng Hu

Erschienen in: New Trends in Medical and Service Robots

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Many kinds of head movements and facial expressions based human machine interfaces (HMIs) have been developed for hands-free control of electric-powered wheelchairs in order to assist disabled and elderly people. Most of these HMIs have a fixed configuration and do not allow users to choose a configuration suitable to their needs. It becomes necessary to provide users with different control modes and flexible configurations. This chapter presents five flexible bi-modal modes for hands-free control of a wheelchair that allow users to choose the most comfortable facial expressions and head movements. An Emotiv sensor is deployed to collect facial expressions and head movements for the bi-modal control modes. Two healthy subjects have participated in experiments, and have chosen their best configurations of the modes for controlling the wheelchair. Experimental results show that bi-modal control modes are flexible and allow users to select their preferred configurations for controlling the wheelchair reliably.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Adachi, Y., Kuno, Y., Shimada, N., and Shirai, Y.: Intelligent wheelchair using visual information on human faces. In Intelligent Robots and Systems, pp. 354–359 (1998) Adachi, Y., Kuno, Y., Shimada, N., and Shirai, Y.: Intelligent wheelchair using visual information on human faces. In Intelligent Robots and Systems, pp. 354–359 (1998)
Zurück zum Zitat Barea, R., Boquete, L., Mazo, M., López, E. and Bergasa, L.M.: EOG guidance of a wheelchair using neural networks. In Proc. of the 15th International Conference on Pattern Recognition, 4, 668–671 (2000) Barea, R., Boquete, L., Mazo, M., López, E. and Bergasa, L.M.: EOG guidance of a wheelchair using neural networks. In Proc. of the 15th International Conference on Pattern Recognition, 4, 668–671 (2000)
Zurück zum Zitat Barea, R., Boquete, L., Bergasa, L.M., López, E. and Mazo, M.: Electrooculography guidance of a wheelchair using eye movements codification. The International Journal of Robotics Research, 22 (7-8), 641–652 (2003) Barea, R., Boquete, L., Bergasa, L.M., López, E. and Mazo, M.: Electrooculography guidance of a wheelchair using eye movements codification. The International Journal of Robotics Research, 22 (7-8), 641–652 (2003)
Zurück zum Zitat Bergasa, L.M., Mazo, M., Gardel, A., Barea, R., and Boquete, L.: Commands generation by face movements applied to the guidance of a wheelchair for handicapped people. In Proceedings of the 15th International Conference on Pattern Recognition, 4, 660–663 (2000) Bergasa, L.M., Mazo, M., Gardel, A., Barea, R., and Boquete, L.: Commands generation by face movements applied to the guidance of a wheelchair for handicapped people. In Proceedings of the 15th International Conference on Pattern Recognition, 4, 660–663 (2000)
Zurück zum Zitat Carrino, F., Tscherrig, J., Mugellini, E., Abou Khaled, O. and Ingold, R.: Head-computer interface: a multimodal approach to navigate through real and virtual worlds. Human-Computer Interaction. Interaction techniques and environments. LNCS: Springer, 6762, 222–230 (2011) Carrino, F., Tscherrig, J., Mugellini, E., Abou Khaled, O. and Ingold, R.: Head-computer interface: a multimodal approach to navigate through real and virtual worlds. Human-Computer Interaction. Interaction techniques and environments. LNCS: Springer, 6762, 222–230 (2011)
Zurück zum Zitat Christensen, H.V., and Garcia, J.C.: Infrared non-contact head sensor for control of wheelchair movements. In Proc. of the 8th European Conference for the Advancement of Assistive Technology in Europe, pp. 336–340 (2005) Christensen, H.V., and Garcia, J.C.: Infrared non-contact head sensor for control of wheelchair movements. In Proc. of the 8th European Conference for the Advancement of Assistive Technology in Europe, pp. 336–340 (2005)
Zurück zum Zitat Crisman, E.E., Loomis, A., Shaw, R. and Laszewski, Z.: Using the eye wink control interface to control a powered wheelchair. In Engineering in Medicine and Biology Society: Vol. 13. In Proc. of the Annual International Conference of the IEEE, pp.1821–1822 (1991) Crisman, E.E., Loomis, A., Shaw, R. and Laszewski, Z.: Using the eye wink control interface to control a powered wheelchair. In Engineering in Medicine and Biology Society: Vol. 13. In Proc. of the Annual International Conference of the IEEE, pp.1821–1822 (1991)
Zurück zum Zitat Felzer, T. and Freisleben, B.: HaWCoS: the hands-free wheelchair control system. In Proc. of the fifth international ACM conference on assistive technologies, pp. 127–134 (2002) Felzer, T. and Freisleben, B.: HaWCoS: the hands-free wheelchair control system. In Proc. of the fifth international ACM conference on assistive technologies, pp. 127–134 (2002)
Zurück zum Zitat Firoozabadi, S.M.P., Oskoei, M.A. and Hu, H.: A human-computer Interface based on forehead multi-channel bio-signals to control a virtual wheelchair. In Proc. of the 14th Iranian Conference on Biomedical Engineering, pp. 272–277 (2008) Firoozabadi, S.M.P., Oskoei, M.A. and Hu, H.: A human-computer Interface based on forehead multi-channel bio-signals to control a virtual wheelchair. In Proc. of the 14th Iranian Conference on Biomedical Engineering, pp. 272–277 (2008)
Zurück zum Zitat Gajwani, P.S. and Chhabria, S.A.: Eye motion tracking for wheelchair control. International Journal of Information Technology, 2(2), 185–187 (2010) Gajwani, P.S. and Chhabria, S.A.: Eye motion tracking for wheelchair control. International Journal of Information Technology, 2(2), 185–187 (2010)
Zurück zum Zitat Galán, F., Nuttin, M., Lew, E., Ferrez, P.W., Vanacker, G., Philips, J. and Millán, J.R.: A brain-actuated wheelchair: asynchronous and non-invasive brain–computer interfaces for continuous control of robots. Clinical Neurophysiology, 119(9), 2159–2169 (2008) Galán, F., Nuttin, M., Lew, E., Ferrez, P.W., Vanacker, G., Philips, J. and Millán, J.R.: A brain-actuated wheelchair: asynchronous and non-invasive brain–computer interfaces for continuous control of robots. Clinical Neurophysiology, 119(9), 2159–2169 (2008)
Zurück zum Zitat Gomez-Gil, J., San-Jose-Gonzalez, I., Nicolas-Alonso, L.F. and Alonso-Garcia, S.: Steering a tractor by means of an EMG-based human machine interface. Sensors, 11(7), 7110–7126 (2011) Gomez-Gil, J., San-Jose-Gonzalez, I., Nicolas-Alonso, L.F. and Alonso-Garcia, S.: Steering a tractor by means of an EMG-based human machine interface. Sensors, 11(7), 7110–7126 (2011)
Zurück zum Zitat Han, J.S., Zenn Bien, Z., Kim, D.J., Lee, H.E. and Kim. J.S.: Human machine interface for wheelchair control with EMG and its evaluation. In Engineering in Medicine and Biology Society: Vol. 2. In Proc. of the 25th Annual International Conference of the IEEE, pp.1602–1605 (2003) Han, J.S., Zenn Bien, Z., Kim, D.J., Lee, H.E. and Kim. J.S.: Human machine interface for wheelchair control with EMG and its evaluation. In Engineering in Medicine and Biology Society: Vol. 2. In Proc. of the 25th Annual International Conference of the IEEE, pp.1602–1605 (2003)
Zurück zum Zitat Jia, P., Hu, H., Lu, T. and Yuan, K.: Head gesture recognition for hands-free control of an intelligent wheelchair. Industrial Robot: An International Journal, 34(1), 60–68 (2007) Jia, P., Hu, H., Lu, T. and Yuan, K.: Head gesture recognition for hands-free control of an intelligent wheelchair. Industrial Robot: An International Journal, 34(1), 60–68 (2007)
Zurück zum Zitat Kuo, C.H. , Chan, Y.C., Chou, H.C. and Siao, J.W.: Eyeglasses based electrooculography human-wheelchair interface. In Systems, Man and Cybernetics, pp. 4746–4751 (2009) Kuo, C.H. , Chan, Y.C., Chou, H.C. and Siao, J.W.: Eyeglasses based electrooculography human-wheelchair interface. In Systems, Man and Cybernetics, pp. 4746–4751 (2009)
Zurück zum Zitat Moon, I., Lee, M., Chu, J. and Mun, M.: Wearable EMG-based HCI for electric-powered wheelchair users with motor disabilities. In Proc. of the IEEE International Conference on Robotics and Automation, pp. 2649–2654 (2005) Moon, I., Lee, M., Chu, J. and Mun, M.: Wearable EMG-based HCI for electric-powered wheelchair users with motor disabilities. In Proc. of the IEEE International Conference on Robotics and Automation, pp. 2649–2654 (2005)
Zurück zum Zitat Palankar, M., De Laurentis, K.J., Alqasemi, R., Veras, E., Dubey, R., Arbel, Y. and Donchin, E.: Control of a 9-DoF wheelchair-mounted robotic arm system using a P300 brain computer interface: Initial experiments. In Robotics and Biomimetics, pp. 348–353 (2008) Palankar, M., De Laurentis, K.J., Alqasemi, R., Veras, E., Dubey, R., Arbel, Y. and Donchin, E.: Control of a 9-DoF wheelchair-mounted robotic arm system using a P300 brain computer interface: Initial experiments. In Robotics and Biomimetics, pp. 348–353 (2008)
Zurück zum Zitat Rebsamen, B., Burdet, E., Guan, C., Teo, C.L., Zeng, Q., Ang, M. and Laugier, C.: Controlling a wheelchair using a BCI with low information transfer rate. In Rehabilitation Robotics, pp. 1003–1008 (2007) Rebsamen, B., Burdet, E., Guan, C., Teo, C.L., Zeng, Q., Ang, M. and Laugier, C.: Controlling a wheelchair using a BCI with low information transfer rate. In Rehabilitation Robotics, pp. 1003–1008 (2007)
Zurück zum Zitat Tamura, H., Manabe, T., Goto, T., Yamashita, Y. and Tanno, K.: A study of the electric wheelchair hands-free safety control system using the surface-electromygram of facial muscles. Intelligent Robotics and Applications. LNCS: Springer, 6425, 97–104 (2010) Tamura, H., Manabe, T., Goto, T., Yamashita, Y. and Tanno, K.: A study of the electric wheelchair hands-free safety control system using the surface-electromygram of facial muscles. Intelligent Robotics and Applications. LNCS: Springer, 6425, 97–104 (2010)
Zurück zum Zitat Tsui, C.S.L., Jia, P., Gan, J.Q., Hu, H. and Yuan, K.: EMG-based hands-free wheelchair control with EOG attention shift detection. In IEEE International Conference on Robotics and Biomimetics, pp. 1266–1271 (2007) Tsui, C.S.L., Jia, P., Gan, J.Q., Hu, H. and Yuan, K.: EMG-based hands-free wheelchair control with EOG attention shift detection. In IEEE International Conference on Robotics and Biomimetics, pp. 1266–1271 (2007)
Zurück zum Zitat Wei, L. and Hu, H.: EMG and visual based HMI for hands-free control of an intelligent wheelchair. In 8th World Congress on Intelligent Control and Automation, pp. 1027–1032 (2010) Wei, L. and Hu, H.: EMG and visual based HMI for hands-free control of an intelligent wheelchair. In 8th World Congress on Intelligent Control and Automation, pp. 1027–1032 (2010)
Metadaten
Titel
Flexible Bi-modal Control Modes for Hands-Free Operation of a Wheelchair by Head Movements and Facial Expressions
verfasst von
Ericka Janet Rechy-Ramirez
Huosheng Hu
Copyright-Jahr
2014
DOI
https://doi.org/10.1007/978-3-319-05431-5_8