Skip to main content

2018 | OriginalPaper | Buchkapitel

Facial Expressions Recognition: Development and Application to HMI

verfasst von : Zekhnine Chérifa, Berrached Nasr Eddine

Erschienen in: Computational Intelligence and Its Applications

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present in this paper, a facial expressions recognition system to command a mobile robot (Pionner-3DX). The proposed system mainly consists of two modules: facial expression recognition and robot command. The first module aims to recognize the facial expressions like happiness, sadness, surprise, anger, fear, disgust and neutral using Gradient Vector Flow (GVF) snake to find ROI (Region Of Interest like: mouth, eyes, eyebrow) segmentation from FEEDTUM database (video file). While the second module, analyses the segmented ROI to recognize with Euclidian distance calculation (compatible with the MPEG-4 description of the six universal emotions) and Time Delay Neural Network classifier. Finally, the recognized facial expressions were used as control commands for the mobile robot displacement (forward; backward; turn left; turn right) in ROS (Robot Operating System).

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mittal, R., Srivastava, P., George, A., Mukherjee, A.: Autonomous robot control using facial expressions. Int. J. Comput. Theory Eng. 4(4), 631 (2012)CrossRef Mittal, R., Srivastava, P., George, A., Mukherjee, A.: Autonomous robot control using facial expressions. Int. J. Comput. Theory Eng. 4(4), 631 (2012)CrossRef
2.
Zurück zum Zitat Ju, D.J.S., Kim, E.Y.: Intelligent wheelchair (IW) interface using face and mouth recognition. IEEE Trans. Circ. Syst. Video Technol. 9(4), 551–564 (1999)CrossRef Ju, D.J.S., Kim, E.Y.: Intelligent wheelchair (IW) interface using face and mouth recognition. IEEE Trans. Circ. Syst. Video Technol. 9(4), 551–564 (1999)CrossRef
3.
Zurück zum Zitat Faria, P.M., Braga, R.A., Valgode, M.E., Reis, L.P.: Interface framework to drive an intelligent wheelchair using facial expressions. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition (FG 1998), Nara, Japan, pp. 124–129 (1998) Faria, P.M., Braga, R.A., Valgode, M.E., Reis, L.P.: Interface framework to drive an intelligent wheelchair using facial expressions. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition (FG 1998), Nara, Japan, pp. 124–129 (1998)
4.
Zurück zum Zitat Shim, B., Kang, K.K., Lee, W.W., Won, S.J.B., Han, S.H.: An intelligent control of mobile robot based on voice command. In: Proceedings of International Conference on Control, Automation and Systems 2010, South Korea, p. 2107 (2010) Shim, B., Kang, K.K., Lee, W.W., Won, S.J.B., Han, S.H.: An intelligent control of mobile robot based on voice command. In: Proceedings of International Conference on Control, Automation and Systems 2010, South Korea, p. 2107 (2010)
5.
Zurück zum Zitat Irfan, E., Pentland, A.: Coding, analysis interpretation and recognition of facial expressions. IEEE Trans. PAMI 19, 757–763 (1997)CrossRef Irfan, E., Pentland, A.: Coding, analysis interpretation and recognition of facial expressions. IEEE Trans. PAMI 19, 757–763 (1997)CrossRef
6.
Zurück zum Zitat Black, M.J., Yacoob, Y.: Recognizing facial expressions in image sequences using local parametrized models of image motion. Int. J. Comput. Vis. 25(1), 23–48 (1997)CrossRef Black, M.J., Yacoob, Y.: Recognizing facial expressions in image sequences using local parametrized models of image motion. Int. J. Comput. Vis. 25(1), 23–48 (1997)CrossRef
7.
Zurück zum Zitat Tian, Y., Kanade, T., Cohn, J.: Recognition actions units for facial expression analysis. IEEE Trans. PAMI 23(2), 97–115 (2001)CrossRef Tian, Y., Kanade, T., Cohn, J.: Recognition actions units for facial expression analysis. IEEE Trans. PAMI 23(2), 97–115 (2001)CrossRef
8.
Zurück zum Zitat Lanitis, A., Taylor, C.J., Coots, T.F.: Automatic interpretation and coding of faces images using flexible models. IEEE Trans. PAMI 19(7), 743–756 (1997)CrossRef Lanitis, A., Taylor, C.J., Coots, T.F.: Automatic interpretation and coding of faces images using flexible models. IEEE Trans. PAMI 19(7), 743–756 (1997)CrossRef
9.
Zurück zum Zitat Shinza, Y., Saito, Y., Kenmochi, Y., Kotani, K.: Facial expression analysis by integrating information of feature-point positions and grey levels of facial images. In: IEEE ICIP, Vancouver, Canada (2000). 2(5), 99–110 (2016) Shinza, Y., Saito, Y., Kenmochi, Y., Kotani, K.: Facial expression analysis by integrating information of feature-point positions and grey levels of facial images. In: IEEE ICIP, Vancouver, Canada (2000). 2(5), 99–110 (2016)
10.
Zurück zum Zitat Zekhnine, C., Berrached, N.E.: Realization of facial expressions recognition system by MLP neural network. In: Fifth Conference on Electric Engineering, Polytechnic Military School, Bordj El Bahri, Algiers, Algeria (2005) Zekhnine, C., Berrached, N.E.: Realization of facial expressions recognition system by MLP neural network. In: Fifth Conference on Electric Engineering, Polytechnic Military School, Bordj El Bahri, Algiers, Algeria (2005)
12.
Zurück zum Zitat Zekhnine, C., Berrached, N.E.: Command of an arm manipulator robot by facial expression. In: Second International Conference on Image and Signal Processing and Their Applications. University Mohamed Khider of Biskra, Algeria (2010) Zekhnine, C., Berrached, N.E.: Command of an arm manipulator robot by facial expression. In: Second International Conference on Image and Signal Processing and Their Applications. University Mohamed Khider of Biskra, Algeria (2010)
13.
Zurück zum Zitat Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. IJCV 1(4), 321–331 (1988)CrossRef Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. IJCV 1(4), 321–331 (1988)CrossRef
14.
Zurück zum Zitat Cohen, I.: Modèles Déformables 2-D et 3-D: Application à la Segmentation d’Images Médicales (1992) Cohen, I.: Modèles Déformables 2-D et 3-D: Application à la Segmentation d’Images Médicales (1992)
15.
Zurück zum Zitat Vylder, J.D., Ochoa, D., Wilfried, P., Chaerle, L., Van Der Straeten, D.: Tracking multiple objects using intensity-GVF snakes. In: EUSIPCO (2009) Vylder, J.D., Ochoa, D., Wilfried, P., Chaerle, L., Van Der Straeten, D.: Tracking multiple objects using intensity-GVF snakes. In: EUSIPCO (2009)
16.
Zurück zum Zitat Xu, C., Pince, J.L.: Generalized gradient vector flow external forces for active contours. Sig. Process. 71, 131–139 (1998)CrossRef Xu, C., Pince, J.L.: Generalized gradient vector flow external forces for active contours. Sig. Process. 71, 131–139 (1998)CrossRef
17.
Zurück zum Zitat Hammal, Z., Caplier, A., Rombaut, M.: Classification d’expressions faciales par la théorie de l’évidence. LIS INPG, Grenoble (2004) Hammal, Z., Caplier, A., Rombaut, M.: Classification d’expressions faciales par la théorie de l’évidence. LIS INPG, Grenoble (2004)
Metadaten
Titel
Facial Expressions Recognition: Development and Application to HMI
verfasst von
Zekhnine Chérifa
Berrached Nasr Eddine
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-89743-1_49