Skip to main content
Top

2020 | OriginalPaper | Chapter

Tracking Changing Human Emotions from Facial Image Sequence by Landmark Triangulation: An Incircle-Circumcircle Duo Approach

Authors : Md Nasir, Paramartha Dutta, Avishek Nandi

Published in: Algorithms in Machine Learning Paradigms

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Intelligent recognition of human emotions from face images is a challenging proposition in the field of affective computing which becomes even more difficult when one has to deal with characterizing the nature of transition of human emotion from a relevant sequence of face images. In the present scope, we considered a triangulation mechanism derived from the landmark points of the face images. Resulting in a number of triangle formulations which are found to be sensitive to different emotions like anger, disgust, fear, happiness, sadness, and surprise. Accordingly a pair of circles, viz, incircle and circumcircle corresponding to these triangles are taken into account and geometric features arising out of such pair are utilized for classification of different emotional transitions from various face image sequences. Results of the proposed method obtained by application on various benchmark image databases are found to be quite impressive and encouraging compared to existing state-of-the-art technique.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aifanti N, Papachristou C, Delopoulos A (2010) The mug facial expression database. In: Proceedings of the 11th international workshop on image analysis for multimedia interactive services WIAMIS 10. IEEE, pp 1–4 Aifanti N, Papachristou C, Delopoulos A (2010) The mug facial expression database. In: Proceedings of the 11th international workshop on image analysis for multimedia interactive services WIAMIS 10. IEEE, pp 1–4
2.
go back to reference Boughrara H, Chtourou M, Amar CB, Chen L (2016) Facial expression recognition based on a mlp neural network using constructive training algorithm. Multimed Tools Appl 75(2):709–731CrossRef Boughrara H, Chtourou M, Amar CB, Chen L (2016) Facial expression recognition based on a mlp neural network using constructive training algorithm. Multimed Tools Appl 75(2):709–731CrossRef
3.
go back to reference Collier G (1985) Emotional expression. Laurence Erlbaum Associates Inc, Publishers, Billsdale, NJ Collier G (1985) Emotional expression. Laurence Erlbaum Associates Inc, Publishers, Billsdale, NJ
4.
go back to reference Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 6:681–685CrossRef Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 6:681–685CrossRef
5.
go back to reference Ding Y, Zhao Q, Li B, Yuan X (2017) Facial expression recognition from image sequence based on lbp and taylor expansion. IEEE Access 5:19409–19419CrossRef Ding Y, Zhao Q, Li B, Yuan X (2017) Facial expression recognition from image sequence based on lbp and taylor expansion. IEEE Access 5:19409–19419CrossRef
6.
go back to reference Ekman P (2004) Emotions revealed. BMJ 328(Suppl S5):0405184 Ekman P (2004) Emotions revealed. BMJ 328(Suppl S5):0405184
7.
go back to reference Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Personal Soc Psychol 17(2):124CrossRef Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Personal Soc Psychol 17(2):124CrossRef
8.
go back to reference Ghimire D, Lee J (2013) Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines. Sensors 13(6):7714–7734CrossRef Ghimire D, Lee J (2013) Geometric feature-based facial expression recognition in image sequences using multi-class adaboost and support vector machines. Sensors 13(6):7714–7734CrossRef
9.
go back to reference Goyal R, Mittal T (2014) Facial expression recognition using artificial neural network. HCTL Open Int J Technol Innov Res 10:1–10 Goyal R, Mittal T (2014) Facial expression recognition using artificial neural network. HCTL Open Int J Technol Innov Res 10:1–10
10.
go back to reference Lajevardi SM, Lech M (2008) Facial expression recognition from image sequences using optimized feature selection. In: Proceedings of the 2008 23rd international conference image and vision computing New Zealand. IEEE, pp 1–6 Lajevardi SM, Lech M (2008) Facial expression recognition from image sequences using optimized feature selection. In: Proceedings of the 2008 23rd international conference image and vision computing New Zealand. IEEE, pp 1–6
11.
go back to reference Lu K, Zhang X (2010) Facial expression recognition from image sequences based on feature points and canonical correlations. In: Proceedings of the 2010 international conference on artificial intelligence and computational intelligence, vol 1. IEEE, pp 219–223 Lu K, Zhang X (2010) Facial expression recognition from image sequences based on feature points and canonical correlations. In: Proceedings of the 2010 international conference on artificial intelligence and computational intelligence, vol 1. IEEE, pp 219–223
12.
go back to reference Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In: Proceedings of the 2010 IEEE computer society conference on computer vision and pattern recognition-workshops. IEEE, pp 94–101 Lucey P, Cohn JF, Kanade T, Saragih J, Ambadar Z, Matthews I (2010) The extended cohn-kanade dataset (ck+): a complete dataset for action unit and emotion-specified expression. In: Proceedings of the 2010 IEEE computer society conference on computer vision and pattern recognition-workshops. IEEE, pp 94–101
13.
go back to reference Manstead AS, Fischer AH (2002) Beyond the universality-specificity dichotomy. Cogn Emot 16(1):1–9CrossRef Manstead AS, Fischer AH (2002) Beyond the universality-specificity dichotomy. Cogn Emot 16(1):1–9CrossRef
14.
go back to reference Mehrabian A (2007) Nonverbal communication. New Brunswick Mehrabian A (2007) Nonverbal communication. New Brunswick
15.
go back to reference Sagonas C, Antonakos E, Tzimiropoulos G, Zafeiriou S, Pantic M (2016) 300 faces in-the-wild challenge: database and results. Image Vis Comput 47:3–18CrossRef Sagonas C, Antonakos E, Tzimiropoulos G, Zafeiriou S, Pantic M (2016) 300 faces in-the-wild challenge: database and results. Image Vis Comput 47:3–18CrossRef
16.
go back to reference Samal A, Iyengar PA (1992) Automatic recognition and analysis of human faces and facial expressions: a survey. Pattern Recognit 25(1):65–77CrossRef Samal A, Iyengar PA (1992) Automatic recognition and analysis of human faces and facial expressions: a survey. Pattern Recognit 25(1):65–77CrossRef
17.
go back to reference Tie Y, Guan L (2013) Automatic landmark point detection and tracking for human facial expressions. EURASIP J Image Video Process 2013(1):8CrossRef Tie Y, Guan L (2013) Automatic landmark point detection and tracking for human facial expressions. EURASIP J Image Video Process 2013(1):8CrossRef
18.
go back to reference Tzimiropoulos G, Pantic M (2013) Optimization problems for fast AAM fitting in-the-wild. In: Proceedings of the IEEE international conference on computer vision, pp 593–600 Tzimiropoulos G, Pantic M (2013) Optimization problems for fast AAM fitting in-the-wild. In: Proceedings of the IEEE international conference on computer vision, pp 593–600
19.
go back to reference Uddin MZ, Hassan MM, Almogren A, Alamri A, Alrubaian M, Fortino G (2017) Facial expression recognition utilizing local direction-based robust features and deep belief network. IEEE Access 5:4525–4536CrossRef Uddin MZ, Hassan MM, Almogren A, Alamri A, Alrubaian M, Fortino G (2017) Facial expression recognition utilizing local direction-based robust features and deep belief network. IEEE Access 5:4525–4536CrossRef
20.
go back to reference Valstar M, Pantic M (2010) Induced disgust, happiness and surprise: an addition to the mmi facial expression database. In: Proceedings of the 3rd international workshop on EMOTION (satellite of LREC): corpora for research on emotion and affect, Paris, France, p 65 Valstar M, Pantic M (2010) Induced disgust, happiness and surprise: an addition to the mmi facial expression database. In: Proceedings of the 3rd international workshop on EMOTION (satellite of LREC): corpora for research on emotion and affect, Paris, France, p 65
21.
go back to reference Yaddaden Y, Adda M, Bouzouane A, Gaboury S, Bouchard B (2017) Facial expression recognition from video using geometric features Yaddaden Y, Adda M, Bouzouane A, Gaboury S, Bouchard B (2017) Facial expression recognition from video using geometric features
22.
go back to reference Zhang L, Tjondronegoro D (2011) Facial expression recognition using facial movement features. IEEE Trans Affect Comput 2(4):219–229 Zhang L, Tjondronegoro D (2011) Facial expression recognition using facial movement features. IEEE Trans Affect Comput 2(4):219–229
Metadata
Title
Tracking Changing Human Emotions from Facial Image Sequence by Landmark Triangulation: An Incircle-Circumcircle Duo Approach
Authors
Md Nasir
Paramartha Dutta
Avishek Nandi
Copyright Year
2020
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-1041-0_8

Premium Partners