Skip to main content
Top

2021 | OriginalPaper | Chapter

Real-Time Facial Emotions Analysis in Videos

Authors : Babajee Phavish, Suddul Geerish, Armoogum Sandhya, Foogooa Ravi

Published in: Progress in Advanced Computing and Intelligent Engineering

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Deciphering human facial expressions is an integral part of achieving a seamless human to machine communication. This may assist in various cognitive tasks and convey important information such as emotions, intentions and opinions in a medium where machines can understand beyond the traditional binary form of communication. In this paper, we present a significant progress in this direction. We adapted a machine learning approach based on a neural network to help recognize human facial expressions in real time. With a core revolving around a multi-layered convolutional network responsible to train a model, we were able to successfully detect frontal faces from a video stream and encode, in real time, the seven emotions of joy, disgust, neutral, anger, fear, sadness and surprise.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together (2006) Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together (2006)
2.
go back to reference Babajee, P., Suddul, G., Armoogum, S., Foogooa, R.A.: Machine learning approach for detecting facial expressions. Rev. Bus. Technol. Res. 15 (2019) Babajee, P., Suddul, G., Armoogum, S., Foogooa, R.A.: Machine learning approach for detecting facial expressions. Rev. Bus. Technol. Res. 15 (2019)
3.
go back to reference Turabzadeh, S., Meng, H., Swash, R.M., Pleva, M., Juhar, J.: Real-time emotional state detection from facial expression on embedded devices. In: Proceedings of the 2017 Seventh International Conference on Innovative Computing Technology (INTECH), Luton, UK, pp. 46–51, 16–18 Aug 2017 Turabzadeh, S., Meng, H., Swash, R.M., Pleva, M., Juhar, J.: Real-time emotional state detection from facial expression on embedded devices. In: Proceedings of the 2017 Seventh International Conference on Innovative Computing Technology (INTECH), Luton, UK, pp. 46–51, 16–18 Aug 2017
4.
go back to reference Huang, X., Lin, Y.: A vision-based hybrid method for facial expression recognition. In: The proceedings of the 1st International Conference on Ambient Media and Systems (2008) Huang, X., Lin, Y.: A vision-based hybrid method for facial expression recognition. In: The proceedings of the 1st International Conference on Ambient Media and Systems (2008)
5.
go back to reference Michel, P., Kaliouby, R.E.: Real time facial expression recognition in video using support vector machines. In: Proceedings of ICMI 2003 (2003) Michel, P., Kaliouby, R.E.: Real time facial expression recognition in video using support vector machines. In: Proceedings of ICMI 2003 (2003)
6.
go back to reference Datcu, D., Rothkrantz, L.: Facial expression recognition in still pictures and videos using active appearance model. In: Proceedings of International Conference on Computer Systems and Technologies (CompSysTech’07) (2007) Datcu, D., Rothkrantz, L.: Facial expression recognition in still pictures and videos using active appearance model. In: Proceedings of International Conference on Computer Systems and Technologies (CompSysTech’07) (2007)
7.
go back to reference Shan, K., Guo, J., You, W., Lu, D., Bie, R.: Automatic facial expression recognition based on deep convolutional-neural-network structure. IEEE 15th International Conference on Software Engineering Research, Management and Application, pp. 123–128 (2017) Shan, K., Guo, J., You, W., Lu, D., Bie, R.: Automatic facial expression recognition based on deep convolutional-neural-network structure. IEEE 15th International Conference on Software Engineering Research, Management and Application, pp. 123–128 (2017)
8.
go back to reference Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Paternnal. Mach. Intell. 23(6), 681–685 (2001)CrossRef Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Paternnal. Mach. Intell. 23(6), 681–685 (2001)CrossRef
9.
go back to reference Revina, M., Emmanuel, W.: A survey on human face expression recognition techniques. Department of Computer Science, Christian College, Sunadaranar University, Tirunelveli, Tamil Nadu, India (2018) Revina, M., Emmanuel, W.: A survey on human face expression recognition techniques. Department of Computer Science, Christian College, Sunadaranar University, Tirunelveli, Tamil Nadu, India (2018)
10.
go back to reference Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real-time face detection and expression recognition: development and application to human–computer interaction. In: Proceedings of the CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, Madison, WI (2003) Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real-time face detection and expression recognition: development and application to human–computer interaction. In: Proceedings of the CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, Madison, WI (2003)
11.
go back to reference Goodfellow, I., Erhan, D., Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L. Xu, B., Chuang, Z., Bengio. Y.: Challenges in representation learning: a report on three machine learning contests (2013) Goodfellow, I., Erhan, D., Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L. Xu, B., Chuang, Z., Bengio. Y.: Challenges in representation learning: a report on three machine learning contests (2013)
12.
go back to reference Viola, P., Jones, M.: Robust real-time object detection. Technical Report CRL 20001/01, Cambridge Research-Laboratory (2001) Viola, P., Jones, M.: Robust real-time object detection. Technical Report CRL 20001/01, Cambridge Research-Laboratory (2001)
13.
go back to reference Jayalakshmi, J., Mathew, T.: Facial Expression recognition and emotion classification system for sentiment analysis. Mar Baselios College of Engineering and Technology. Trivandrum, India (2017) Jayalakshmi, J., Mathew, T.: Facial Expression recognition and emotion classification system for sentiment analysis. Mar Baselios College of Engineering and Technology. Trivandrum, India (2017)
14.
go back to reference Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell 22(12), 1424–1445 (2000)CrossRef Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell 22(12), 1424–1445 (2000)CrossRef
15.
go back to reference Theng, B.: Portable Real Time Emotion Detection System for the disabled. Expert Systems with Applications, Malaysia (2010) Theng, B.: Portable Real Time Emotion Detection System for the disabled. Expert Systems with Applications, Malaysia (2010)
Metadata
Title
Real-Time Facial Emotions Analysis in Videos
Authors
Babajee Phavish
Suddul Geerish
Armoogum Sandhya
Foogooa Ravi
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-4299-6_24