Skip to main content
main-content

Tipp

Weitere Kapitel dieses Buchs durch Wischen aufrufen

2021 | OriginalPaper | Buchkapitel

Real-Time Facial Emotions Analysis in Videos

verfasst von: Babajee Phavish, Suddul Geerish, Armoogum Sandhya, Foogooa Ravi

Erschienen in: Progress in Advanced Computing and Intelligent Engineering

Verlag: Springer Singapore

share
TEILEN

Abstract

Deciphering human facial expressions is an integral part of achieving a seamless human to machine communication. This may assist in various cognitive tasks and convey important information such as emotions, intentions and opinions in a medium where machines can understand beyond the traditional binary form of communication. In this paper, we present a significant progress in this direction. We adapted a machine learning approach based on a neural network to help recognize human facial expressions in real time. With a core revolving around a multi-layered convolutional network responsible to train a model, we were able to successfully detect frontal faces from a video stream and encode, in real time, the seven emotions of joy, disgust, neutral, anger, fear, sadness and surprise.

Sie möchten Zugang zu diesem Inhalt erhalten? Dann informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 69.000 Bücher
  • über 500 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Testen Sie jetzt 15 Tage kostenlos.

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 50.000 Bücher
  • über 380 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




Testen Sie jetzt 15 Tage kostenlos.

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 58.000 Bücher
  • über 300 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Testen Sie jetzt 15 Tage kostenlos.

Literatur
1.
Zurück zum Zitat Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together (2006) Sebanz, N., Bekkering, H., Knoblich, G.: Joint action: bodies and minds moving together (2006)
2.
Zurück zum Zitat Babajee, P., Suddul, G., Armoogum, S., Foogooa, R.A.: Machine learning approach for detecting facial expressions. Rev. Bus. Technol. Res. 15 (2019) Babajee, P., Suddul, G., Armoogum, S., Foogooa, R.A.: Machine learning approach for detecting facial expressions. Rev. Bus. Technol. Res. 15 (2019)
3.
Zurück zum Zitat Turabzadeh, S., Meng, H., Swash, R.M., Pleva, M., Juhar, J.: Real-time emotional state detection from facial expression on embedded devices. In: Proceedings of the 2017 Seventh International Conference on Innovative Computing Technology (INTECH), Luton, UK, pp. 46–51, 16–18 Aug 2017 Turabzadeh, S., Meng, H., Swash, R.M., Pleva, M., Juhar, J.: Real-time emotional state detection from facial expression on embedded devices. In: Proceedings of the 2017 Seventh International Conference on Innovative Computing Technology (INTECH), Luton, UK, pp. 46–51, 16–18 Aug 2017
4.
Zurück zum Zitat Huang, X., Lin, Y.: A vision-based hybrid method for facial expression recognition. In: The proceedings of the 1st International Conference on Ambient Media and Systems (2008) Huang, X., Lin, Y.: A vision-based hybrid method for facial expression recognition. In: The proceedings of the 1st International Conference on Ambient Media and Systems (2008)
5.
Zurück zum Zitat Michel, P., Kaliouby, R.E.: Real time facial expression recognition in video using support vector machines. In: Proceedings of ICMI 2003 (2003) Michel, P., Kaliouby, R.E.: Real time facial expression recognition in video using support vector machines. In: Proceedings of ICMI 2003 (2003)
6.
Zurück zum Zitat Datcu, D., Rothkrantz, L.: Facial expression recognition in still pictures and videos using active appearance model. In: Proceedings of International Conference on Computer Systems and Technologies (CompSysTech’07) (2007) Datcu, D., Rothkrantz, L.: Facial expression recognition in still pictures and videos using active appearance model. In: Proceedings of International Conference on Computer Systems and Technologies (CompSysTech’07) (2007)
7.
Zurück zum Zitat Shan, K., Guo, J., You, W., Lu, D., Bie, R.: Automatic facial expression recognition based on deep convolutional-neural-network structure. IEEE 15th International Conference on Software Engineering Research, Management and Application, pp. 123–128 (2017) Shan, K., Guo, J., You, W., Lu, D., Bie, R.: Automatic facial expression recognition based on deep convolutional-neural-network structure. IEEE 15th International Conference on Software Engineering Research, Management and Application, pp. 123–128 (2017)
8.
Zurück zum Zitat Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Paternnal. Mach. Intell. 23(6), 681–685 (2001) CrossRef Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Paternnal. Mach. Intell. 23(6), 681–685 (2001) CrossRef
9.
Zurück zum Zitat Revina, M., Emmanuel, W.: A survey on human face expression recognition techniques. Department of Computer Science, Christian College, Sunadaranar University, Tirunelveli, Tamil Nadu, India (2018) Revina, M., Emmanuel, W.: A survey on human face expression recognition techniques. Department of Computer Science, Christian College, Sunadaranar University, Tirunelveli, Tamil Nadu, India (2018)
10.
Zurück zum Zitat Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real-time face detection and expression recognition: development and application to human–computer interaction. In: Proceedings of the CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, Madison, WI (2003) Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R.: Real-time face detection and expression recognition: development and application to human–computer interaction. In: Proceedings of the CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, Madison, WI (2003)
11.
Zurück zum Zitat Goodfellow, I., Erhan, D., Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L. Xu, B., Chuang, Z., Bengio. Y.: Challenges in representation learning: a report on three machine learning contests (2013) Goodfellow, I., Erhan, D., Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Lee, D., Zhou, Y., Ramaiah, C., Feng, F., Li, R., Wang, X., Athanasakis, D., Shawe-Taylor, J., Milakov, M., Park, J., Ionescu, R., Popescu, M., Grozea, C., Bergstra, J., Xie, J., Romaszko, L. Xu, B., Chuang, Z., Bengio. Y.: Challenges in representation learning: a report on three machine learning contests (2013)
12.
Zurück zum Zitat Viola, P., Jones, M.: Robust real-time object detection. Technical Report CRL 20001/01, Cambridge Research-Laboratory (2001) Viola, P., Jones, M.: Robust real-time object detection. Technical Report CRL 20001/01, Cambridge Research-Laboratory (2001)
13.
Zurück zum Zitat Jayalakshmi, J., Mathew, T.: Facial Expression recognition and emotion classification system for sentiment analysis. Mar Baselios College of Engineering and Technology. Trivandrum, India (2017) Jayalakshmi, J., Mathew, T.: Facial Expression recognition and emotion classification system for sentiment analysis. Mar Baselios College of Engineering and Technology. Trivandrum, India (2017)
14.
Zurück zum Zitat Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell 22(12), 1424–1445 (2000) CrossRef Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell 22(12), 1424–1445 (2000) CrossRef
15.
Zurück zum Zitat Theng, B.: Portable Real Time Emotion Detection System for the disabled. Expert Systems with Applications, Malaysia (2010) Theng, B.: Portable Real Time Emotion Detection System for the disabled. Expert Systems with Applications, Malaysia (2010)
Metadaten
Titel
Real-Time Facial Emotions Analysis in Videos
verfasst von
Babajee Phavish
Suddul Geerish
Armoogum Sandhya
Foogooa Ravi
Copyright-Jahr
2021
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-33-4299-6_24