Skip to main content

2023 | OriginalPaper | Buchkapitel

Dense SIFT-Based Facial Expression Recognition Using Machine Learning Techniques

verfasst von : S. Vaijayanthi, J. Arunnehru

Erschienen in: Proceedings of the 6th International Conference on Advance Computing and Intelligent Engineering

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Facial analysis is an active research topic in examining the emotional state of humans over the past few decades. It is still a challenging task in computer vision due to its high intra-class variation, head pose, suitable environment conditions like lighting and illumination factors in behaviour prediction and recommendation systems. This paper proposes a novel facial emotion representation approach based on dense descriptors for recognizing facial dynamics on image sequences. Initially, the face is detected using the Haar cascade classifer to extract the temporal information from the facial frame by applying a scale invariant feature transform by combining a bag of visual words. Later, the extracted high-level features are fed to machine learning algorithms to classify the seven emotions from the MUG dataset. The proposed dense SIFT clustering performance was evaluated on four different machine learning algorithms and achieved a high rate of recognition accuracy in all classes. In the experimental results, K-NN exhibits the proposed architecture’s effectiveness with an accuracy rate of 91.8% for the MUG dataset, 89% for SVM, 87.6% for Naive Bayes, and 85.7% decision tree, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang, Y., Chen, F., Lv, S., & Wang, X. (2019). Facial expression recognition: A survey. Symmetry, 11(10), 1189.CrossRef Huang, Y., Chen, F., Lv, S., & Wang, X. (2019). Facial expression recognition: A survey. Symmetry, 11(10), 1189.CrossRef
2.
Zurück zum Zitat Vaijayanthi, S., & Arunnehru, J. (2021). Synthesis approach for emotion recognition from cepstral and pitch coefficients using machine learning. In International Conference on Communication, Computing and Electronics Systems (pp. 515–528). Springer. Vaijayanthi, S., & Arunnehru, J. (2021). Synthesis approach for emotion recognition from cepstral and pitch coefficients using machine learning. In International Conference on Communication, Computing and Electronics Systems (pp. 515–528). Springer.
3.
Zurück zum Zitat Arunnehru, J., & Kalaiselvi Geetha, M. (2017). Automatic human emotion recognition in surveillance video. In Intelligent techniques in signal processing for multimedia security (pp. 321–342). Springer. Arunnehru, J., & Kalaiselvi Geetha, M. (2017). Automatic human emotion recognition in surveillance video. In Intelligent techniques in signal processing for multimedia security (pp. 321–342). Springer.
4.
Zurück zum Zitat Ekman, P., & Rosenberg, E. L. (1997). What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, USA. Ekman, P., & Rosenberg, E. L. (1997). What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press, USA.
5.
Zurück zum Zitat Youssif, A. A. A., & Asker, W. A. A. (2011). Automatic facial expression recognition system based on geometric and appearance features. Computer and Information Science, 4(2), 115.CrossRef Youssif, A. A. A., & Asker, W. A. A. (2011). Automatic facial expression recognition system based on geometric and appearance features. Computer and Information Science, 4(2), 115.CrossRef
6.
Zurück zum Zitat Arunnehru, J., Nandhana Davi, A. K., Raghul Sharan, R., & Nambiar, P. G. (2019). Human pose estimation and activity classification using machine learning approach. In International Conference on Soft Computing and Signal Processing (pp. 113–123). Springer. Arunnehru, J., Nandhana Davi, A. K., Raghul Sharan, R., & Nambiar, P. G. (2019). Human pose estimation and activity classification using machine learning approach. In International Conference on Soft Computing and Signal Processing (pp. 113–123). Springer.
7.
Zurück zum Zitat Arunnehru, J., Kumar, A., & Verma, J. P. (2019). Early prediction of brain tumor classification using convolution neural networks. In International Conference on Computational Intelligence, Security and Internet of Things (pp. 16–25). Springer. Arunnehru, J., Kumar, A., & Verma, J. P. (2019). Early prediction of brain tumor classification using convolution neural networks. In International Conference on Computational Intelligence, Security and Internet of Things (pp. 16–25). Springer.
8.
Zurück zum Zitat Revina, I. M., & Sam Emmanuel, W. R. (2021). A survey on human face expression recognition techniques. Journal of King Saud University-Computer and Information Sciences, 33(6), 619–628. Revina, I. M., & Sam Emmanuel, W. R. (2021). A survey on human face expression recognition techniques. Journal of King Saud University-Computer and Information Sciences, 33(6), 619–628.
9.
Zurück zum Zitat Li, S., Deng, W. (2020). Deep facial expression recognition: A survey. IEEE Transactions on Affective Computing. Li, S., Deng, W. (2020). Deep facial expression recognition: A survey. IEEE Transactions on Affective Computing.
10.
Zurück zum Zitat Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2017). Automatic analysis of facial actions: A survey. IEEE transactions on affective computing, 10(3), 325–347. Martinez, B., Valstar, M. F., Jiang, B., & Pantic, M. (2017). Automatic analysis of facial actions: A survey. IEEE transactions on affective computing, 10(3), 325–347.
11.
Zurück zum Zitat Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020). Facial sentiment analysis using AI techniques: State-of-the-art, taxonomies, and challenges. IEEE Access, 8, 90495–90519.CrossRef Patel, K., Mehta, D., Mistry, C., Gupta, R., Tanwar, S., Kumar, N., & Alazab, M. (2020). Facial sentiment analysis using AI techniques: State-of-the-art, taxonomies, and challenges. IEEE Access, 8, 90495–90519.CrossRef
12.
Zurück zum Zitat Majumder, A., Behera, L., & Subramanian, V. K. (2014). Emotion recognition from geometric facial features using self-organizing map. Pattern Recognition, 47(3), 1282–1293. Majumder, A., Behera, L., & Subramanian, V. K. (2014). Emotion recognition from geometric facial features using self-organizing map. Pattern Recognition, 47(3), 1282–1293.
13.
Zurück zum Zitat Liu, X., Cheng, X., & Lee, K. (2020). Ga-svm-based facial emotion recognition using facial geometric features. IEEE Sensors Journal, 21(10), 11532–11542.CrossRef Liu, X., Cheng, X., & Lee, K. (2020). Ga-svm-based facial emotion recognition using facial geometric features. IEEE Sensors Journal, 21(10), 11532–11542.CrossRef
14.
Zurück zum Zitat Liliana, D. Y., Widyanto, M. R., & Basaruddin, T. (2016). Human emotion recognition based on active appearance model and semi-supervised fuzzy c-means. In 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS) (pp. 439–445). IEEE. Liliana, D. Y., Widyanto, M. R., & Basaruddin, T. (2016). Human emotion recognition based on active appearance model and semi-supervised fuzzy c-means. In 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS) (pp. 439–445). IEEE.
15.
Zurück zum Zitat Kalsum, T., Anwar, S. M., Majid, M., Khan, B., & Ali, S. M. (2018). Emotion recognition from facial expressions using hybrid feature descriptors. IET Image Processing, 12(6), 1004–1012. Kalsum, T., Anwar, S. M., Majid, M., Khan, B., & Ali, S. M. (2018). Emotion recognition from facial expressions using hybrid feature descriptors. IET Image Processing, 12(6), 1004–1012.
16.
Zurück zum Zitat Wang, J. G., Li, J., Lee, C. Y., & Yau, W. Y. (2010). Dense sift and gabor descriptors-based face representation with applications to gender recognition. In 2010 11th International Conference on Control Automation Robotics & Vision (pp. 1860–1864). IEEE. Wang, J. G., Li, J., Lee, C. Y., & Yau, W. Y. (2010). Dense sift and gabor descriptors-based face representation with applications to gender recognition. In 2010 11th International Conference on Control Automation Robotics & Vision (pp. 1860–1864). IEEE.
17.
Zurück zum Zitat Li, C., Qi, Z., Jia, N., & Wu, J. (2017). Human face detection algorithm via haar cascade classifier combined with three additional classifiers. In 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI) (pp. 483–487). IEEE. Li, C., Qi, Z., Jia, N., & Wu, J. (2017). Human face detection algorithm via haar cascade classifier combined with three additional classifiers. In 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI) (pp. 483–487). IEEE.
18.
Zurück zum Zitat Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110. Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 60(2), 91–110.
19.
Zurück zum Zitat Kahou, S. E., Bouthillier, X., Lamblin, P., Gulcehre, C., Michalski, V., Konda, K., Jean, S., Froumenty, P., Dauphin, Y., Boulanger-Lewandowski, N., et al. (2016). Emonets: Multimodal deep learning approaches for emotion recognition in video. Journal on Multimodal User Interfaces, 10(2), 99–111. Kahou, S. E., Bouthillier, X., Lamblin, P., Gulcehre, C., Michalski, V., Konda, K., Jean, S., Froumenty, P., Dauphin, Y., Boulanger-Lewandowski, N., et al. (2016). Emonets: Multimodal deep learning approaches for emotion recognition in video. Journal on Multimodal User Interfaces, 10(2), 99–111.
20.
Zurück zum Zitat Arunnehru, J., Vidhyasagar, B. S., & Basha, H. A. (2020). Plant leaf diseases recognition using convolutional neural network and transfer learning. In International Conference on Communication, Computing and Electronics Systems (pp. 221–229). Springer. Arunnehru, J., Vidhyasagar, B. S., & Basha, H. A. (2020). Plant leaf diseases recognition using convolutional neural network and transfer learning. In International Conference on Communication, Computing and Electronics Systems (pp. 221–229). Springer.
21.
Zurück zum Zitat Arunnehru, J., & Geetha, M. K. (2013). Behavior recognition in surveillance video using temporal features. In 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT) (pp. 1–5). IEEE. Arunnehru, J., & Geetha, M. K. (2013). Behavior recognition in surveillance video using temporal features. In 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT) (pp. 1–5). IEEE.
22.
Zurück zum Zitat Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2018). Survey on emotional body gesture recognition. IEEE Transactions on Affective Computing. Noroozi, F., Corneanu, C. A., Kaminska, D., Sapinski, T., Escalera, S., & Anbarjafari, G. (2018). Survey on emotional body gesture recognition. IEEE Transactions on Affective Computing.
23.
Zurück zum Zitat Aifanti, N., Papachristou, C., & Delopoulos, A. (2010). The mug facial expression database. In 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10 (pp. 1–4). IEEE. Aifanti, N., Papachristou, C., & Delopoulos, A. (2010). The mug facial expression database. In 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10 (pp. 1–4). IEEE.
Metadaten
Titel
Dense SIFT-Based Facial Expression Recognition Using Machine Learning Techniques
verfasst von
S. Vaijayanthi
J. Arunnehru
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-2225-1_27

Neuer Inhalt