Skip to main content
Erschienen in: Soft Computing 13/2018

19.05.2017 | Methodologies and Application

Facial expression recognition using a combination of multiple facial features and support vector machine

verfasst von: Hung-Hsu Tsai, Yi-Cheng Chang

Erschienen in: Soft Computing | Ausgabe 13/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a novel facial expression recognition (FER) technique based on support vector machine (SVM) for the FER. Here it is called the FERS technique. First, the FERS technique develops a face detection method that combines the Haar-like features method with the self-quotient image (SQI) filter. As a result, the FERS technique possesses better detection rate because the face detection method gets more accurate in locating face regions of an image. The main reason is that the SQI filter can overcome the insufficient light and shade light. Subsequently, three schemes, the angular radial transform (ART), the discrete cosine transform (DCT) and the Gabor filter (GF), are simultaneously employed in the design of the feature extraction for facial expression in the FERS technique. More specifically, they are employed in constructing a set of training patterns for the training of an SVM. The FERS technique then exploits the trained SVM to recognize the facial expression for a query face image. Finally, experimental results show that the recognition performance of the FERS technique can be better than that of other existing methods under consideration in the paper.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Burges CJC (1998) A Tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef Burges CJC (1998) A Tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef
Zurück zum Zitat Chai Z, Vazquez MH, He R, Sun Z, Tan T (2014) Explore semantic pixel sets based local patterns with information entropy for face recognition. EURASIP J Image Video Process 26:1–11 Chai Z, Vazquez MH, He R, Sun Z, Tan T (2014) Explore semantic pixel sets based local patterns with information entropy for face recognition. EURASIP J Image Video Process 26:1–11
Zurück zum Zitat Chen HY, Huang CL, Fu CM (2008) Hybrid-boost learning for multi-pose face detection and facial expression recognition. Pattern Recogn 41:1173–1185CrossRefMATH Chen HY, Huang CL, Fu CM (2008) Hybrid-boost learning for multi-pose face detection and facial expression recognition. Pattern Recogn 41:1173–1185CrossRefMATH
Zurück zum Zitat Cheng K, Chen Y, Zhan Y (2008) A new approach for facial expression recognition based on Burial Markov model. In: Proceedings of the fifth international conference on fuzzy systems and knowledge discovery, pp 3–9 Cheng K, Chen Y, Zhan Y (2008) A new approach for facial expression recognition based on Burial Markov model. In: Proceedings of the fifth international conference on fuzzy systems and knowledge discovery, pp 3–9
Zurück zum Zitat Fang J, Qiu G (2003) Human face detection using angular radial transform and support vector machines. In: Proceedings of international conference on image processing, pp 669–672 Fang J, Qiu G (2003) Human face detection using angular radial transform and support vector machines. In: Proceedings of international conference on image processing, pp 669–672
Zurück zum Zitat Fellenz WA, Taylor JG, Tsapatsoulis N, Kollias S (1999) Comparing template-based, feature-based and supervised classification of facial expressions from static images. In: Proceedings of circuits systems, communications and computers, pp 5331–5336 Fellenz WA, Taylor JG, Tsapatsoulis N, Kollias S (1999) Comparing template-based, feature-based and supervised classification of facial expressions from static images. In: Proceedings of circuits systems, communications and computers, pp 5331–5336
Zurück zum Zitat Haykin S (1995) Neural networks: a comprehensive foundation. Macmillan College Publishing Company, New YorkMATH Haykin S (1995) Neural networks: a comprehensive foundation. Macmillan College Publishing Company, New YorkMATH
Zurück zum Zitat Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE international conference on automatic face and gesture recognition, pp 46–53 Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE international conference on automatic face and gesture recognition, pp 46–53
Zurück zum Zitat Kharat GU, Dudul SV (2008) Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques. WSEAS Trans Comput 7:650–659 Kharat GU, Dudul SV (2008) Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques. WSEAS Trans Comput 7:650–659
Zurück zum Zitat Kim DH, Jung SU, Chung MJ (2008) Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn Lett 29:1621–1631CrossRef Kim DH, Jung SU, Chung MJ (2008) Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn Lett 29:1621–1631CrossRef
Zurück zum Zitat Kotsia I, Zafeiriou S, Pitas I (2008) Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recogn 41:833–851CrossRefMATH Kotsia I, Zafeiriou S, Pitas I (2008) Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recogn 41:833–851CrossRefMATH
Zurück zum Zitat Lajevardi SM, Hussain ZM (2012) Automatic facial expression recognition: feature extraction and selection. SIViP 6:159–169CrossRef Lajevardi SM, Hussain ZM (2012) Automatic facial expression recognition: feature extraction and selection. SIViP 6:159–169CrossRef
Zurück zum Zitat Lee JJ, Uddin MZ, Kim TS (2008) Spatiotemporal human facial expression recognition using fisher independent component analysis and Hidden Markov Model. In: Proceedings of the 30th annual international IEEE EMBS conference, Vancouver, British Columbia, pp 2546–2549 Lee JJ, Uddin MZ, Kim TS (2008) Spatiotemporal human facial expression recognition using fisher independent component analysis and Hidden Markov Model. In: Proceedings of the 30th annual international IEEE EMBS conference, Vancouver, British Columbia, pp 2546–2549
Zurück zum Zitat Liu W, Wang Z (2006) Facial expression recognition based on fusion of multiple Gabor features. In: Proceedings of the 18th international conference on pattern recognition, pp 536–539 Liu W, Wang Z (2006) Facial expression recognition based on fusion of multiple Gabor features. In: Proceedings of the 18th international conference on pattern recognition, pp 536–539
Zurück zum Zitat Loh MP, Wong YP, Wong CO (2006) Facial expression recognition for e-Learning systems using Gabor wavelet & neural network. In: Proceedings of the sixth international conference on advanced learning technologies, pp 523–525 Loh MP, Wong YP, Wong CO (2006) Facial expression recognition for e-Learning systems using Gabor wavelet & neural network. In: Proceedings of the sixth international conference on advanced learning technologies, pp 523–525
Zurück zum Zitat Mita T, Kaneko T, Hori O (2005) Joint haar-like features for face detection. In: Proceedings of the tenth IEEE international conference on computer vision, pp 1619–1626 Mita T, Kaneko T, Hori O (2005) Joint haar-like features for face detection. In: Proceedings of the tenth IEEE international conference on computer vision, pp 1619–1626
Zurück zum Zitat Rowley HA, Baluja S, Kanade T (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20:23–38CrossRef Rowley HA, Baluja S, Kanade T (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20:23–38CrossRef
Zurück zum Zitat Saeed I, Wang A, Senaratne R, Halgamuge S (2007) Using the active appearance model to detect driver fatigue. In: Proceedings of the third international conference on information and automation for sustainability, pp 124–128 Saeed I, Wang A, Senaratne R, Halgamuge S (2007) Using the active appearance model to detect driver fatigue. In: Proceedings of the third international conference on information and automation for sustainability, pp 124–128
Zurück zum Zitat Shih P, Liu C (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recogn 39:260–276CrossRef Shih P, Liu C (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recogn 39:260–276CrossRef
Zurück zum Zitat Sun X, Xu H, Zhao C, Yang J (2008) Facial expression recognition based on histogram sequence of local Gabor binary patterns. In: Proceedings of IEEE conference on cybernetics and intelligent systems, pp 158–163 Sun X, Xu H, Zhao C, Yang J (2008) Facial expression recognition based on histogram sequence of local Gabor binary patterns. In: Proceedings of IEEE conference on cybernetics and intelligent systems, pp 158–163
Zurück zum Zitat Tsai HH, Lai YS, Lo SC (2013) A zero-watermark scheme with geometrical invariants using SVM and PSO against geometrical attacks for image protection. J Syst Softw 86:335–348CrossRef Tsai HH, Lai YS, Lo SC (2013) A zero-watermark scheme with geometrical invariants using SVM and PSO against geometrical attacks for image protection. J Syst Softw 86:335–348CrossRef
Zurück zum Zitat Tsai HH, Chang BM, Liu SH (2014) Rotation invariant image retrieval using PSO and SVR. Appl Soft Comput 17:127–139CrossRef Tsai HH, Chang BM, Liu SH (2014) Rotation invariant image retrieval using PSO and SVR. Appl Soft Comput 17:127–139CrossRef
Zurück zum Zitat Tsai HH, Cheng JS (2005) Adaptive signal-dependent audio watermarking based on human auditory system and neural networks. Appl Intell 23:191–206CrossRef Tsai HH, Cheng JS (2005) Adaptive signal-dependent audio watermarking based on human auditory system and neural networks. Appl Intell 23:191–206CrossRef
Zurück zum Zitat VenkataRamiReddy Ch, Kishore KVK, Bhattacharyya D, Kim TH (2014) Multi-feature fusion based facial expression classification using DLBP and DCT. Int J Softw Eng Appl 8:55–68 VenkataRamiReddy Ch, Kishore KVK, Bhattacharyya D, Kim TH (2014) Multi-feature fusion based facial expression classification using DLBP and DCT. Int J Softw Eng Appl 8:55–68
Zurück zum Zitat Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, pp 511–518 Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, pp 511–518
Zurück zum Zitat Wei W, Jia Q (2016) Weighted feature Gaussian kernel SVM for emotion recognition. Comput Intell Neurosci 2016:1–7CrossRef Wei W, Jia Q (2016) Weighted feature Gaussian kernel SVM for emotion recognition. Comput Intell Neurosci 2016:1–7CrossRef
Zurück zum Zitat Wong JJ, Cho SY (2009) A local experts organization model with application to face emotion recognition. Expert Syst Appl 36:804–819CrossRef Wong JJ, Cho SY (2009) A local experts organization model with application to face emotion recognition. Expert Syst Appl 36:804–819CrossRef
Zurück zum Zitat Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34–58CrossRef Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34–58CrossRef
Zurück zum Zitat Yang P, Liu Q, Metaxas DN (2009) Boosting encoded dynamic features for facial expression recognition. Pattern Recogn Lett 30:132–139CrossRef Yang P, Liu Q, Metaxas DN (2009) Boosting encoded dynamic features for facial expression recognition. Pattern Recogn Lett 30:132–139CrossRef
Zurück zum Zitat Zhou G, Zhan Y, Zhang J (2006) Facial expression recognition based on selective feature extraction. In: Proceedings of the sixth international conference on intelligent systems design and applications, pp 412–417 Zhou G, Zhan Y, Zhang J (2006) Facial expression recognition based on selective feature extraction. In: Proceedings of the sixth international conference on intelligent systems design and applications, pp 412–417
Metadaten
Titel
Facial expression recognition using a combination of multiple facial features and support vector machine
verfasst von
Hung-Hsu Tsai
Yi-Cheng Chang
Publikationsdatum
19.05.2017
Verlag
Springer Berlin Heidelberg
Erschienen in
Soft Computing / Ausgabe 13/2018
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2634-3

Weitere Artikel der Ausgabe 13/2018

Soft Computing 13/2018 Zur Ausgabe