Skip to main content
Top
Published in: Soft Computing 13/2018

19-05-2017 | Methodologies and Application

Facial expression recognition using a combination of multiple facial features and support vector machine

Authors: Hung-Hsu Tsai, Yi-Cheng Chang

Published in: Soft Computing | Issue 13/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents a novel facial expression recognition (FER) technique based on support vector machine (SVM) for the FER. Here it is called the FERS technique. First, the FERS technique develops a face detection method that combines the Haar-like features method with the self-quotient image (SQI) filter. As a result, the FERS technique possesses better detection rate because the face detection method gets more accurate in locating face regions of an image. The main reason is that the SQI filter can overcome the insufficient light and shade light. Subsequently, three schemes, the angular radial transform (ART), the discrete cosine transform (DCT) and the Gabor filter (GF), are simultaneously employed in the design of the feature extraction for facial expression in the FERS technique. More specifically, they are employed in constructing a set of training patterns for the training of an SVM. The FERS technique then exploits the trained SVM to recognize the facial expression for a query face image. Finally, experimental results show that the recognition performance of the FERS technique can be better than that of other existing methods under consideration in the paper.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Burges CJC (1998) A Tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef Burges CJC (1998) A Tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRef
go back to reference Chai Z, Vazquez MH, He R, Sun Z, Tan T (2014) Explore semantic pixel sets based local patterns with information entropy for face recognition. EURASIP J Image Video Process 26:1–11 Chai Z, Vazquez MH, He R, Sun Z, Tan T (2014) Explore semantic pixel sets based local patterns with information entropy for face recognition. EURASIP J Image Video Process 26:1–11
go back to reference Chen HY, Huang CL, Fu CM (2008) Hybrid-boost learning for multi-pose face detection and facial expression recognition. Pattern Recogn 41:1173–1185CrossRefMATH Chen HY, Huang CL, Fu CM (2008) Hybrid-boost learning for multi-pose face detection and facial expression recognition. Pattern Recogn 41:1173–1185CrossRefMATH
go back to reference Cheng K, Chen Y, Zhan Y (2008) A new approach for facial expression recognition based on Burial Markov model. In: Proceedings of the fifth international conference on fuzzy systems and knowledge discovery, pp 3–9 Cheng K, Chen Y, Zhan Y (2008) A new approach for facial expression recognition based on Burial Markov model. In: Proceedings of the fifth international conference on fuzzy systems and knowledge discovery, pp 3–9
go back to reference Fang J, Qiu G (2003) Human face detection using angular radial transform and support vector machines. In: Proceedings of international conference on image processing, pp 669–672 Fang J, Qiu G (2003) Human face detection using angular radial transform and support vector machines. In: Proceedings of international conference on image processing, pp 669–672
go back to reference Fellenz WA, Taylor JG, Tsapatsoulis N, Kollias S (1999) Comparing template-based, feature-based and supervised classification of facial expressions from static images. In: Proceedings of circuits systems, communications and computers, pp 5331–5336 Fellenz WA, Taylor JG, Tsapatsoulis N, Kollias S (1999) Comparing template-based, feature-based and supervised classification of facial expressions from static images. In: Proceedings of circuits systems, communications and computers, pp 5331–5336
go back to reference Haykin S (1995) Neural networks: a comprehensive foundation. Macmillan College Publishing Company, New YorkMATH Haykin S (1995) Neural networks: a comprehensive foundation. Macmillan College Publishing Company, New YorkMATH
go back to reference Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE international conference on automatic face and gesture recognition, pp 46–53 Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of the fourth IEEE international conference on automatic face and gesture recognition, pp 46–53
go back to reference Kharat GU, Dudul SV (2008) Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques. WSEAS Trans Comput 7:650–659 Kharat GU, Dudul SV (2008) Human emotion recognition system using optimally designed SVM with different facial feature extraction techniques. WSEAS Trans Comput 7:650–659
go back to reference Kim DH, Jung SU, Chung MJ (2008) Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn Lett 29:1621–1631CrossRef Kim DH, Jung SU, Chung MJ (2008) Extension of cascaded simple feature based face detection to facial expression recognition. Pattern Recogn Lett 29:1621–1631CrossRef
go back to reference Kotsia I, Zafeiriou S, Pitas I (2008) Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recogn 41:833–851CrossRefMATH Kotsia I, Zafeiriou S, Pitas I (2008) Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recogn 41:833–851CrossRefMATH
go back to reference Lajevardi SM, Hussain ZM (2012) Automatic facial expression recognition: feature extraction and selection. SIViP 6:159–169CrossRef Lajevardi SM, Hussain ZM (2012) Automatic facial expression recognition: feature extraction and selection. SIViP 6:159–169CrossRef
go back to reference Lee JJ, Uddin MZ, Kim TS (2008) Spatiotemporal human facial expression recognition using fisher independent component analysis and Hidden Markov Model. In: Proceedings of the 30th annual international IEEE EMBS conference, Vancouver, British Columbia, pp 2546–2549 Lee JJ, Uddin MZ, Kim TS (2008) Spatiotemporal human facial expression recognition using fisher independent component analysis and Hidden Markov Model. In: Proceedings of the 30th annual international IEEE EMBS conference, Vancouver, British Columbia, pp 2546–2549
go back to reference Liu W, Wang Z (2006) Facial expression recognition based on fusion of multiple Gabor features. In: Proceedings of the 18th international conference on pattern recognition, pp 536–539 Liu W, Wang Z (2006) Facial expression recognition based on fusion of multiple Gabor features. In: Proceedings of the 18th international conference on pattern recognition, pp 536–539
go back to reference Loh MP, Wong YP, Wong CO (2006) Facial expression recognition for e-Learning systems using Gabor wavelet & neural network. In: Proceedings of the sixth international conference on advanced learning technologies, pp 523–525 Loh MP, Wong YP, Wong CO (2006) Facial expression recognition for e-Learning systems using Gabor wavelet & neural network. In: Proceedings of the sixth international conference on advanced learning technologies, pp 523–525
go back to reference Mita T, Kaneko T, Hori O (2005) Joint haar-like features for face detection. In: Proceedings of the tenth IEEE international conference on computer vision, pp 1619–1626 Mita T, Kaneko T, Hori O (2005) Joint haar-like features for face detection. In: Proceedings of the tenth IEEE international conference on computer vision, pp 1619–1626
go back to reference Rowley HA, Baluja S, Kanade T (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20:23–38CrossRef Rowley HA, Baluja S, Kanade T (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20:23–38CrossRef
go back to reference Saeed I, Wang A, Senaratne R, Halgamuge S (2007) Using the active appearance model to detect driver fatigue. In: Proceedings of the third international conference on information and automation for sustainability, pp 124–128 Saeed I, Wang A, Senaratne R, Halgamuge S (2007) Using the active appearance model to detect driver fatigue. In: Proceedings of the third international conference on information and automation for sustainability, pp 124–128
go back to reference Shih P, Liu C (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recogn 39:260–276CrossRef Shih P, Liu C (2006) Face detection using discriminating feature analysis and support vector machine. Pattern Recogn 39:260–276CrossRef
go back to reference Sun X, Xu H, Zhao C, Yang J (2008) Facial expression recognition based on histogram sequence of local Gabor binary patterns. In: Proceedings of IEEE conference on cybernetics and intelligent systems, pp 158–163 Sun X, Xu H, Zhao C, Yang J (2008) Facial expression recognition based on histogram sequence of local Gabor binary patterns. In: Proceedings of IEEE conference on cybernetics and intelligent systems, pp 158–163
go back to reference Tsai HH, Lai YS, Lo SC (2013) A zero-watermark scheme with geometrical invariants using SVM and PSO against geometrical attacks for image protection. J Syst Softw 86:335–348CrossRef Tsai HH, Lai YS, Lo SC (2013) A zero-watermark scheme with geometrical invariants using SVM and PSO against geometrical attacks for image protection. J Syst Softw 86:335–348CrossRef
go back to reference Tsai HH, Chang BM, Liu SH (2014) Rotation invariant image retrieval using PSO and SVR. Appl Soft Comput 17:127–139CrossRef Tsai HH, Chang BM, Liu SH (2014) Rotation invariant image retrieval using PSO and SVR. Appl Soft Comput 17:127–139CrossRef
go back to reference Tsai HH, Cheng JS (2005) Adaptive signal-dependent audio watermarking based on human auditory system and neural networks. Appl Intell 23:191–206CrossRef Tsai HH, Cheng JS (2005) Adaptive signal-dependent audio watermarking based on human auditory system and neural networks. Appl Intell 23:191–206CrossRef
go back to reference VenkataRamiReddy Ch, Kishore KVK, Bhattacharyya D, Kim TH (2014) Multi-feature fusion based facial expression classification using DLBP and DCT. Int J Softw Eng Appl 8:55–68 VenkataRamiReddy Ch, Kishore KVK, Bhattacharyya D, Kim TH (2014) Multi-feature fusion based facial expression classification using DLBP and DCT. Int J Softw Eng Appl 8:55–68
go back to reference Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, pp 511–518 Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition, pp 511–518
go back to reference Wei W, Jia Q (2016) Weighted feature Gaussian kernel SVM for emotion recognition. Comput Intell Neurosci 2016:1–7CrossRef Wei W, Jia Q (2016) Weighted feature Gaussian kernel SVM for emotion recognition. Comput Intell Neurosci 2016:1–7CrossRef
go back to reference Wong JJ, Cho SY (2009) A local experts organization model with application to face emotion recognition. Expert Syst Appl 36:804–819CrossRef Wong JJ, Cho SY (2009) A local experts organization model with application to face emotion recognition. Expert Syst Appl 36:804–819CrossRef
go back to reference Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34–58CrossRef Yang MH, Kriegman D, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34–58CrossRef
go back to reference Yang P, Liu Q, Metaxas DN (2009) Boosting encoded dynamic features for facial expression recognition. Pattern Recogn Lett 30:132–139CrossRef Yang P, Liu Q, Metaxas DN (2009) Boosting encoded dynamic features for facial expression recognition. Pattern Recogn Lett 30:132–139CrossRef
go back to reference Zhou G, Zhan Y, Zhang J (2006) Facial expression recognition based on selective feature extraction. In: Proceedings of the sixth international conference on intelligent systems design and applications, pp 412–417 Zhou G, Zhan Y, Zhang J (2006) Facial expression recognition based on selective feature extraction. In: Proceedings of the sixth international conference on intelligent systems design and applications, pp 412–417
Metadata
Title
Facial expression recognition using a combination of multiple facial features and support vector machine
Authors
Hung-Hsu Tsai
Yi-Cheng Chang
Publication date
19-05-2017
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 13/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2634-3

Other articles of this Issue 13/2018

Soft Computing 13/2018 Go to the issue

Premium Partner