Top

Cognitive Neurodynamics

Published in:

12-10-2020 | Research Article

Geometrical features of lips using the properties of parabola for recognizing facial expression

Authors: V. Suma Avani, S. G. Shaila, A. Vadivel

Published in: Cognitive Neurodynamics | Issue 3/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Various real-time applications such as Human–Computer Interactions, Psychometric analysis, etc. use facial expressions as one of the important parameters. The researchers have used Action Units (AU) of the face as feature points and its deformation is compared with the reference points on the face to estimate the facial expressions. Among many parts of the face, features from the mouth contribute largely to all the well-known emotions. In this paper, the parabola theory is used to identify and mark various points on the lips. These points are considered as feature points to construct feature vectors. The Latus Rectum, Focal Point, Directrix, Vertex, etc. are also considered to identify the feature points of the lower lips and upper lips. The proposed approach is evaluated on benchmark datasets such as JAFFEE and Cohn–Kanade dataset and it is found that the performance is encouraging in understanding the facial expressions. The results are compared with contemporary methods and found that the proposed approach has given good classification accuracy in recognizing facial expressions.

previous article EEG power spectral density in locked-in and completely locked-in state patients: a longitudinal study

next article Dependency analysis of frequency and strength of gamma oscillations on input difference between excitatory and inhibitory neurons

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Ahmed F, Bari H, Hossain E (2014) Person-independent facial expression recognition based on compound local binary pattern (CLBP). Int Arab J Inf Technol 11(2):195–203

Al-Sumaidaee SAM, Dlay SS, Woo WL, Chambers JA (2015) Facial expression recognition using local gabor gradient code-horizontal diagonal descriptor. In: 2nd IET international conference on intelligent signal processing (ISP), London, pp 1–6. https://doi.org/10.1049/cp.2015.1766

Arumugam D, Srinivasan P (2011) Emotion classification using facial expression. Int J Adv Comput Sci Appl 2:92–98

Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464PubMedPubMedCentral

Carcagnì P, Coco M, Leo M, Distante C (2015) Facial expression recognition and histograms of oriented gradients: a comprehensive study. SpringerPlus 4(1):645PubMedPubMedCentral

Chao WL, Ding JJ, Liu JZ (2015) Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection. J Sig Process 2:552–561

Cheon Y, Kim D (2008) A natural facial expression recognition using differential—AAM and k-NNs. In: Tenth IEEE international symposium on multimedia, Berkeley, pp 220–227

Chien SI, Choi I (2000) Face and facial landmarks location based on log-polar mapping. In: Lee SW, Bülthoff HH, Poggio T (eds) Biologically motivated computer vision (BMCV 2000), vol 1811. Lecture Notes in Computer Science. Springer, Berlin, pp 379–386

Choi HC, Oh SY (2006) Real time facial expression recognition using active appearance model and multilayer perceptron. In: SICE-ICASE international joint conference, Busan, pp 5924–5927

Choi S-I, Oh J, Choi C-H, Kim C (2012) Input variable selection for feature extraction in classification problems. Sig Process 92(3):636–648

Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685

Cruz AC, Bhanu B, Thakoor NS (2014) Vision and attention theory based sampling for continuous facial emotion recognition. IEEE Trans Affect Comput 5(4):418–431

Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition (CVPR ‘05), San Diego, CA, vol 1, pp 886–893

Darwin C (1872) The expression of the emotions in man and animals. John Murray, London

Dosadia P, Poonia A, Gupta SK, Agrwal SL (2015) New Gabor-DCT feature extraction technique for facial expression recognition. In: 5th international conference on communication systems and network technologies (CSNT), Gwalior, pp 546–549

Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto

Elaiwat S, Bennamoun M, Boussaid F, El-Sallam A (2014) 3-D Face recognition using curvelet local features. IEEE Signal Process Lett 21(2):172–175

Fan X, Tjahjadi T (2015) A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences. Pattern Recogn 48:3407–3416

Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell 32(9):1627–1645PubMed

Ghimire D, Lee J (2013) Geometric feature-based facial expression recognition in image sequences using multi-class AdaBoost and support vector machines. Sensors J 13(6):7714–7734

Ghimire D, Lee J (2014) Extreme learning machine ensemble using bagging for facial expression recognition. J Inf Process Syst 10(3):443–458

Ghimire D, Jeong S, Yoon S, Choi J, Lee J (2015) Facial expression recognition based on region specific appearance and geometric features. In: 2015 Tenth International Conference on Digital Information Management (ICDIM), Jeju, pp 142–147

Goa T, Fenga XL, Lub H, Zhaia JH (2013) A novel face feature descriptor using adaptively weighted extended LBP pyramid. J Opt 124:6286–6291

Haq MU, Shahzad A, Mahmood Z, Shah AA (2019) Boosting the face recognition performance of ensemble based LDA for Pose, non-uniform illuminations, and low-resolution images. KSII Trans Internet Inf Syst 13(6):3144–3166

He C, Mao H, Jin L (2011) Realistic smile expression recognition using biologically inspired features. In: Wang D, Reynolds M (eds) Advances in artificial intelligence (AI 2011), vol 7106. Lecture Notes in Computer Science. Springer, Berlin, pp 590–599

Huang CL, Huang YM (1997) Facial expression recognition using model based feature extraction and action parameters classification. J Vis Commun Image Represent 8(3):278–290

Huang X, Zhao G, Zheng W, Pietikäinen M (2012) Towards a dynamic expression recognition system under facial occlusion. Pattern Recogn Lett 33(16):2181–2191

Jabid T, Kabir MH, Chae O (2010) Facial expression recognition using Local Directional Pattern (LDP). In: 2010 IEEE international conference on image processing, Hong Kong, pp 1605–1608

Jeong G-M, Ahn H-S, Choi S-I, Kwak N, Moon C (2010) Pattern recognition using feature feedback: application to face recognition. J Control Autom Syst 8(1):141–148

Jyoti K, Rajesh R, Pooja KM (2015) Facial expression recognition: a survey. Procedia Comput Sci 58:486–491

Jyoti K, Rajesh R, Abhinav K (2016) Fusion of features for the effective facial expression recognition. In: International conference on communication and signal processing (ICCSP), Melmaruvathur, India, pp 0457–0461

Kahou SE, Bouthillier X, Lamblin P, et al (2016) EmoNets: multimodal deep learning approaches for emotion recognition in video. J. Multimodal User Interfaces. 10(2):99–111. https://doi.org/10.1007/s12193-015-0195-2.CrossRef

Kaur M, Vashisht R, Neeru N (2010) Recognition of Facial Expressions with principal component analysis and singular value decomposition. Int J Comput Appl 9(12):0975–8887

Khan RA, Meyer A, Konik H, Bouakaz S (2013) Framework for reliable, real-time facial expression recognition for low resolution images. Pattern Recogn Lett 34:1159–1168

Khan SA, Ansari NR, Akram S, Latif S (2015) Facial expression recognition using computationally intelligent techniques. J Intell Fuzzy Syst 28:2881–2887

Khan SA, Hussain A, Usman M (2016) Facial expression recognition on real world face images using intelligent techniques: a survey. Optik Int J Light Electron Opt 127(15):6195–6203

Khan SA, Hussain S, Xiaoming S, Yang S (2018a) An effective framework for driver fatigue recognition based on intelligent facial expressions analysis. IEEE Access 6:67459–67468. https://doi.org/10.1109/ACCESS.2018.2878601CrossRef

Khan SA, Hussain A, Usman M (2018b) Reliable facial expression recognition for multi-scale images using weber local binary image based cosine transform features. Multimed Tools Appl 77:1133–1165. https://doi.org/10.1007/s11042-016-4324-zCrossRef

Khandait SP, Thool RC, Khandait PD (2011) Automatic facial feature extraction and expression recognition based on neural network. Int J Adv Comput Sci Appl 2:113–118

Ko KE, Sim KB (2010) Emotion recognition in facial image sequences using a combination of AAM with FACS and DBN. In: Liu H, Ding H, Xiong Z, Zhu X (eds) Intelligent robotics and applications (ICIRA 2010), vol 6424. Lecture Notes in Computer Science. Springer, Berlin, pp 702–712

Kristensen RL, Tan Z-H, Ma Z, Gou J (2014) Emotion recognition in blurred images with local features and machine learning. Master Thesis, pp 130.

Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Pereira FBurges C, Bottou L, Weinberger K (eds), Advances in neural information processing systems, Curran Associates, vol 25, pp 1097–1105

Lajevardi SM, Hussain ZM (2009) Feature selection for facial expression recognition based on optimization algorithm. In: 2nd international workshop on nonlinear dynamics and synchronization, Klagenfurt, pp 182–185

Lekshmi VP, Vidyadharan DS, Naveen S (2008) Analysis of facial expressions using PCA on half and full faces. In: Proceedings of international conference of audio, language and image processing (ICALIP), pp 1379–1383

Lin DT (2006) Facial expression classification using PCA and hierarchical radial basis function network. J Inf Sci Eng 22:1033–1046

Liu P, Han S, Meng Z, Tong Y (2014) Facial expression recognition via a boosted deep belief network. In: IEEE conference on computer vision and pattern recognition, Columbus, pp 1805–1812

Long TB, Thai LH, Hanh T (2012) Facial expression classification method based on pseudo-zernike moment and radial basis function network. Int J Mach Learn Comput 2(4):402–405

Lowe DG (1999) Object recognition from local scale-invariant features. In: Seventh IEEE international conference on computer vision, Kerkyra, Greece, vol 2, pp 1150–1157

Lyons MJ, Budynek J, Akamatsu S (1999) Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell 21(12):1357–1362

Mistry K, Zhang L, Neoh SC, Lim CP, Fielding B (2017) A microGA embedded PSO feature selection approach to intelligent facial emotion recognition. IEEE Trans Cybern 47(6):1496–1509PubMed

Munir A, Hussain A, Khan SA, Nadeem M, Arshid S (2018) Illumination invariant facial expression recognition using selected merged binary patterns for real world images. Optik 158:1016–1025

Niu Z, Qiu X (2010) Facial expression recognition based on weighted principal component analysis and support vector machines. In: 3rd international conference on advanced computer theory and engineering (ICACTE), vol 3, pp V3-174–V3-178

Ouyang Y, Sang N, Huang R (2015) Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers. J Neurocomput 149:71–78

Pai N-S, Chang S-P (2011) An embedded system for real-time facial expression recognition based on the extension theory. Comput Math Appl 61(8):2101–2106

Sadeghi H, Raie AA, Mohammadi MR (2013) Facial expression recognition using geometric normalization and appearance representation. In: 8th Iranian conference on machine vision and image processing (MVIP), Zanjan, pp 159–163

Schels M, Schwenker F (2010) A multiple classifier system approach for facial expressions in image sequence utilizing GMM Supervectors. In: 20th international conference on pattern recognition, Istanbul, pp 4251–4254

Shan C, Gong S, Mc Owan PW (2005) Conditional mutual information based boosting for facial expression recognition. In: Clocksin WF, Fitzgibbon AW, Torr PHS (eds), Proceedings of the British machine conference (BMVC), pp 1–10. https://doi.org/10.5244/c.19.42

Shan C, Gong S, McOwan PW (2009) Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis Comput 27(6):803–816

Shen X, Wu Qi, Fu X (2012) Effects of the duration of expressions on the recognition of microexpressions. Journal of Zhejiang University. Science. B. 13(3): 221–30PubMedPubMedCentral

Siddiqi MH, Lee S, Lee Y-K, Khan AM, Truc PTH (2013) Hierarchical recognition scheme for human facial expression recognition systems. Sensors J 13:16682–16713

Su C, Deng J, Yang Y, Wang G (2010) Expression recognition methods based on feature fusion. In: Yao Y, Sun R, Poggio T, Liu J, Zhong N, Huang J (eds) Brain informatics (BI 2010), vol 6334. Lecture Notes in Computer Science. Springer, Berlin, pp 346–356

Swaminathan A, Vadivel A, Arock M (2020) FERCE: facial expression recognition for combined emotions using FERCE algorithm. IETE J Res. https://doi.org/10.1080/03772063.2020.1756471CrossRef

Tian YL, Kanade T, Cohn JF (2005) Facial expression analysis. Handbook of face recognition. Springer, New York

Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Proceedings of the 1998 IEEE international conference on computer vision, Bombay, India

Tong Y, Chen R, Cheng Y (2014) Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle. Optik Int J Light Electron Opt 125(16):4186–4189

Turk MA, Pentland AP (1991) Face recognition using eigenfaces. In: IEEE computer society conference on computer vision and pattern recognition. Maui, HI, pp 586–591

Ucar A, Demir Y, Guzelis C (2016) A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering. Neural Comput Appl 27:131–142

Wang X, Liu X, Lu L, Shen Z (2014) A new facial expression recognition method based on geometric alignment and LBP features. In: IEEE 17th international conference on computational science and engineering, Chengdu, pp 1734–1737

Wang L, Li RF, Wang K, Chen J (2015) Feature representation for facial expression recognition based on FACS and LBP. Int J Autom Comput 11(5):459–468

Wang Z, Ruan Q, An G (2016) Facial expression recognition using sparse local fisher discriminant analysis. Neurocomputing 174:756–766

Xu M, Cheng W, Zhao Q, Ma L, Xu F (2015) Facial expression recognition based on transfer learning from deep convolutional networks. In: 11th international conference on natural computation (ICNC), Zhangjiajie, pp 702–708

Yu K, Wang Z, Zhuo L, Wang J, Chi Z, Feng D (2013) Learning realistic facial expressions from web images. Pattern Recogn 46:2144–2155

Yuan LUO, Wu C, Zhang Y (2013) Facial expression feature extraction using hybrid PCA and LBP. J China Univ Posts Telecommun 20(2):120–124

Yun W, Kim D, Park C, Kim J (2013) Multi-view facial expression recognition using parametric kernel Eigenspace method based on class features. In: IEEE conference on systems, man and cybernetics, Manchester, pp 2689–2693

Zhang W, Zhang Y, Ma L, Guan J, Gong S (2015) Multimodal learning for facial expression recognition. Pattern Recogn 48:3191–3202

Zheng W, Zong Y, Zhou X, Xin M (2018) Cross-domain color facial expression recognition using transductive transfer subspace learning. IEEE Trans Affect Comput 9(1):21–37

Zhou F, Kong S, Fowlkes CC, Chen T, Lei B (2020) Fine-grained facial expression analysis using dimensional emotion model. Neurocomputing 392(7):38–49

Title: Geometrical features of lips using the properties of parabola for recognizing facial expression
Authors: V. Suma Avani
S. G. Shaila
A. Vadivel
Publication date: 12-10-2020
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 3/2021
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-020-09638-x

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 3/2021

Speech signal analysis of alzheimer’s diseases in farsi using auditory model system

Brain functional network modeling and analysis based on fMRI: a systematic review

An automatic EEG-based sleep staging system with introducing NAoSP and NAoGP as new metrics for sleep staging systems

EEG power spectral density in locked-in and completely locked-in state patients: a longitudinal study

Aperiodic stochastic resonance in neural information processing with Gaussian colored noise

Dependency analysis of frequency and strength of gamma oscillations on input difference between excitatory and inhibitory neurons