Skip to main content
Erschienen in: Wireless Personal Communications 2/2023

24.04.2023

Deep Learning Method of Facial Expression Recognition Based on Gabor Filter Bank Combined with PCNN

verfasst von: Lisha Yao, Haifeng Zhao

Erschienen in: Wireless Personal Communications | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Traditional recognition methods are simple to extract features and need to be manually extracted with high complexity and unstable accuracy. The expression recognition method of deep learning still has the problems of poor network representation ability and low recognition rate. In order to fully represent the complex texture and edge features of expression images, a deep learning method of expression recognition based on Gabor representation combined with PCNN was proposed. Firstly, different Gabor representations are obtained through a set of Gabor filter banks with different proportions and directions, and the corresponding convolutional neural network model is trained to generate G-CNNs. Then, the Pulse Coupled Neural Network (PCNN) was introduced to fuse the different outputs of G-CNNs. Experiments in CK+ and JAFFE databases show that the average recognition rates of this method obtained 94.87% and 96.91%, time is 2097 ms and 6142 ms. Compared with other methods, the experimental results verify the effectiveness and superiority of the proposed method. The proposed method improves the recognition rate on the premise of ensuring the recognition efficiency.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, Q. M., & Xin, Y. Y. (2020). Face expression recognition based on end-to-end low-quality face images. Journal of Chinese Computer Systems, 041(003), 668–672. Liu, Q. M., & Xin, Y. Y. (2020). Face expression recognition based on end-to-end low-quality face images. Journal of Chinese Computer Systems, 041(003), 668–672.
2.
Zurück zum Zitat Li, T. T., Hu, Y. L., & Wei, F. L. (2020). Improved facial expression recognition algorithm based on GAN and application. Journal of Jilin University (Science Edition), 058(003), 605–610. Li, T. T., Hu, Y. L., & Wei, F. L. (2020). Improved facial expression recognition algorithm based on GAN and application. Journal of Jilin University (Science Edition), 058(003), 605–610.
3.
Zurück zum Zitat Qiang, W., Zhou, X. Y., Xu, H. N., Li, D. P., & An, H. R. (2020). Micro-expression recognition based on LBP and two-stream spatial-temporal neural network. Information and Contro, 49(06), 37–43. Qiang, W., Zhou, X. Y., Xu, H. N., Li, D. P., & An, H. R. (2020). Micro-expression recognition based on LBP and two-stream spatial-temporal neural network. Information and Contro, 49(06), 37–43.
4.
Zurück zum Zitat Wu, H., Hu, M., Gao, Y., Wang, X. H., & Huang, Z. (2020). Facial expression recognition based on DCLBP and HOAG. Journal of Electronic Measurement and Instrumentation, 2, 73–79. Wu, H., Hu, M., Gao, Y., Wang, X. H., & Huang, Z. (2020). Facial expression recognition based on DCLBP and HOAG. Journal of Electronic Measurement and Instrumentation, 2, 73–79.
5.
Zurück zum Zitat Zhou, H. L., Kinman, L., & He, X. J. (2016). Shape-appearance-correlated active appearance model. Pattern Recognition, 56(1), 88–99.CrossRef Zhou, H. L., Kinman, L., & He, X. J. (2016). Shape-appearance-correlated active appearance model. Pattern Recognition, 56(1), 88–99.CrossRef
6.
Zurück zum Zitat Ye, Z. H., Bai, L., & Zhan, Y. J. (2016). Hyperspectral image classification algorithm based on Gabor feature and locality-preserving dimensionality reduction. Acta Optica Sinica, 36(10), 1028003.CrossRef Ye, Z. H., Bai, L., & Zhan, Y. J. (2016). Hyperspectral image classification algorithm based on Gabor feature and locality-preserving dimensionality reduction. Acta Optica Sinica, 36(10), 1028003.CrossRef
7.
Zurück zum Zitat Paczos, T., Bonham, A., Canavesi, C., Rolland, J. P., & O’Connell, R. (2021). Near-histologic resolution images of cervical dysplasia obtained with Gabor domain optical coherence microscopy. Journal of Lower Genital Tract Disease, 25(2), 137–141.CrossRef Paczos, T., Bonham, A., Canavesi, C., Rolland, J. P., & O’Connell, R. (2021). Near-histologic resolution images of cervical dysplasia obtained with Gabor domain optical coherence microscopy. Journal of Lower Genital Tract Disease, 25(2), 137–141.CrossRef
8.
Zurück zum Zitat Jiang, B., & Jia, K. B. (2014). A local discriminative component analysis algorithm for facial expression recognition. Acta Electronica Sinica, 42(1), 155–159. Jiang, B., & Jia, K. B. (2014). A local discriminative component analysis algorithm for facial expression recognition. Acta Electronica Sinica, 42(1), 155–159.
9.
Zurück zum Zitat Huang, H., & Zheng, X. L. (2016). Hyperspectral image classification with combination of weighted spatial-spectral and KNN. Optics and Precision Engineering, 24(4), 873–881.CrossRef Huang, H., & Zheng, X. L. (2016). Hyperspectral image classification with combination of weighted spatial-spectral and KNN. Optics and Precision Engineering, 24(4), 873–881.CrossRef
10.
Zurück zum Zitat Xu, Y., Gu, Y., Peng, D. L., & Liu, J. (2020). SAR ATR based on disentangled representation learning generative adversarial networks and support vector machine. Optics and Precision Engineering, 28(3), 727–735.CrossRef Xu, Y., Gu, Y., Peng, D. L., & Liu, J. (2020). SAR ATR based on disentangled representation learning generative adversarial networks and support vector machine. Optics and Precision Engineering, 28(3), 727–735.CrossRef
11.
Zurück zum Zitat Su, B. C., Chen, G., & Che, R. S. (2009). Kinetic people model learning of modified HMM. Optics and Precision Engineering, 17(6), 1485–1495. Su, B. C., Chen, G., & Che, R. S. (2009). Kinetic people model learning of modified HMM. Optics and Precision Engineering, 17(6), 1485–1495.
12.
Zurück zum Zitat Lopes, A. T., Aguiar, E. D., Souza, A., & Oliveira-Santos, T. (2017). Facial expression recognition with convolutional neural networks: Coping with few data and the training sample order. Pattern Recognition, 61, 610–628.CrossRef Lopes, A. T., Aguiar, E. D., Souza, A., & Oliveira-Santos, T. (2017). Facial expression recognition with convolutional neural networks: Coping with few data and the training sample order. Pattern Recognition, 61, 610–628.CrossRef
13.
Zurück zum Zitat Ding, M. D., & Li, L. (2020). CNN and HOG dual-path feature fusion for face expression recognition. Information and Control, 49(1), 47–54. Ding, M. D., & Li, L. (2020). CNN and HOG dual-path feature fusion for face expression recognition. Information and Control, 49(1), 47–54.
14.
Zurück zum Zitat He, Z. C., Zhao, L. Z., & Chen, C. (2018). Convolution neural network with multi-resolution feature fusion for facial expression recognition. Laser & Optoelectronics Progress, 55(07), 370–375. He, Z. C., Zhao, L. Z., & Chen, C. (2018). Convolution neural network with multi-resolution feature fusion for facial expression recognition. Laser & Optoelectronics Progress, 55(07), 370–375.
15.
Zurück zum Zitat Gupta, K. K., Dhanda, N., & Kumar, U. (2021). A novel approach to brain tumor detection using texture based Gabor filter followed by genetic algorithm. International Journal on Communications Antenna and Propagation: IRCEAP, 11(4), 233–241. Gupta, K. K., Dhanda, N., & Kumar, U. (2021). A novel approach to brain tumor detection using texture based Gabor filter followed by genetic algorithm. International Journal on Communications Antenna and Propagation: IRCEAP, 11(4), 233–241.
16.
Zurück zum Zitat Jahmunah, V., Ng, E. Y. K., San, T. R., & Acharya, U. R. (2021). Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using Gabor CNN model with ECG signals. Computers in Biology and Medicine, 134, 134–145.CrossRef Jahmunah, V., Ng, E. Y. K., San, T. R., & Acharya, U. R. (2021). Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using Gabor CNN model with ECG signals. Computers in Biology and Medicine, 134, 134–145.CrossRef
17.
Zurück zum Zitat Jiang, Y. N., Zhang, C. L., Zhang, X., & Kim, S. H. (2022). Boosting tree model with Gabor and LPQ feature fusion of HSI ground object recognition. Remote Sensing Technology and Application, 2, 515–523. Jiang, Y. N., Zhang, C. L., Zhang, X., & Kim, S. H. (2022). Boosting tree model with Gabor and LPQ feature fusion of HSI ground object recognition. Remote Sensing Technology and Application, 2, 515–523.
18.
Zurück zum Zitat Gao, H. (2017). Corner detection using the log-Gabor gradient direction. Journal of Image and Graphics, 22(6), 797–806. Gao, H. (2017). Corner detection using the log-Gabor gradient direction. Journal of Image and Graphics, 22(6), 797–806.
19.
Zurück zum Zitat Li, L., Dong, Z. L., Zhang, D. X., & Fei, X. (2016). An unsupervised color image segmentation method based on region-constrained EM and graph cuts. Acta Electronica Sinica, 44(6), 1349–1354. Li, L., Dong, Z. L., Zhang, D. X., & Fei, X. (2016). An unsupervised color image segmentation method based on region-constrained EM and graph cuts. Acta Electronica Sinica, 44(6), 1349–1354.
20.
Zurück zum Zitat Lian, J., Yang, Z., Liu, J., Sun, W., Zheng, L., Du, X., Yi, Z., Shi, B., & Ma, Y. (2021). An overview of image segmentation based on pulse-coupled neural network. Archives of Computational Methods in Engineering, 28(2), 387–403.MathSciNetCrossRef Lian, J., Yang, Z., Liu, J., Sun, W., Zheng, L., Du, X., Yi, Z., Shi, B., & Ma, Y. (2021). An overview of image segmentation based on pulse-coupled neural network. Archives of Computational Methods in Engineering, 28(2), 387–403.MathSciNetCrossRef
21.
Zurück zum Zitat Guo, Y., Yang, Z., Ma, Y., Lian, J., & Zhu, L. (2018). Saliency motivated improved simplified PCNN model for object segmentation. Neurocomputing, 275(1), 2179–2190.CrossRef Guo, Y., Yang, Z., Ma, Y., Lian, J., & Zhu, L. (2018). Saliency motivated improved simplified PCNN model for object segmentation. Neurocomputing, 275(1), 2179–2190.CrossRef
22.
Zurück zum Zitat Tan, W., Xiang, P., Zhang, J., Zhou, H., & Qin, H. (2020). Remote sensing image fusion via boundary measured dual-channel PCNN in multi-scale morphological gradient domain. IEEE Access, 8, 42540–42549.CrossRef Tan, W., Xiang, P., Zhang, J., Zhou, H., & Qin, H. (2020). Remote sensing image fusion via boundary measured dual-channel PCNN in multi-scale morphological gradient domain. IEEE Access, 8, 42540–42549.CrossRef
23.
Zurück zum Zitat Li, L. L., & Ma, H. B. (2021). Pulse coupled neural network-based multimodal medical image fusion via guided filtering and WSEML in NSCT domain. Entropy, 23(5), 591.MathSciNetCrossRef Li, L. L., & Ma, H. B. (2021). Pulse coupled neural network-based multimodal medical image fusion via guided filtering and WSEML in NSCT domain. Entropy, 23(5), 591.MathSciNetCrossRef
24.
Zurück zum Zitat Mohammed, M. M., Badr, A., & Abdelhalim, M. B. (2015). Image classification and retrieval using optimized pulse coupled neural network. Expert Systems with Applications, 42(11), 4927–4936.CrossRef Mohammed, M. M., Badr, A., & Abdelhalim, M. B. (2015). Image classification and retrieval using optimized pulse coupled neural network. Expert Systems with Applications, 42(11), 4927–4936.CrossRef
25.
Zurück zum Zitat Yonekawa, M., & Kurokawa, H. (2012). The content-based image retrieval using the pulse coupled neural network. In Proceedings of international joint conference on neural networks (pp. 1–8). IEEE Press, Washington D. C., USA. Yonekawa, M., & Kurokawa, H. (2012). The content-based image retrieval using the pulse coupled neural network. In Proceedings of international joint conference on neural networks (pp. 1–8). IEEE Press, Washington D. C., USA.
26.
Zurück zum Zitat Deng, X. Y., Ma, Y. D., & Dong, M. (2016). A new adaptive filtering method for removing salt and pepper noise based on multilayered PCNN. Pattern Recognition Letters, 79, 8–17.CrossRef Deng, X. Y., Ma, Y. D., & Dong, M. (2016). A new adaptive filtering method for removing salt and pepper noise based on multilayered PCNN. Pattern Recognition Letters, 79, 8–17.CrossRef
27.
Zurück zum Zitat Shen, C., Wang, D., Tang, S., Cao, H., & Liu, J. (2017). Hybrid image noise reduction algorithm based on genetic ant colony and PCNN. The Visual Computer, 33(11), 1373–1384.CrossRef Shen, C., Wang, D., Tang, S., Cao, H., & Liu, J. (2017). Hybrid image noise reduction algorithm based on genetic ant colony and PCNN. The Visual Computer, 33(11), 1373–1384.CrossRef
28.
Zurück zum Zitat Deng, X. Y., & Ma, Y. (2014). PCNN model analysis and its automatic parameters determination in image segmentation and edge detection. Chinese Journal of Electronics, 23(1), 97–103. Deng, X. Y., & Ma, Y. (2014). PCNN model analysis and its automatic parameters determination in image segmentation and edge detection. Chinese Journal of Electronics, 23(1), 97–103.
29.
Zurück zum Zitat Zhou, L., Sun, Y., & Zheng, J. G. (2008). Automated color image edge detection using improved PCNN model. WSEAS Transactions on Computers, 7(4/6), 186–191. Zhou, L., Sun, Y., & Zheng, J. G. (2008). Automated color image edge detection using improved PCNN model. WSEAS Transactions on Computers, 7(4/6), 186–191.
30.
Zurück zum Zitat Kuntimad, G., & Ranganath, H. S. (1999). Perfect image segmentation using pulse coupled neural networks. IEEE Transactions on Neural Networks, 10(3), 591–598.CrossRef Kuntimad, G., & Ranganath, H. S. (1999). Perfect image segmentation using pulse coupled neural networks. IEEE Transactions on Neural Networks, 10(3), 591–598.CrossRef
31.
Zurück zum Zitat Gai, D., Shen, X., Chen, H., Xie, Z., & Su, P. (2020). Medical image fusion using the PCNN based on IQPSO in NSST domain. IET Image Processing, 14(9), 1870–1880.CrossRef Gai, D., Shen, X., Chen, H., Xie, Z., & Su, P. (2020). Medical image fusion using the PCNN based on IQPSO in NSST domain. IET Image Processing, 14(9), 1870–1880.CrossRef
32.
Zurück zum Zitat Chinmaya, P., Ayan, S., & Kumar, M. N. (2020). Fractal dimension based parameter adaptive dual channel PCNN for multi-focus image fusion. Optics and Lasers in Engineering, 133, 10614. Chinmaya, P., Ayan, S., & Kumar, M. N. (2020). Fractal dimension based parameter adaptive dual channel PCNN for multi-focus image fusion. Optics and Lasers in Engineering, 133, 10614.
Metadaten
Titel
Deep Learning Method of Facial Expression Recognition Based on Gabor Filter Bank Combined with PCNN
verfasst von
Lisha Yao
Haifeng Zhao
Publikationsdatum
24.04.2023
Verlag
Springer US
Erschienen in
Wireless Personal Communications / Ausgabe 2/2023
Print ISSN: 0929-6212
Elektronische ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-023-10463-8

Weitere Artikel der Ausgabe 2/2023

Wireless Personal Communications 2/2023 Zur Ausgabe

Neuer Inhalt