nach oben

Neural Computing and Applications

Erschienen in:

01.04.2022 | Review

Deep learning-based microexpression recognition: a survey

verfasst von: Wenjuan Gong, Zhihong An, Noha M. Elfiky

Erschienen in: Neural Computing and Applications | Ausgabe 12/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

With the recent development of microexpression recognition, deep learning (DL) has been widely applied in this field. In this paper, we provide a comprehensive survey of the current DL-based microexpression (ME) recognition methods. In addition, we introduce a novel dataset based on fusing all the existing ME datasets. We also evaluate a baseline DL for the microexpression recognition task. Finally, we make the new dataset and the code publicly available to the community at https://github.com/wenjgong/microExpressionSurvey.

Vorheriger Artikel Deep learning techniques to classify agricultural crops through UAV imagery: a review

Nächster Artikel A survey of visual and procedural handwriting analysis for neuropsychological assessment

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

https://github.com/xiaobaishu0097/MEGC2019.

https://github.com/IcedDoggie/DSSN-MER.

https://github.com/bogireddytejareddy/micro-expression-recognition.

https://github.com/christy1206/STSTNet.

https://github.com/CodeShareBot/ACII19-Apex-Time-Network.

https://github.com/IcedDoggie/Micro-Expression-with-Deep-Learning.

https://github.com/quangdtsc/megc2019

Aouayeb M, Hamidouche W, Kpalma K, Benazza-Benyahia A (2019) A spatiotemporal deep learning solution for automatic micro-expressions recognition from local facial regions. In: 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP), pp 1–6. IEEE

Barron JL, Fleet DJ, Beauchemin SS (1994) Performance of optical flow techniques. Int J Comput Vis 12:43–77. https://doi.org/10.1007/BF01420984CrossRef

Belaiche R, Liu Y, Migniot C, Ginhac D, Yang F (2020) Cost-effective CNNs for real-time micro-expression recognition. Appl Sci (Switzerland). https://doi.org/10.3390/app10144959CrossRef

Borza D, Itu R, Danescu R (2018) Micro expression detection and recognition from high speed cameras using convolutional neural networks. VISIGRAPP 2018 - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications 5(January), 201–208. https://doi.org/10.5220/0006548802010208

Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell SystTechnol (TIST) 2(3):1–27CrossRef

Chaudhry R, Ravichandran A, Hager G, Vidal R (2009) Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp 1932–1939. IEEE

Chen B, Zhang Z, Liu N, Tan Y, Liu X, Chen T (2020) Spatiotemporal convolutional neural network with convolutional block attention module for micro-expression recognition. Information (Switzerland). https://doi.org/10.3390/INFO11080380CrossRef

Chen C, Crivelli C, Garrod O, Schyns PG, Jack RE (2018) Distinct facial expressions represent pain and pleasure across cultures. Proc Natl Acad Sci 115(43):201807862CrossRef

Chen H, Liu X, Li X, Shi H, Zhao G (2019) Analyze spontaneous gestures for emotional stress state recognition: a micro-gesture dataset and analysis with deep learning. In: 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019)

10.

Chen L.C, Papandreou G, Kokkinos I, Murphy K, Yuille A.L (2014) Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv preprint arXiv:1412.7062

11.

Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078

12.

Choi DY, Song BC (2020) Facial micro-expression recognition using two-dimensional landmark feature maps. IEEE Access 8:121549–121563. https://doi.org/10.1109/ACCESS.2020.3006958CrossRef

13.

Dang M, Wang H (2020) A survey of facial expression recognition methods based on deep leaming. Sci Technol Eng 20(24):9724

14.

Davison AK, Lansley C, Costen N, Tan K, Yap MH (2016) Samm: a spontaneous micro-facial movement dataset. IEEE Trans Affect Comput 9(1):116–129CrossRef

15.

Diyasa G, Fauzi A, Idhom M, Setiawan A (2021) Multi-face recognition for the detection of prisoners in jail using a modified cascade classifier and cnn. J Phys Conf Ser 1844:012005CrossRef

16.

Du S, Martinez AM (2015) Compound facial expressions of emotion: from basic research to clinical applications. Dial Clin Neurosci 17(4):443CrossRef

17.

Du S, Tao Y, Martinez AM (2014) Compound facial expressions of emotion. Proc Natl Acad Sci U S A 111(15):E1454CrossRef

18.

Farnebck G (2003) Two-frame motion estimation based on polynomial expansion. In: 13th Scandinavian Conference on Image Analysis (SCIA 2003)

19.

Gan YS, Liong ST, Yau WC, Huang YC, Tan LK (2019) OFF-ApexNet on micro-expression recognition system. Signal Process Image Commun 74(May):129–139. https://doi.org/10.1016/j.image.2019.02.005CrossRef

20.

Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V (2017) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):2096MathSciNetMATH

21.

Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. In: Proceedings of Advances in Neural Information Processing Systems, pp 2672–2680

22.

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

23.

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778

24.

Heaven D (2020) Why faces don’t always tell the truth about feelings. Nature 578(7796):502–504. https://doi.org/10.1038/d41586-020-00507-5CrossRef

25.

Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef

26.

Horn B, Schunck BG (1981) Determining optical flow. Artificial Intell 17(1–3):185–203CrossRef

27.

Hu C, Jiang D, Zou H, Zuo X, Shu Y (2018) Multi-task micro-expression recognition combining deep and handcrafted features. In: 2018 24th International Conference on Pattern Recognition (ICPR), pp. 946–951. IEEE

28.

Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7132–7141

29.

Ilg E, Mayer N, Saikia T, Keuper M, Dosovitskiy A, Brox T (2017) Flownet 2.0: Evolution of optical flow estimation with deep networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2462–2470

30.

Ji S, Xu W, Yang M, Yu K (2013) 3D convolutional neural networks for human action recognition. IEEE Trans Pattern Anal Mach Intell 35(1):221–231CrossRef

31.

Jingting L, Wang S.J, Yap M.H, See J, Hong X, Li X (2020) Megc2020-the third facial micro-expression grand challenge. In: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 777–780. IEEE

32.

Justesen N, Bontrager P, Togelius J, Risi S (2020) Deep learning for video game playing. IEEE Trans Games 12(1):1–20. https://doi.org/10.1109/TG.2019.2896986CrossRef

33.

Karmakar P, Teng S.W, Lu G (2021) Thank you for attention: a survey on attention-based artificial neural networks for automatic speech recognition. arXiv preprint arXiv:2102.07259

34.

Khor H.Q, See J, Liong S.T, Phan R.C, Lin W (2019) Dual-stream shallow networks for facial micro-expression recognition. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 36–40. IEEE

35.

Khor H.Q, See J, Phan R.C.W, Lin W (2018) Elrcn. In: IEEE International Conference on Automatic Face & Gesture Recognition

36.

Kim D.H, Baddar W.J, Ro Y.M (2016) Micro-expression recognition with expression-state constrained spatio-temporal feature representations. MM 2016 - Proceedings of the 2016 ACM Multimedia Conference pp. 382–386. https://doi.org/10.1145/2964284.2967247

37.

Kipf T.N, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907

38.

Krizhevsky A, Sutskever I, Hinton G (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings Advances in Neural Information Processing Systems, pp 1097–1105

39.

Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inform Process Syst 25:1097–1105

40.

Li J, Wang Y, See J, Liu W (2019) Micro-expression recognition based on 3D flow convolutional neural network. Pattern Anal Appl 22(4):1331–1339. https://doi.org/10.1007/s10044-018-0757-5MathSciNetCrossRef

41.

Li Q, Yu J, Kurihara T, Zhang H, Zhan S (2020) Deep convolutional neural network with optical flow for facial micro-expression recognition. J Circuits, Syst Comput 29(1):1–18. https://doi.org/10.1142/S0218126620500061CrossRef

42.

Li X, Pfister T, Huang X, Zhao G, Pietikäinen M (2013) A spontaneous micro-expression database: Inducement, collection and baseline. In: Proceedings of IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp 1-6

43.

Li Y, Huang X, Zhao G (2018) Can Micro-Expression be Recognized Based on Single Apex Frame? Proceedings - International Conference on Image Processing, ICIP pp. 3094–3098. https://doi.org/10.1109/ICIP.2018.8451376

44.

Liang M, Hu X (2015) Recurrent convolutional neural network for object recognition. In: IEEE Conference on Computer Vision & Pattern Recognition, pp 3367–3375

45.

Liong S.T, Gan Y.S, See J, Khor H.Q, Huang Y.C (2019) Shallow triple stream three-dimensional CNN (STSTNet) for micro-expression recognition. In: Proceedings of IEEE International Conference on Automatic Face & Gesture Recognition, pp 1–5

46.

Liong ST, Gan YS, Zheng D, Li SM, Xu HX, Zhang HZ, Lyu RK, Liu KH (2019) Evaluation of the spatio-temporal features and GAN for micro-expression recognition system. J Sign Process Syst (92):705–725. https://doi.org/10.1007/s11265-020-01523-4

47.

Liong S.T, See J, Wong K.S, Le Ngo A.C, Oh Y.H, Phan R (2016) Automatic apex frame spotting in micro-expression database. Proceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015 (June 2016), 665–669. https://doi.org/10.1109/ACPR.2015.7486586

48.

Liu H, Simonyan K, Yang Y (2018) Darts: Differentiable architecture search. arXiv preprint arXiv:1806.09055

49.

Liu Y, Du H, Zheng L, Gedeon T (2019) A neural micro-expression recognizer. Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 pp. 1–4. https://doi.org/10.1109/FG.2019.8756583

50.

Lo L, Xie H.X, Shuai H.H, Cheng W.H (2020) MER-GCN: Micro-Expression Recognition Based on Relation Modeling with Graph Convolutional Networks. Proceedings - 3rd International Conference on Multimedia Information Processing and Retrieval, MIPR 2020 pp. 79–84. https://doi.org/10.1109/MIPR49039.2020.00023

51.

Lucey P, Cohn J.F, Kanade T, Saragih J, Matthews I (2010) The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression. In: Computer Vision & Pattern Recognition Workshops

52.

Mayya V, Pai R.M, Pai M.M (2016) Combining temporal interpolation and DCNN for faster recognition of micro-expressions in video sequences. 2016 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2016 pp. 699–703. https://doi.org/10.1109/ICACCI.2016.7732128

53.

Merghani W, Davison A.K, Yap M.H (2018) A Review on Facial Micro-Expressions Analysis: Datasets, Features and Metrics pp. 1–19. http://arxiv.org/abs/1805.02397

54.

Minu M, Arun K, Tiwari A, Rampuria P (2020) Face recognition system based on haar cascade classifier. Int. J. Adv. Sci. Technol. 29(5):3799–3805

55.

Nag S, Bhunia A.K, Konwer A, Roy P.P (2019) Facial micro-expression spotting and recognition using time contrasted feature with visual memory. In: ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2022–2026. IEEE

56.

Nistor S.C (2020) Multi-Staged Training of Deep Neural Networks for Micro-Expression Recognition. SACI 2020 - IEEE 14th International Symposium on Applied Computational Intelligence and Informatics, Proceedings pp. 29–34. https://doi.org/10.1109/SACI49304.2020.9118811

57.

Odena A, Olah C, Shlens J (2017) Conditional image synthesis with auxiliary classifier gans. In: Proceedings of International Conference on Machine Learning, Vol 70, pp 2642–2651

58.

Oh YH, See J, Le Ngo AC, Phan RC, Baskaran VM (2018) A survey of automatic facial micro-expression analysis: databases, methods, and challenges. Front Psychol. https://doi.org/10.3389/fpsyg.2018.01128CrossRef

59.

Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987CrossRef

60.

Ojala T, Pietik Inen M, Harwood D (1996) A comparative study of texture measures with classification based on feature distributions. Pattern Recogn 29(1):51–59CrossRef

61.

Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. In: Proceedings of the British Machine Vision Conference, pp 41.1–41.12

62.

Patel D, Hong X, Zhao G (2016) Selective deep features for micro-expression recognition. Proceedings - International Conference on Pattern Recognition 0(i), 2258–2263. https://doi.org/10.1109/ICPR.2016.7899972

63.

Peng M, Wang C, Bi T, Chen T, Shi Y (2019) A Novel Apex-Time Network for Cross-Dataset Micro-Expression Recognition. In: 8th International Conference on Affective Computing and Intelligent Interaction (ACII)

64.

Peng M, Wang C, Chen T, Liu G, Fu X (2017) Dual temporal scale convolutional neural network for micro-expression recognition. Front Psychol. https://doi.org/10.3389/fpsyg.2017.01745CrossRef

65.

Peng M, Wu Z, Zhang Z, Chen T (2018) From macro to micro expression recognition: Deep learning on small datasets using transfer learning. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 pp. 657–661. https://doi.org/10.1109/FG.2018.00103

66.

Pfister T, Li X, Zhao G, Pietikäinen M (2011) Recognising spontaneous facial micro-expressions. In: Proceedings of International Conference on Computer Vision, pp 1449–1456

67.

Reddy SPT, Karri ST, Dubey SR, Mukherjee S (2019) Spontaneous facial micro-expression recognition using 3d spatiotemporal convolutional neural networks. In: Proceedings of International Joint Conference on Neural Networks, pp 1–8

68.

Sabour S, Frosst N, Hinton G.E (2017) Dynamic routing between capsules. arXiv preprint arXiv:1710.09829

69.

See J, Yap M.H, Li J, Hong X, Wang S.J (2019) MEGC 2019 - The second facial micro-expressions grand challenge. Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 pp. 1–5. https://doi.org/10.1109/FG.2019.8756611

70.

Senst T, Eiselein V, Sikora T (2012) Robust local optical flow for feature tracking. IEEE Trans Circuits Syst Video Technol 22(9):1377–1387CrossRef

71.

Song B, Li K, Zong Y, Zhu J, Zheng W, Shi J, Zhao L (2019) Recognizing spontaneous micro-expression using a three-stream convolutional neural network. IEEE Access 7:184537–184551. https://doi.org/10.1109/ACCESS.2019.2960629CrossRef

72.

Taini M, Zhao G, Li S.Z, Pietikainen M (2008) Facial expression recognition from near-infrared video sequences. In: 19th International Conference on Pattern Recognition (ICPR 2008), December 8-11, 2008, Tampa, Florida, USA

73.

Takalkar M.A, Xu M (2017) Image based facial micro-expression recognition using deep learning on small datasets. In: 2017 international conference on digital image computing: techniques and applications (DICTA), pp. 1–7. IEEE

74.

Takalkar MA, Xu M, Chaczko Z (2020) Manifold feature integration for micro-expression recognition. Multimedia Syst 26(5):535–551. https://doi.org/10.1007/s00530-020-00663-8CrossRef

75.

Takalkar M.A, Zhang H, Xu M (2019) Improving micro-expression recognition accuracy using twofold feature extraction. In: Proceedings of International Conference on MultiMedia Modeling, pp 652–664

76.

Tokmakov P, Alahari K, Schmid C (2017) Learning motion patterns in videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3386–3394

77.

Van Quang N, Chun J, Tokuyama T (2019) CapsuleNet for micro-expression recognition. Proceedings - 14th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2019 pp. 1–7. https://doi.org/10.1109/FG.2019.8756544

78.

Verma M, Vipparthi SK, Singh G (2020) Non-Linearities Improve OrigiNet based on Active Imaging for Micro Expression Recognition. Proceedings of the International Joint Conference on Neural Networks. https://doi.org/10.1109/IJCNN48605.2020.9207718

79.

Verma M, Vipparthi S.K, Singh G, Subrahmanyam M (2019) LEARNet: Dynamic Imaging Network for Micro Expression Recognition. arXiv preprint arXiv: 1904.09410

80.

Wang C, Peng M, Bi T, Chen T (2020) Micro-attention for micro-expression recognition. Neurocomputing 410:354–362. https://doi.org/10.1016/j.neucom.2020.06.005CrossRef

81.

Wang SJ, Li BJ, Liu YJ, Yan WJ, Ou X, Huang X, Xu F, Fu X (2018) Micro-expression recognition with small sample size by transferring long-term convolutional neural network. Neurocomputing 312:251–262. https://doi.org/10.1016/j.neucom.2018.05.107CrossRef

82.

Wedel Pock, Braun Franke, (2009) Cremers: Duality tv-l1 flow with fundamental matrix prior. In: Image & Vision Computing New Zealand, Ivcnz International Conference

83.

Woo S, Park J, Lee J.Y, Kweon I.S (2018) Cbam: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp. 3–19

84.

Wu C, Guo F (2021) TSNN: three-stream combining 2D and 3D convolutional neural network for micro-expression recognition. IEEJ Trans Electric Electron Eng 16(1):98–107. https://doi.org/10.1002/tee.23272CrossRef

85.

Wu H.Y, Rubinstein M, Shih E, Guttag J, Freeman W (2012) Eulerian video magnification for revealing subtle changes in the world. In: SIGGRAPH

86.

Xia Z, Feng X, Hong X, Zhao G (2019) Spontaneous facial micro-expression recognition via deep convolutional network. 2018 8th International Conference on Image Processing Theory, Tools and Applications, IPTA 2018 - Proceedings pp. 1–6. https://doi.org/10.1109/IPTA.2018.8608119

87.

Xia Z, Hong X, Gao X, Feng X, Zhao G (2020) Spatiotemporal recurrent convolutional networks for recognizing spontaneous micro-expressions. IEEE Trans Multi 22:626–640CrossRef

88.

Xia Z, Liang H, Hong X, Feng X (2019) Cross-database micro-expression recognition with deep convolutional networks. ACM International Conference Proceeding Series pp. 56–60. https://doi.org/10.1145/3345336.3345343

89.

Xia Z, Peng W, Khor HQ, Feng X, Zhao G (2020) Revealing the invisible with model and data Shrinking for composite-database micro-expression Recognition. IEEE Trans Image Process 29(AUGUST):8590–8605. https://doi.org/10.1109/TIP.2020.3018222CrossRef

90.

Xie H.X, Lo L, Shuai H.H, Cheng W.H (2020) An Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge pp. 1–20. http://arxiv.org/abs/2012.11307

91.

Yan WJ, Li X, Wang SJ, Zhao G, Liu YJ, Chen YH, Fu X (2014) Casme ii: an improved spontaneous micro-expression database and the baseline evaluation. Plos One 9(1):e86041CrossRef

92.

Yan W.J, Wu Q, Liu Y.J, Wang S.J, Fu X (2013) Casme database: A dataset of spontaneous micro-expressions collected from neutralized faces. In: IEEE International Conference & Workshops on Automatic Face & Gesture Recognition

93.

Yang H, Wang XA (2016) Cascade classifier for face detection. J Algorithms Comput Technol 10(3):187–197MathSciNetCrossRef

94.

Yap M.H, See J, Hong X, Wang S.J (2018) Facial micro-expressions grand challenge 2018 summary. Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018 pp. 675–678. https://doi.org/10.1109/FG.2018.00106

95.

Yu J, Zhang C, Song Y, Cai W (2020) ICE-GAN: Identity-aware and capsule-enhanced gan for micro-expression recognition and synthesis. arXiv preprint arXiv: 2005.04370

96.

Zhang H, Goodfellow I, Metaxas D, Odena A (2019) Self-attention generative adversarial networks. In: Proceedings of International Conference on Machine Learning, vol 97, pp 7354–7363

97.

Zhang L, Arandjelovic O (2021) Review of automatic micro-expression recognition in the past decade. Mach Learn Knowl Extract. https://doi.org/10.3390/make3020021CrossRef

98.

Zhang L, Arandjelović O (2021) Review of automatic microexpression recognition in the past decade. Mach Learn Knowl Extract 3(2):414–434. https://doi.org/10.3390/make3020021CrossRef

99.

Zhao G, Li X (2019) Automatic micro-expression analysis: open challenges. Front Psychol 10:1–4. https://doi.org/10.3389/fpsyg.2019.01833CrossRef

100.

Zhao Y, Xu J (2019) A convolutional neural network for compound micro-expression recognition. Sensors (Switzerland). https://doi.org/10.3390/s19245553CrossRef

101.

Zhi R, Xu H, Wan M, Li T (2019) Combining 3d convolutional neural networks with transfer learning by supervised pre-training for facial micro-expression recognition. IEICE Trans Inform Syst 102(5):1054–1064CrossRef

102.

Zhou J, Hong X, Su F, Zhao G (2016) Recurrent convolutional neural network regression for continuous pain intensity estimation in video. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp. 84–92

103.

Zhou L, Mao Q, Xue L (2019) Cross-database micro-expression recognition: A style aggregated and attention transfer approach. Proceedings - 2019 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2019 pp. 102–107. https://doi.org/10.1109/ICMEW.2019.00025

104.

Zhou L, Mao Q, Xue L (2019) Dual-Inception Network for Cross-Database Micro-Expression Recognition. In: 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019)

105.

Zhu J.Y, Park T, Isola P, Efros A.A (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp. 2223–2232

Titel: Deep learning-based microexpression recognition: a survey
verfasst von: Wenjuan Gong
Zhihong An
Noha M. Elfiky
Publikationsdatum: 01.04.2022
Verlag: Springer London
Erschienen in: Neural Computing and Applications / Ausgabe 12/2022
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI: https://doi.org/10.1007/s00521-022-07157-w

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Weitere Artikel der Ausgabe 12/2022

The multi-mode operation decision of cleaning robot based on curriculum learning strategy and feedback network

Research on control strategy and policy optimal scheduling based on an improved genetic algorithm

Image simulation of urban landscape in coastal areas based on geographic information system and machine learning

Reference-guided face inpainting with reference attention network

Iterative facial image inpainting based on an encoder-generator architecture

LRTI: landmark ratios with task importance toward accurate age estimation using deep neural networks

Premium Partner