Skip to main content
Erschienen in: Neural Processing Letters 3/2017

05.04.2017

A Brain-Inspired Method of Facial Expression Generation Using Chaotic Feature Extracting Bidirectional Associative Memory

verfasst von: Isar Nejadgholi, Seyyed Ali SeyyedSalehi, Sylvain Chartier

Erschienen in: Neural Processing Letters | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Human cognitive system adapts many different environments by exhibiting a broad range of behaviors according to the context. These behaviors vary from general abstractions referred as prototypes to specific perceptual patterns referred as exemplars. A chaotic feature extracting associative memory is proposed to mimic human brain in generating prototype and exemplar facial expressions. This model automatically extracts features of each category of images related to a specific subject and expression. In the training phase, the features are extracted as fixed points. In recall phase, the output attractor of the network ranges from fixed point which results in a prototype facial image, to chaotic attractors which lead to generating exemplar faces. The generative model is applied to enrich a facial image dataset in terms of variability by generating various virtual patterns, in case that only one image per subject is provided. A face recognition task is implemented to compare the enriched and original dataset in training classifiers. Our results show that recognition accuracy increases from 32 to 100% when exemplars generated by the proposed model are used to enrich the training dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Martinez B, Valstar MF (2016) Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok M, Celebi ME, Smolka B (eds) Advances in face detection and facial image analysis. Springer, Heidelberg, pp 63–100 Martinez B, Valstar MF (2016) Advances, challenges, and opportunities in automatic facial expression recognition. In: Kawulok M, Celebi ME, Smolka B (eds) Advances in face detection and facial image analysis. Springer, Heidelberg, pp 63–100
2.
Zurück zum Zitat Kamarol SKA, Jaward MH, Parkkinen J, Parthiban R (2016) Spatiotemporal feature extraction for facial expression recognition. IET Image Process 10:534–541CrossRef Kamarol SKA, Jaward MH, Parkkinen J, Parthiban R (2016) Spatiotemporal feature extraction for facial expression recognition. IET Image Process 10:534–541CrossRef
3.
Zurück zum Zitat Wen Y, Liu W, Yang M, Fu Y, Xiang Y, Hu R (2016) Structured occlusion coding for robust face recognition. Neurocomputing 178:11–24CrossRef Wen Y, Liu W, Yang M, Fu Y, Xiang Y, Hu R (2016) Structured occlusion coding for robust face recognition. Neurocomputing 178:11–24CrossRef
4.
Zurück zum Zitat Suja P, Thomas SM, Tripathi S, Madan VK (2016) Emotion recognition from images under varying illumination conditions. In: Balas V, Jain L, Kovačević B (eds) Soft computing applications. Advances in intelligent systems and computing, vol 357. Springer, pp 913–921 Suja P, Thomas SM, Tripathi S, Madan VK (2016) Emotion recognition from images under varying illumination conditions. In: Balas V, Jain L, Kovačević B (eds) Soft computing applications. Advances in intelligent systems and computing, vol 357. Springer, pp 913–921
5.
Zurück zum Zitat Peng X, Xia Z, Li L, Feng X (2016) Towards facial expression recognition in the wild: a new database and deep recognition system. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 93–99 Peng X, Xia Z, Li L, Feng X (2016) Towards facial expression recognition in the wild: a new database and deep recognition system. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 93–99
6.
Zurück zum Zitat Qi M, Li D (2009) Review of image-based facial expression generation techniques. In: Proceedings of international conference on computational intelligence and software engineering, 2009. CiSE 2009, IEEE, pp 1–5 Qi M, Li D (2009) Review of image-based facial expression generation techniques. In: Proceedings of international conference on computational intelligence and software engineering, 2009. CiSE 2009, IEEE, pp 1–5
7.
Zurück zum Zitat Korshunov P, Ebrahimi T (2013) Using face morphing to protect privacy. In: Proceedings of 10th IEEE international conference on 2013, advanced video and signal based surveillance (AVSS), IEEE, pp 208–213 Korshunov P, Ebrahimi T (2013) Using face morphing to protect privacy. In: Proceedings of 10th IEEE international conference on 2013, advanced video and signal based surveillance (AVSS), IEEE, pp 208–213
8.
Zurück zum Zitat Hu Y, Zhou M, Wu Z (2009) A dense point-to-point alignment method for realistic 3d face morphing and animation. Int J Comput Games Technol 2009:3CrossRef Hu Y, Zhou M, Wu Z (2009) A dense point-to-point alignment method for realistic 3d face morphing and animation. Int J Comput Games Technol 2009:3CrossRef
9.
Zurück zum Zitat Shirore D, Baji S (2015) Facial image morphing for animation using mesh warping method. Int J Comput Appl 109(6):18–22 Shirore D, Baji S (2015) Facial image morphing for animation using mesh warping method. Int J Comput Appl 109(6):18–22
10.
Zurück zum Zitat Liu S, Huang D-Y, Lin W, Dong M, Li H, Ong EP (2014) Emotional facial expression transfer based on temporal restricted boltzmann machines. In: Signal and information processing association annual summit and conference (APSIPA), 2014 Asia-Pacific, IEEE, pp 1–7 Liu S, Huang D-Y, Lin W, Dong M, Li H, Ong EP (2014) Emotional facial expression transfer based on temporal restricted boltzmann machines. In: Signal and information processing association annual summit and conference (APSIPA), 2014 Asia-Pacific, IEEE, pp 1–7
11.
Zurück zum Zitat Wei W, Tian C, Maybank SJ, Zhang Y (2016) Facial expression transfer method based on frequency analysis. Pattern Recognit 49:115–128CrossRef Wei W, Tian C, Maybank SJ, Zhang Y (2016) Facial expression transfer method based on frequency analysis. Pattern Recognit 49:115–128CrossRef
12.
Zurück zum Zitat Weise T, Bouaziz S, Li H, Pauly M (2011) Realtime performance-based facial animation. In: ACM transactions on graphics (TOG), ACM, vol 30, p 77 Weise T, Bouaziz S, Li H, Pauly M (2011) Realtime performance-based facial animation. In: ACM transactions on graphics (TOG), ACM, vol 30, p 77
13.
Zurück zum Zitat Testa RL, Muniz AHN, Carpio LUS, da Silva Dias R, de Almeida Rocca CC, Lima AM, dos Santos Nunes FdL, et al (2015) Generating facial emotions for diagnosis and training. In: IEEE 28th international symposium on computer-based medical systems, 2015, IEEE, pp 304–309 Testa RL, Muniz AHN, Carpio LUS, da Silva Dias R, de Almeida Rocca CC, Lima AM, dos Santos Nunes FdL, et al (2015) Generating facial emotions for diagnosis and training. In: IEEE 28th international symposium on computer-based medical systems, 2015, IEEE, pp 304–309
14.
Zurück zum Zitat Amini R, Lisetti C (2013) Hapfacs: An open source api/software to generate facs-based expressions for ecas animation and for corpus generation. In: Affective computing and intelligent interaction (ACII), Humaine association conference on 2013, pp 270–275, IEEE Amini R, Lisetti C (2013) Hapfacs: An open source api/software to generate facs-based expressions for ecas animation and for corpus generation. In: Affective computing and intelligent interaction (ACII), Humaine association conference on 2013, pp 270–275, IEEE
15.
Zurück zum Zitat Ekman P, Freisen WV, Ancoli S (1980) Facial signs of emotional experience. J Personal Soc Psychol 39(6):1125CrossRef Ekman P, Freisen WV, Ancoli S (1980) Facial signs of emotional experience. J Personal Soc Psychol 39(6):1125CrossRef
16.
Zurück zum Zitat Ekman P, Friesen W, Hager J (2002) Facial action coding system: the manual on CD ROM. A Human Face, Salt Lake City Ekman P, Friesen W, Hager J (2002) Facial action coding system: the manual on CD ROM. A Human Face, Salt Lake City
17.
Zurück zum Zitat Hamm J, Kohler CG, Gur RC, Verma R (2011) Automated facial action coding system for dynamic analysis of facial expressions in neuropsychiatric disorders. J Neurosci Methods 200(2):237–256CrossRef Hamm J, Kohler CG, Gur RC, Verma R (2011) Automated facial action coding system for dynamic analysis of facial expressions in neuropsychiatric disorders. J Neurosci Methods 200(2):237–256CrossRef
18.
Zurück zum Zitat Yan X, Yang J, Sohn K, Lee H (2015) Attribute2image: Conditional image generation from visual attributes. arXiv preprint arXiv:1512.00570 Yan X, Yang J, Sohn K, Lee H (2015) Attribute2image: Conditional image generation from visual attributes. arXiv preprint arXiv:​1512.​00570
19.
Zurück zum Zitat Posner J, Russell JA, Peterson BS (2005) The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 17(03):715–734CrossRef Posner J, Russell JA, Peterson BS (2005) The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 17(03):715–734CrossRef
20.
Zurück zum Zitat Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef
21.
Zurück zum Zitat Darwin C, Ekman P, Prodger P (1998) The expression of the emotions in man and animals. Oxford University Press, Oxford Darwin C, Ekman P, Prodger P (1998) The expression of the emotions in man and animals. Oxford University Press, Oxford
22.
Zurück zum Zitat Ekman P (1999) Facial expressions. Handb Cognit Emot 16:301–320 Ekman P (1999) Facial expressions. Handb Cognit Emot 16:301–320
23.
Zurück zum Zitat Harris RJ, Young AW, Andrews TJ (2012) Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain. Proc Natl Acad Sci 109(51):21164–21169CrossRef Harris RJ, Young AW, Andrews TJ (2012) Morphing between expressions dissociates continuous from categorical representations of facial expression in the human brain. Proc Natl Acad Sci 109(51):21164–21169CrossRef
24.
Zurück zum Zitat Fisher K, Towler J, Eimer M (2016) Facial identity and facial expression are initially integrated at visual perceptual stages of face processing. Neuropsychologia 80:115–125CrossRef Fisher K, Towler J, Eimer M (2016) Facial identity and facial expression are initially integrated at visual perceptual stages of face processing. Neuropsychologia 80:115–125CrossRef
25.
Zurück zum Zitat Meaux E, Vuilleumier P (2016) Facing mixed emotions: analytic and holistic perception of facial emotion expressions engages separate brain networks. NeuroImage 141:154–173CrossRef Meaux E, Vuilleumier P (2016) Facing mixed emotions: analytic and holistic perception of facial emotion expressions engages separate brain networks. NeuroImage 141:154–173CrossRef
26.
Zurück zum Zitat Tsuda I (2001) Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behav Brain Sci 24(05):793–810CrossRef Tsuda I (2001) Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. Behav Brain Sci 24(05):793–810CrossRef
27.
Zurück zum Zitat Adachi M, Aihara K (1997) Associative dynamics in a chaotic neural network. Neural Netw 10(1):83–98CrossRef Adachi M, Aihara K (1997) Associative dynamics in a chaotic neural network. Neural Netw 10(1):83–98CrossRef
28.
Zurück zum Zitat Chartier S, Renaud P, Boukadoum M (2008) A nonlinear dynamic artificial neural network model of memory. New Ideas Psychol 26(2):252–277CrossRef Chartier S, Renaud P, Boukadoum M (2008) A nonlinear dynamic artificial neural network model of memory. New Ideas Psychol 26(2):252–277CrossRef
29.
Zurück zum Zitat Huang Y, Zhang H, Wang Z (2012) Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions. Appl Math Comput 219(3):899–910MathSciNetMATH Huang Y, Zhang H, Wang Z (2012) Multistability and multiperiodicity of delayed bidirectional associative memory neural networks with discontinuous activation functions. Appl Math Comput 219(3):899–910MathSciNetMATH
30.
Zurück zum Zitat Susskind JM, Anderson AK, Hinton GE, Movellan JR (2008) Generating facial expressions with deep belief nets. INTECH Open Access Publisher, Rijeka Susskind JM, Anderson AK, Hinton GE, Movellan JR (2008) Generating facial expressions with deep belief nets. INTECH Open Access Publisher, Rijeka
31.
Zurück zum Zitat Nejadgholi I, Chartier S, Seyyedsalehi SA (2013) Controlling deterministic output variability in a feature extracting chaotic BAM. Neurocomputing 120:298–309CrossRef Nejadgholi I, Chartier S, Seyyedsalehi SA (2013) Controlling deterministic output variability in a feature extracting chaotic BAM. Neurocomputing 120:298–309CrossRef
32.
Zurück zum Zitat Chartier S, Giguère G, Renaud P, Lina J-M, Proulx R (2007) Febam: a feature-extracting bidirectional associative memory. In: International joint conference on neural networks, 2007. IJCNN 2007, IEEE, pp 1679–1684 Chartier S, Giguère G, Renaud P, Lina J-M, Proulx R (2007) Febam: a feature-extracting bidirectional associative memory. In: International joint conference on neural networks, 2007. IJCNN 2007, IEEE, pp 1679–1684
33.
Zurück zum Zitat Sutton RS (1988) Learning to predict by the methods of temporal differences. Mach Learn 3(1):9–44 Sutton RS (1988) Learning to predict by the methods of temporal differences. Mach Learn 3(1):9–44
34.
Zurück zum Zitat Kosko B (1990) Unsupervised learning in noise. Neural Netw IEEE Trans 1(1):44–57CrossRef Kosko B (1990) Unsupervised learning in noise. Neural Netw IEEE Trans 1(1):44–57CrossRef
35.
Zurück zum Zitat Chartier S, Boukadoum M (2006) A bidirectional heteroassociative memory for binary and grey-level patterns. Neural Netw IEEE Trans 17(2):385–396CrossRef Chartier S, Boukadoum M (2006) A bidirectional heteroassociative memory for binary and grey-level patterns. Neural Netw IEEE Trans 17(2):385–396CrossRef
36.
Zurück zum Zitat Nomura S, Yamanaka K, Katai O, Kawakami H, Shiose T (2005) Improved mlp learning via orthogonal bipolar target vectors. J Adv Comput Intell Intell Inf 9(6):580–589CrossRef Nomura S, Yamanaka K, Katai O, Kawakami H, Shiose T (2005) Improved mlp learning via orthogonal bipolar target vectors. J Adv Comput Intell Intell Inf 9(6):580–589CrossRef
37.
Zurück zum Zitat Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of fourth IEEE international conference on automatic face and gesture recognition, 2000, IEEE, pp 46–53 Kanade T, Cohn JF, Tian Y (2000) Comprehensive database for facial expression analysis. In: Proceedings of fourth IEEE international conference on automatic face and gesture recognition, 2000, IEEE, pp 46–53
38.
Zurück zum Zitat Hosoya H, Hyvärinen A (2016) Learning visual spatial pooling by strong pca dimension reduction. Neural Comput 28(7):1249–1264 Hosoya H, Hyvärinen A (2016) Learning visual spatial pooling by strong pca dimension reduction. Neural Comput 28(7):1249–1264
39.
Zurück zum Zitat Haxby JV, Hoffman EA, Gobbini MI (2002) Human neural systems for face recognition and social communication. Biol Psychiatry 51(1):59–67CrossRef Haxby JV, Hoffman EA, Gobbini MI (2002) Human neural systems for face recognition and social communication. Biol Psychiatry 51(1):59–67CrossRef
Metadaten
Titel
A Brain-Inspired Method of Facial Expression Generation Using Chaotic Feature Extracting Bidirectional Associative Memory
verfasst von
Isar Nejadgholi
Seyyed Ali SeyyedSalehi
Sylvain Chartier
Publikationsdatum
05.04.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9615-5

Weitere Artikel der Ausgabe 3/2017

Neural Processing Letters 3/2017 Zur Ausgabe

Neuer Inhalt