Skip to main content
Erschienen in: Neural Computing and Applications 4/2017

19.11.2015 | Original Article

Application of emotion affected associative memory based on mood congruency effects for a humanoid

verfasst von: Naoki Masuyama, Md. Nazrul Islam, Manjeevan Seera, Chu Kiong Loo

Erschienen in: Neural Computing and Applications | Ausgabe 4/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Emotional factor plays an important role in communication. In the field of psychology, it is known that memory and emotions are closely related to each other. In this paper, we present the significance of emotional factors to associative memory in communication and apply it on human–robot interaction problems. Emotional models for the robot partner are developed, and an interactive robot system with a complex-valued multi-directional associative memory model is proposed. We utilize multi-modal information such as object, gesture, voice, and facial expressions to associate the relationships in associative memory, and generate the emotional information for the robot partner. As a result, the robot partner is able to perform various actions depending on the emotional factors. Results from the interactive experiments indicate possibility of suitable information for communication space being provided from the robot partner.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Pfeifer R, Scheier C (1999) Understanding intelligence. The MIT Press, Cambridge Pfeifer R, Scheier C (1999) Understanding intelligence. The MIT Press, Cambridge
2.
Zurück zum Zitat Gregory RL (1998) The mind. Oxford Univ Press, Oxford Gregory RL (1998) The mind. Oxford Univ Press, Oxford
3.
Zurück zum Zitat Sperber D, Wilson D (1995) Relevance: communication and cognition. Oxford Univ Press, Oxford Sperber D, Wilson D (1995) Relevance: communication and cognition. Oxford Univ Press, Oxford
4.
Zurück zum Zitat Minsky M (1986) The society of mind. Simon and Schuster, New York Minsky M (1986) The society of mind. Simon and Schuster, New York
5.
Zurück zum Zitat Yorita A, Kubota N (2011) Cognitive development in partner robots for information support to elderly people. IEEE Trans Auton Ment Dev 3(1):64–73CrossRef Yorita A, Kubota N (2011) Cognitive development in partner robots for information support to elderly people. IEEE Trans Auton Ment Dev 3(1):64–73CrossRef
6.
Zurück zum Zitat Zheng K, Glas DF, Kanda T, Ishiguro H, Hagita N (2013) Designing and implementing a human–robot team for social interactions. IEEE Trans Syst Man Cybern Syst 43(4):843–859CrossRef Zheng K, Glas DF, Kanda T, Ishiguro H, Hagita N (2013) Designing and implementing a human–robot team for social interactions. IEEE Trans Syst Man Cybern Syst 43(4):843–859CrossRef
7.
Zurück zum Zitat Toris R, Kent D, Chernova S (2014) The robot management system: A framework for conducting human–robot interaction studies through crowdsourcing. J Hum Robot Interact 3(2):25–49CrossRef Toris R, Kent D, Chernova S (2014) The robot management system: A framework for conducting human–robot interaction studies through crowdsourcing. J Hum Robot Interact 3(2):25–49CrossRef
8.
Zurück zum Zitat Bechara A, Damasio H, Damasio AR (2000) Emotion, decision making and the orbitofrontal cortex. Cereb Cortex 10(3):295–307CrossRef Bechara A, Damasio H, Damasio AR (2000) Emotion, decision making and the orbitofrontal cortex. Cereb Cortex 10(3):295–307CrossRef
9.
Zurück zum Zitat Reisberg DE, Hertel PE (2004) Memory and emotion. Oxford University Press, OxfordCrossRef Reisberg DE, Hertel PE (2004) Memory and emotion. Oxford University Press, OxfordCrossRef
10.
Zurück zum Zitat Ekkekakis P (2013) The measurement of affect, mood, and emotion: a guide for health-behavioral research. Cambridge University Press, CambridgeCrossRef Ekkekakis P (2013) The measurement of affect, mood, and emotion: a guide for health-behavioral research. Cambridge University Press, CambridgeCrossRef
11.
12.
Zurück zum Zitat Rosenblatt F (1958) The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386CrossRef Rosenblatt F (1958) The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev 65(6):386CrossRef
13.
Zurück zum Zitat Aizenberg N, Ivaskiv YL, Pospelov D, Hudiakov G (1973) Multiple-valued threshold functions. II. Synthesis of the multi-valued threshold elements. Kibernetika (Cybernetics) 1:53–66 Aizenberg N, Ivaskiv YL, Pospelov D, Hudiakov G (1973) Multiple-valued threshold functions. II. Synthesis of the multi-valued threshold elements. Kibernetika (Cybernetics) 1:53–66
14.
Zurück zum Zitat Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558MathSciNetCrossRef Hopfield JJ (1982) Neural networks and physical systems with emergent collective computational abilities. Proc Natl Acad Sci 79(8):2554–2558MathSciNetCrossRef
15.
Zurück zum Zitat Kosko B (1987) Constructing an associative memory. Byte 12(10):137–144 Kosko B (1987) Constructing an associative memory. Byte 12(10):137–144
16.
Zurück zum Zitat Hagiwara M (1990) Multidirectional associative memory. In: International joint conference on neural networks, vol 1, pp 3–6 Hagiwara M (1990) Multidirectional associative memory. In: International joint conference on neural networks, vol 1, pp 3–6
17.
Zurück zum Zitat Noest A (1988) Discrete-state phasor neural networks. Phys Rev A 38(4):2196–2199CrossRef Noest A (1988) Discrete-state phasor neural networks. Phys Rev A 38(4):2196–2199CrossRef
18.
Zurück zum Zitat Jankowski S, Lozowski A, Zurada J (1996) Complex-valued multistate neural associative memory. IEEE Trans Neural Netw 7(6):1491–1496CrossRef Jankowski S, Lozowski A, Zurada J (1996) Complex-valued multistate neural associative memory. IEEE Trans Neural Netw 7(6):1491–1496CrossRef
19.
Zurück zum Zitat Donq-Liang L, Wen-June W (1998) A multivalued bidirectional associative memory operating on a complex domain. Neural Netw 11(9):1623–1635CrossRef Donq-Liang L, Wen-June W (1998) A multivalued bidirectional associative memory operating on a complex domain. Neural Netw 11(9):1623–1635CrossRef
20.
Zurück zum Zitat Kobayashi M, Yamazaki H (2005) Complex-valued multidirectional associative memory. IEEJ Trans Electron Inf Syst 125:1290–1295 Kobayashi M, Yamazaki H (2005) Complex-valued multidirectional associative memory. IEEJ Trans Electron Inf Syst 125:1290–1295
21.
22.
Zurück zum Zitat Kitahara M, Kobayashi M (2014) Projection rule for rotor hopfield neural networks. IEEE Trans Neural Netw Learn Syst 25(7):1298–1307CrossRef Kitahara M, Kobayashi M (2014) Projection rule for rotor hopfield neural networks. IEEE Trans Neural Netw Learn Syst 25(7):1298–1307CrossRef
23.
Zurück zum Zitat Oh H, Kothari SC (1994) Adaptation of the relaxation method for learning in bidirectional associative memory. IEEE Trans Neural Netw 5(4):576–583CrossRef Oh H, Kothari SC (1994) Adaptation of the relaxation method for learning in bidirectional associative memory. IEEE Trans Neural Netw 5(4):576–583CrossRef
24.
Zurück zum Zitat Shimizu Y, Osana Y (2010) Chaotic complex-valued multidirectional associative memory. In: IASTED artificial intelligence and applications Shimizu Y, Osana Y (2010) Chaotic complex-valued multidirectional associative memory. In: IASTED artificial intelligence and applications
25.
Zurück zum Zitat Yoshida A, Osana Y (2011) Chaotic complex-valued multidirectional associative memory with variable scaling factor. In: Artificial neural networks and machine learning—ICANN 2011. Springer, pp 266–274 Yoshida A, Osana Y (2011) Chaotic complex-valued multidirectional associative memory with variable scaling factor. In: Artificial neural networks and machine learning—ICANN 2011. Springer, pp 266–274
26.
Zurück zum Zitat Gandhi V, Prasad G, Coyle D, Behera L, McGinnity T (2014) Quantum neural network-based eeg filtering for a brain–computer interface. IEEE Trans Neural Netw Learn Syst 25(2):278–288CrossRef Gandhi V, Prasad G, Coyle D, Behera L, McGinnity T (2014) Quantum neural network-based eeg filtering for a brain–computer interface. IEEE Trans Neural Netw Learn Syst 25(2):278–288CrossRef
27.
Zurück zum Zitat Chen C, Dong D, Li H, Chu J, Tarn T (2014) Fidelity-based probabilistic q-learning for control of quantum systems. IEEE Trans Neural Netw Learn Syst 25(5):920–933CrossRef Chen C, Dong D, Li H, Chu J, Tarn T (2014) Fidelity-based probabilistic q-learning for control of quantum systems. IEEE Trans Neural Netw Learn Syst 25(5):920–933CrossRef
28.
29.
Zurück zum Zitat Ekman P (1992) An argument for basic emotions. Cognit Emot 6(3–4):169–200CrossRef Ekman P (1992) An argument for basic emotions. Cognit Emot 6(3–4):169–200CrossRef
30.
Zurück zum Zitat Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef Russell JA (1980) A circumplex model of affect. J Personal Soc Psychol 39(6):1161CrossRef
31.
Zurück zum Zitat Han MJ, Lin CH, Song KT (2013) Robotic emotional expression generation based on mood transition and personality model. IEEE Trans Cybern 43(4):1290–1303CrossRef Han MJ, Lin CH, Song KT (2013) Robotic emotional expression generation based on mood transition and personality model. IEEE Trans Cybern 43(4):1290–1303CrossRef
32.
Zurück zum Zitat Schneider M, Adamy J (2014) Towards modelling affect and emotions in autonomous agents with recurrent fuzzy systems. In: 2014 IEEE international conference on systems, man and cybernetics (SMC). IEEE, pp 31–38 Schneider M, Adamy J (2014) Towards modelling affect and emotions in autonomous agents with recurrent fuzzy systems. In: 2014 IEEE international conference on systems, man and cybernetics (SMC). IEEE, pp 31–38
33.
Zurück zum Zitat Russell JA, Barrett LF (1999) Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J Personal Soc Psychol 76(5):805CrossRef Russell JA, Barrett LF (1999) Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J Personal Soc Psychol 76(5):805CrossRef
34.
Zurück zum Zitat Ortony A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge Ortony A (1990) The cognitive structure of emotions. Cambridge University Press, Cambridge
35.
36.
Zurück zum Zitat LeDoux JE (1994) Emotion, memory and the brain. Sci Am 270(6):50–57CrossRef LeDoux JE (1994) Emotion, memory and the brain. Sci Am 270(6):50–57CrossRef
37.
38.
Zurück zum Zitat Friedman HS, Riggio RE (1981) Effect of individual differences in nonverbal expressiveness on transmission of emotion. J Nonverbal Behav 6(2):96–104CrossRef Friedman HS, Riggio RE (1981) Effect of individual differences in nonverbal expressiveness on transmission of emotion. J Nonverbal Behav 6(2):96–104CrossRef
39.
Zurück zum Zitat Cristinacce D, Cootes T (2008) Automatic feature localisation with constrained local models. Pattern Recognit 41(10):3054–3067CrossRefMATH Cristinacce D, Cootes T (2008) Automatic feature localisation with constrained local models. Pattern Recognit 41(10):3054–3067CrossRefMATH
40.
Zurück zum Zitat Nuevo J, Bergasa LM, Jim’enez P (2010) RSMAT: robust simultaneous modeling and tracking. Pattern Recognit Lett 31(16):2455–2463CrossRef Nuevo J, Bergasa LM, Jim’enez P (2010) RSMAT: robust simultaneous modeling and tracking. Pattern Recognit Lett 31(16):2455–2463CrossRef
41.
Zurück zum Zitat Dawood F, Loo CK, Chin WH (2013) Incremental on-line learning of human motion using gaussian adaptive resonance hidden markov model. In: The 2013 international joint conference on neural networks (IJCNN). IEEE, pp 1–7 Dawood F, Loo CK, Chin WH (2013) Incremental on-line learning of human motion using gaussian adaptive resonance hidden markov model. In: The 2013 international joint conference on neural networks (IJCNN). IEEE, pp 1–7
42.
Zurück zum Zitat Smith SM, Petty RE (1995) Personality moderators of mood congruency effects on cognition: the role of self-esteem and negative mood regulation. J Personal Soc Psychol 68(6):1092CrossRef Smith SM, Petty RE (1995) Personality moderators of mood congruency effects on cognition: the role of self-esteem and negative mood regulation. J Personal Soc Psychol 68(6):1092CrossRef
43.
Zurück zum Zitat Kubota N, Toda Y (2012) Multimodal communication for human-friendly robot partners in informationally structured space. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1142–1151CrossRef Kubota N, Toda Y (2012) Multimodal communication for human-friendly robot partners in informationally structured space. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1142–1151CrossRef
44.
Zurück zum Zitat Lee A, Kawahara T (2009) Recent development of open-source speech recognition engine Julius. In: Proceedings: APSIPA ASC 2009, pp 131–137 Lee A, Kawahara T (2009) Recent development of open-source speech recognition engine Julius. In: Proceedings: APSIPA ASC 2009, pp 131–137
45.
Zurück zum Zitat Webb J, Ashley J (2012) Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, New YorkCrossRef Webb J, Ashley J (2012) Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, New YorkCrossRef
46.
Zurück zum Zitat Saragih JM, Lucey S, Cohn JF (2011) Deformable model fitting by regularized landmark mean-shift. Int J Comput Vis 91(2):200–215MathSciNetCrossRefMATH Saragih JM, Lucey S, Cohn JF (2011) Deformable model fitting by regularized landmark mean-shift. Int J Comput Vis 91(2):200–215MathSciNetCrossRefMATH
47.
Zurück zum Zitat Cootes TF, Taylor CJ (1992) Active shape models—‘smart snakes’. In: BMVC92. Springer, pp 266–275 Cootes TF, Taylor CJ (1992) Active shape models—‘smart snakes’. In: BMVC92. Springer, pp 266–275
48.
Zurück zum Zitat Di Stefano L, Mattoccia S, Tombari F (2005) ZNCC-based template matching using bounded partial correlation. Pattern Recognit Lett 26(14):2129–2134CrossRef Di Stefano L, Mattoccia S, Tombari F (2005) ZNCC-based template matching using bounded partial correlation. Pattern Recognit Lett 26(14):2129–2134CrossRef
49.
Zurück zum Zitat Kanaujia A, Huang Y, Metaxas D (2006) Tracking facial features using mixture of point distribution models. In: Computer vision, graphics and image processing. Springer, pp 492–503 Kanaujia A, Huang Y, Metaxas D (2006) Tracking facial features using mixture of point distribution models. In: Computer vision, graphics and image processing. Springer, pp 492–503
50.
Zurück zum Zitat Rychlak JF (1973) Introduction to personality and psychotherapy: A theory-construction approach. Houghton Mifflin, Boston Rychlak JF (1973) Introduction to personality and psychotherapy: A theory-construction approach. Houghton Mifflin, Boston
51.
Zurück zum Zitat Mischel W (1993) Introduction to personality, vol 250. London Mischel W (1993) Introduction to personality, vol 250. London
Metadaten
Titel
Application of emotion affected associative memory based on mood congruency effects for a humanoid
verfasst von
Naoki Masuyama
Md. Nazrul Islam
Manjeevan Seera
Chu Kiong Loo
Publikationsdatum
19.11.2015
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 4/2017
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-015-2102-x

Weitere Artikel der Ausgabe 4/2017

Neural Computing and Applications 4/2017 Zur Ausgabe