Skip to main content
Erschienen in: Autonomous Robots 5/2018

23.11.2017

Hierarchical emotional episodic memory for social human robot collaboration

verfasst von: Won-Hyong Lee, Jong-Hwan Kim

Erschienen in: Autonomous Robots | Ausgabe 5/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For social human robot collaboration, robots need to effectively remember human experiences and manage emotional experiences as well as repetitive experiences. To implement these functions, the hierarchical emotional episodic memory, using deep adaptive resonance theory network, is proposed in this paper. The proposed memory not only learns emotional experiences, but also has the ability to anticipate future emotional situations. Two parameter modulation processes, delayed consolidation and instant update, are provided. These make emotional experiences reinforce faster, remain for longer, and become more stable and sensitive to analogous experiences. Simulation analysis is conducted to verify the proposed memory, and an experiment is carried out in a kitchen environment to demonstrate social human robot collaboration.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Carpenter, G. A., Grossberg, S., & Rosen, D. B. (1991). Fuzzy art: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4(6), 759–771.CrossRef Carpenter, G. A., Grossberg, S., & Rosen, D. B. (1991). Fuzzy art: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4(6), 759–771.CrossRef
Zurück zum Zitat Conway, M. A. (2008). Exploring episodic memory. In E. Dere, A. Easton, L. Nadel, & J. P. Huston (Eds.), Handbook of episodic memory (Vol. 18, pp. 19–29). Oxford, UK: Elsevier. Conway, M. A. (2008). Exploring episodic memory. In E. Dere, A. Easton, L. Nadel, & J. P. Huston (Eds.), Handbook of episodic memory (Vol. 18, pp. 19–29). Oxford, UK: Elsevier.
Zurück zum Zitat Deutsch, T., Gruber, A., Lang, R., & Velik, R. (2008). Episodic memory for autonomous agents. In 2008 conference on human system interactions (pp. 621–626). IEEE. Deutsch, T., Gruber, A., Lang, R., & Velik, R. (2008). Episodic memory for autonomous agents. In 2008 conference on human system interactions (pp. 621–626). IEEE.
Zurück zum Zitat Dodd, W., & Gutierrez, R. (2005). The role of episodic memory and emotion in a cognitive robot. In IEEE international workshop on robots and human interactive communication (pp. 692–697). Dodd, W., & Gutierrez, R. (2005). The role of episodic memory and emotion in a cognitive robot. In IEEE international workshop on robots and human interactive communication (pp. 692–697).
Zurück zum Zitat Gao, S., & Tan, A. H. (2014). User daily activity pattern learning: A multi-memory modeling approach. In 2014 international joint conference on neural networks (IJCNN) (pp. 1542–1548). IEEE. Gao, S., & Tan, A. H. (2014). User daily activity pattern learning: A multi-memory modeling approach. In 2014 international joint conference on neural networks (IJCNN) (pp. 1542–1548). IEEE.
Zurück zum Zitat Holland, A. C., & Kensinger, E. A. (2010). Emotion and autobiographical memory. Physics of Life Reviews, 7(1), 88–131.CrossRef Holland, A. C., & Kensinger, E. A. (2010). Emotion and autobiographical memory. Physics of Life Reviews, 7(1), 88–131.CrossRef
Zurück zum Zitat Howard, M. W., Fotedar, M. S., Datey, A. V., & Hasselmo, M. E. (2005). The temporal context model in spatial navigation and relational learning: Toward a common explanation of medial temporal lobe function across domains. Psychological Review, 112(1), 75.CrossRef Howard, M. W., Fotedar, M. S., Datey, A. V., & Hasselmo, M. E. (2005). The temporal context model in spatial navigation and relational learning: Toward a common explanation of medial temporal lobe function across domains. Psychological Review, 112(1), 75.CrossRef
Zurück zum Zitat Jockel, S., Weser, M., Westhoff, D., & Zhang, J. (2008). Towards an episodic memory for cognitive robots. In Proceedings of 6th cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI) (pp. 68–74). Citeseer. Jockel, S., Weser, M., Westhoff, D., & Zhang, J. (2008). Towards an episodic memory for cognitive robots. In Proceedings of 6th cognitive robotics workshop at 18th European conference on artificial intelligence (ECAI) (pp. 68–74). Citeseer.
Zurück zum Zitat Kasap, Z., & Magnenat-Thalmann, N. (2010). Towards episodic memory-based long-term affective interaction with a human-like robot. In RO-MAN (pp. 452–457). IEEE. Kasap, Z., & Magnenat-Thalmann, N. (2010). Towards episodic memory-based long-term affective interaction with a human-like robot. In RO-MAN (pp. 452–457). IEEE.
Zurück zum Zitat Kasap, Z., & Magnenat-Thalmann, N. (2012). Building long-term relationships with virtual and robotic characters: The role of remembering. The Visual Computer, 28(1), 87–97.CrossRef Kasap, Z., & Magnenat-Thalmann, N. (2012). Building long-term relationships with virtual and robotic characters: The role of remembering. The Visual Computer, 28(1), 87–97.CrossRef
Zurück zum Zitat Kazemifard, M., Ghasem-Aghaee, N., Koenig, B. L., & Ören, T. I. (2014). An emotion understanding framework for intelligent agents based on episodic and semantic memories. Autonomous Agents and Multi-Agent Systems, 28(1), 126–153.CrossRef Kazemifard, M., Ghasem-Aghaee, N., Koenig, B. L., & Ören, T. I. (2014). An emotion understanding framework for intelligent agents based on episodic and semantic memories. Autonomous Agents and Multi-Agent Systems, 28(1), 126–153.CrossRef
Zurück zum Zitat Komatsu, T., & Takeno, J. (2011). A conscious robot that expects emotions. In 2011 IEEE international conference on industrial technology (ICIT) (pp. 15–20). IEEE. Komatsu, T., & Takeno, J. (2011). A conscious robot that expects emotions. In 2011 IEEE international conference on industrial technology (ICIT) (pp. 15–20). IEEE.
Zurück zum Zitat Leconte, F., Ferland, F., & Michaud, F. (2014). Fusion adaptive resonance theory networks used as episodic memory for an autonomous robot. In International Conference on Artificial General Intelligence (pp. 63–72). Cham: Springer. Leconte, F., Ferland, F., & Michaud, F. (2014). Fusion adaptive resonance theory networks used as episodic memory for an autonomous robot. In International Conference on Artificial General Intelligence (pp. 63–72). Cham: Springer.
Zurück zum Zitat Leconte, F., Ferland, F., & Michaud, F. (2016). Design and integration of a spatio-temporal memory with emotional influences to categorize and recall the experiences of an autonomous mobile robot. Autonomous Robots, 40(5), 831–848. Leconte, F., Ferland, F., & Michaud, F. (2016). Design and integration of a spatio-temporal memory with emotional influences to categorize and recall the experiences of an autonomous mobile robot. Autonomous Robots, 40(5), 831–848.
Zurück zum Zitat Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady, 10, 707.MathSciNetMATH Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady, 10, 707.MathSciNetMATH
Zurück zum Zitat McGaugh, J. L. (2000). Memory—A century of consolidation. Science, 287(5451), 248–251.CrossRef McGaugh, J. L. (2000). Memory—A century of consolidation. Science, 287(5451), 248–251.CrossRef
Zurück zum Zitat McGaugh, J. L. (2003). Memory and emotion: The making of lasting memories. New York City, NY: Columbia University Press. McGaugh, J. L. (2003). Memory and emotion: The making of lasting memories. New York City, NY: Columbia University Press.
Zurück zum Zitat Mueller, S. T., & Shiffrin, R. M. (2006). REM II: A model of the developmental co-evolution of episodic memory and semantic knowledge. In International conference on learning and development (ICDL), Bloomington, IN. Mueller, S. T., & Shiffrin, R. M. (2006). REM II: A model of the developmental co-evolution of episodic memory and semantic knowledge. In International conference on learning and development (ICDL), Bloomington, IN.
Zurück zum Zitat Norman, K. A., Detre, G. J., & Polyn, S. M. (2008). Computational models of episodic memory. In R. Sun (Ed.), The Cambridge handbook of computational psychology (pp. 189–224). New York: Cambridge University Press. Norman, K. A., Detre, G. J., & Polyn, S. M. (2008). Computational models of episodic memory. In R. Sun (Ed.), The Cambridge handbook of computational psychology (pp. 189–224). New York: Cambridge University Press.
Zurück zum Zitat Nuxoll, A. M., & Laird, J. E. (2012). Enhancing intelligent agents with episodic memory. Cognitive Systems Research, 17, 34–48.CrossRef Nuxoll, A. M., & Laird, J. E. (2012). Enhancing intelligent agents with episodic memory. Cognitive Systems Research, 17, 34–48.CrossRef
Zurück zum Zitat Park, G. M., & Kim, J. H. (2016). Deep adaptive resonance theory for learning biologically inspired episodic memory. In 2016 international joint conference on neural networks (IJCNN) (pp. 5174–5180). IEEE. Park, G. M., & Kim, J. H. (2016). Deep adaptive resonance theory for learning biologically inspired episodic memory. In 2016 international joint conference on neural networks (IJCNN) (pp. 5174–5180). IEEE.
Zurück zum Zitat Park, G. M., Yoo, Y. H., & Kim, J. H. (2015). REM-ART: Reward-based electromagnetic adaptive resonance theory. In Proceedings of international conference on artificial intelligence (ICAI), Las Vegas. Park, G. M., Yoo, Y. H., & Kim, J. H. (2015). REM-ART: Reward-based electromagnetic adaptive resonance theory. In Proceedings of international conference on artificial intelligence (ICAI), Las Vegas.
Zurück zum Zitat Park, G. M., Yoo, Y. H., Kim, D. H., & Kim, J. H. (2017). Deep ART neural model for biologically-inspired episodic memory and its application to task performance of robots. In IEEE transactions on cybernetics (Accepted subject to minor revisions). Park, G. M., Yoo, Y. H., Kim, D. H., & Kim, J. H. (2017). Deep ART neural model for biologically-inspired episodic memory and its application to task performance of robots. In IEEE transactions on cybernetics (Accepted subject to minor revisions).
Zurück zum Zitat Rinkus, G. J. (2004). A neural model of episodic and semantic spatiotemporal memory. In Proceedings of the 26th Annual Conference of Cognitive Science Society (pp. 1155–1160). Chicago: LEA. Rinkus, G. J. (2004). A neural model of episodic and semantic spatiotemporal memory. In Proceedings of the 26th Annual Conference of Cognitive Science Society (pp. 1155–1160). Chicago: LEA.
Zurück zum Zitat Stachowicz, D., & Kruijff, G. J. M. (2012). Episodic-like memory for cognitive robots. IEEE Transactions on Autonomous Mental Development, 4(1), 1–16.CrossRef Stachowicz, D., & Kruijff, G. J. M. (2012). Episodic-like memory for cognitive robots. IEEE Transactions on Autonomous Mental Development, 4(1), 1–16.CrossRef
Zurück zum Zitat Starzyk, J. A., & He, H. (2009). Spatio-temporal memories for machine learning: A long-term memory organization. IEEE Transactions on Neural Networks, 20(5), 768–780.CrossRef Starzyk, J. A., & He, H. (2009). Spatio-temporal memories for machine learning: A long-term memory organization. IEEE Transactions on Neural Networks, 20(5), 768–780.CrossRef
Zurück zum Zitat Subagdja, B., & Tan, A. H. (2015). Neural modeling of sequential inferences and learning over episodic memory. Neurocomputing, 161, 229–242.CrossRef Subagdja, B., & Tan, A. H. (2015). Neural modeling of sequential inferences and learning over episodic memory. Neurocomputing, 161, 229–242.CrossRef
Zurück zum Zitat Tan, A. H., Carpenter, G. A., & Grossberg, S. (2007). Intelligence through interaction: Towards a unified theory for learning. In Advances in neural networks–ISNN 2007 (pp. 1094–1103). Springer. Tan, A. H., Carpenter, G. A., & Grossberg, S. (2007). Intelligence through interaction: Towards a unified theory for learning. In Advances in neural networks–ISNN 2007 (pp. 1094–1103). Springer.
Zurück zum Zitat Tulving, C. (1983). Elements of episodic memory. New York City, NY: Oxford University Press. Tulving, C. (1983). Elements of episodic memory. New York City, NY: Oxford University Press.
Zurück zum Zitat Wagner, R. A., & Fischer, M. J. (1974). The string-to-string correction problem. Journal of the ACM (JACM), 21(1), 168–173.MathSciNetCrossRefMATH Wagner, R. A., & Fischer, M. J. (1974). The string-to-string correction problem. Journal of the ACM (JACM), 21(1), 168–173.MathSciNetCrossRefMATH
Zurück zum Zitat Wang, W., Subagdja, B., Tan, A. H., & Starzyk, J. A. (2012). Neural modeling of episodic memory: Encoding, retrieval, and forgetting. IEEE Transactions on Neural Networks and Learning Systems, 23(10), 1574–1586.CrossRef Wang, W., Subagdja, B., Tan, A. H., & Starzyk, J. A. (2012). Neural modeling of episodic memory: Encoding, retrieval, and forgetting. IEEE Transactions on Neural Networks and Learning Systems, 23(10), 1574–1586.CrossRef
Zurück zum Zitat Zhang, J., Thalmann, N. M., & Zheng, J. (2016). Combining memory and emotion with dialog on social companion: A review. In Proceedings of the 29th international conference on computer animation and social agents (pp. 1–9). ACM. Zhang, J., Thalmann, N. M., & Zheng, J. (2016). Combining memory and emotion with dialog on social companion: A review. In Proceedings of the 29th international conference on computer animation and social agents (pp. 1–9). ACM.
Metadaten
Titel
Hierarchical emotional episodic memory for social human robot collaboration
verfasst von
Won-Hyong Lee
Jong-Hwan Kim
Publikationsdatum
23.11.2017
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 5/2018
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-017-9679-0

Weitere Artikel der Ausgabe 5/2018

Autonomous Robots 5/2018 Zur Ausgabe

Neuer Inhalt