Skip to main content

2018 | OriginalPaper | Buchkapitel

Motivated Reinforcement Learning Using Self-Developed Knowledge in Autonomous Cognitive Agent

verfasst von : Piotr Papiez, Adrian Horzyk

Erschienen in: Artificial Intelligence and Soft Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes the development of a cognitive agent using motivated reinforcement learning. The conducted research was based on the example of a virtual robot, that placed in an unknown maze, was learned to reach a given goal optimally. The robot should expand knowledge about the surroundings and learn how to move in it to achieve a given target. The built-in motivation factors allow it to focus initially on collecting experiences instead of reaching the goal. In this way, the robot gradually broadens its knowledge with the advancement of exploration of its surroundings. The correctly formed knowledge is used for effective controlling the reinforcement learning routine to reach the target by the robot. In such a way, the motivation factors allow the robot to adapt and control its motivated reinforcement learning routine automatically and autonomously.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Duch, W.: Brain-inspired conscious computing architecture. J. Mind Behav. 26, 1–22 (2005) Duch, W.: Brain-inspired conscious computing architecture. J. Mind Behav. 26, 1–22 (2005)
2.
Zurück zum Zitat Horzyk, A., Starzyk, J.A., Graham, J.: Integration of semantic and episodic memories. IEEE Trans. Neural Netw. Learn. Syst. 28(12), 3084–3095 (2017)MathSciNetCrossRef Horzyk, A., Starzyk, J.A., Graham, J.: Integration of semantic and episodic memories. IEEE Trans. Neural Netw. Learn. Syst. 28(12), 3084–3095 (2017)MathSciNetCrossRef
3.
Zurück zum Zitat Horzyk, A.: How does generalization and creativity come into being in neural associative systems and how does it form human-like knowledge? Neurocomputing 144, 238–257 (2014)CrossRef Horzyk, A.: How does generalization and creativity come into being in neural associative systems and how does it form human-like knowledge? Neurocomputing 144, 238–257 (2014)CrossRef
4.
Zurück zum Zitat Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence, pp. 1–276. EXIT, Warsaw (2013) Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence, pp. 1–276. EXIT, Warsaw (2013)
5.
Zurück zum Zitat Horzyk, A.: Human-like knowledge engineering, generalization, and creativity in artificial neural associative systems. In: Skulimowski, A.M.J., Kacprzyk, J. (eds.) Knowledge, Information and Creativity Support Systems: Recent Trends, Advances and Solutions. AISC, vol. 364, pp. 39–51. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-19090-7_4CrossRef Horzyk, A.: Human-like knowledge engineering, generalization, and creativity in artificial neural associative systems. In: Skulimowski, A.M.J., Kacprzyk, J. (eds.) Knowledge, Information and Creativity Support Systems: Recent Trends, Advances and Solutions. AISC, vol. 364, pp. 39–51. Springer, Cham (2016). https://​doi.​org/​10.​1007/​978-3-319-19090-7_​4CrossRef
6.
Zurück zum Zitat Kalat, J.W.: Biological Grounds of Psychology. PWN, Warsaw (2006) Kalat, J.W.: Biological Grounds of Psychology. PWN, Warsaw (2006)
7.
Zurück zum Zitat Larose, D.T.: Discovering Knowledge from Data: Introduction to Data Mining. PWN, Warsaw (2006)MATH Larose, D.T.: Discovering Knowledge from Data: Introduction to Data Mining. PWN, Warsaw (2006)MATH
8.
Zurück zum Zitat Rutkowski, L.: Techniques and Methods of Artificial Intelligence. PWN, Warsaw (2012) Rutkowski, L.: Techniques and Methods of Artificial Intelligence. PWN, Warsaw (2012)
9.
Zurück zum Zitat Tadeusiewicz, R.Y.: New trends in neurocybernetics. Comput. Methods Mater. Sci. 10(1), 1–7 (2010) Tadeusiewicz, R.Y.: New trends in neurocybernetics. Comput. Methods Mater. Sci. 10(1), 1–7 (2010)
10.
Zurück zum Zitat Smart, W.D.: Making reinforcement learning work on real robots. Ph.D. dissertation, Department of Computer Science, Brown University, Providence, RI (2002) Smart, W.D.: Making reinforcement learning work on real robots. Ph.D. dissertation, Department of Computer Science, Brown University, Providence, RI (2002)
11.
Zurück zum Zitat Papiez, P.: Use of a neural network to move a robot to the designated target position in a maze using reinforcement learning. Engineering dissertation, AGH University of Science and Technology in Krakow, Supervised and Promoted by A. Horzyk (2018) Papiez, P.: Use of a neural network to move a robot to the designated target position in a maze using reinforcement learning. Engineering dissertation, AGH University of Science and Technology in Krakow, Supervised and Promoted by A. Horzyk (2018)
12.
Zurück zum Zitat Kober, J., Bagnell, J.A., Peters, J.: Reinforcement learning: a survey. Int. J. Robot. Res. 32, 1238–1274 (2013)CrossRef Kober, J., Bagnell, J.A., Peters, J.: Reinforcement learning: a survey. Int. J. Robot. Res. 32, 1238–1274 (2013)CrossRef
13.
Zurück zum Zitat Starzyk, J.A.: Motivated learning for computational intelligence. In: Igelnik, B. (ed.) Computational Modeling and Simulation of Intellect: Current State and Future Perspectives (Chap. 11), pp. 265–292. IGI Publishing, Hershey (2011)CrossRef Starzyk, J.A.: Motivated learning for computational intelligence. In: Igelnik, B. (ed.) Computational Modeling and Simulation of Intellect: Current State and Future Perspectives (Chap. 11), pp. 265–292. IGI Publishing, Hershey (2011)CrossRef
14.
Zurück zum Zitat Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998) Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
15.
Zurück zum Zitat Janowski, M.: Use of a neural network to move a robot back to the starting position in a maze using supervised learning. Engineering dissertation, AGH University of Science and Technology in Krakow, Supervised and Promoted by A. Horzyk (2018) Janowski, M.: Use of a neural network to move a robot back to the starting position in a maze using supervised learning. Engineering dissertation, AGH University of Science and Technology in Krakow, Supervised and Promoted by A. Horzyk (2018)
16.
Zurück zum Zitat Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonglou, I., Wierstra, D., Riedmiller, M.: Playing Atari with Deep Reinforcement Learning. arXiv preprint arXiv:1312.5602 (2013) Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonglou, I., Wierstra, D., Riedmiller, M.: Playing Atari with Deep Reinforcement Learning. arXiv preprint arXiv:​1312.​5602 (2013)
18.
Zurück zum Zitat Tadeusiewicz, R.: Introduction to intelligent systems. In: Wilamowski, B.M., Irvin, J.D. (eds.) The Industrial Electronics Handbook Intelligent Systems, pp. 1–12. CRC Press, Boca Raton (2011) Tadeusiewicz, R.: Introduction to intelligent systems. In: Wilamowski, B.M., Irvin, J.D. (eds.) The Industrial Electronics Handbook Intelligent Systems, pp. 1–12. CRC Press, Boca Raton (2011)
Metadaten
Titel
Motivated Reinforcement Learning Using Self-Developed Knowledge in Autonomous Cognitive Agent
verfasst von
Piotr Papiez
Adrian Horzyk
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-91253-0_17