Skip to main content
Top

2023 | OriginalPaper | Chapter

Discretization and Representation of a Complex Environment for On-Policy Reinforcement Learning for Obstacle Avoidance for Simulated Autonomous Mobile Agents

Author : Andreas Dyrøy Jansson

Published in: Proceedings of Seventh International Congress on Information and Communication Technology

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In recent years, the demand for digitalization, automation, and smart systems in the airline industry has accelerated. Furthermore, due to the ongoing global pandemic as of 2022, airlines are faced with the challenge of offering flexibility in both cargo and passenger capacity. Studies show that the use of smart products and autonomous agents are expected to play a key part in the digital transformation of the logistics industry. This paper aims to examine the current state-of-the-art in multi-agent systems and reinforcement learning with special interest in intelligent baggage handling systems. How to simplify, implement, and simulate a system of autonomous baggage carts as a software model in order to examine congestion situations will be the main topics of this paper. Furthermore, how the findings from the software model may be applied to real-world scenarios related to Industry 4.0, and baggage handling will also be discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Meyer G, Främling K, Holmström J (2009) Intelligent products: a survey. Comput Ind 60(3):137–148CrossRef Meyer G, Främling K, Holmström J (2009) Intelligent products: a survey. Comput Ind 60(3):137–148CrossRef
4.
go back to reference Sella R, Rassõlkinb A, Wanga R, Otto T (2019) Integration of autonomous vehicles and Industry 4.0. In: Proceedings of the Estonian Academy of Sciences. Estonian Academy Publishers, Tallin, Estonia, pp 389–394 Sella R, Rassõlkinb A, Wanga R, Otto T (2019) Integration of autonomous vehicles and Industry 4.0. In: Proceedings of the Estonian Academy of Sciences. Estonian Academy Publishers, Tallin, Estonia, pp 389–394
5.
go back to reference Thürer M, Fernandes NO, Stevenson M, Qu T, Huang GQ (2021) Self-organizing material flow control using smart products: an assessment by simulation. J Ind Prod Eng 38(2):148–156 Thürer M, Fernandes NO, Stevenson M, Qu T, Huang GQ (2021) Self-organizing material flow control using smart products: an assessment by simulation. J Ind Prod Eng 38(2):148–156
6.
go back to reference Bussmann S, Schild K (2000) Self-organizing manufacturing control: an industrial application of agent technology. In: Proceedings fourth international conference on multiagent systems. IEEE, pp 87–94 Bussmann S, Schild K (2000) Self-organizing manufacturing control: an industrial application of agent technology. In: Proceedings fourth international conference on multiagent systems. IEEE, pp 87–94
7.
go back to reference Hallenborg K, Demazeau Y (2006) Dynamical control in large-scale material handling systems through agent technology. In: 2006 IEEE/WIC/ACM international conference on intelligent agent technology. IEEE, pp 637–645 Hallenborg K, Demazeau Y (2006) Dynamical control in large-scale material handling systems through agent technology. In: 2006 IEEE/WIC/ACM international conference on intelligent agent technology. IEEE, pp 637–645
8.
go back to reference Tumer K, Agogino A Distributed agent-based air traffic flow management. In: Proceedings of the 6th international joint conference on autonomous agents and multiagent systems. Association for Computing Machinery, New York, NY, pp 1–8 Tumer K, Agogino A Distributed agent-based air traffic flow management. In: Proceedings of the 6th international joint conference on autonomous agents and multiagent systems. Association for Computing Machinery, New York, NY, pp 1–8
9.
go back to reference Duc DN, Huu TT, Nananukul N (2020) A dynamic route-planning system based on Industry 4.0 technology. Algorithms 13(12):308 Duc DN, Huu TT, Nananukul N (2020) A dynamic route-planning system based on Industry 4.0 technology. Algorithms 13(12):308
10.
go back to reference Cheng Y, Wang GY (2018) Mobile robot navigation based on lidar. In: Chinese control and decision conference. IEEE, pp 1243–1246 Cheng Y, Wang GY (2018) Mobile robot navigation based on lidar. In: Chinese control and decision conference. IEEE, pp 1243–1246
11.
go back to reference Malavazi FBP, Guyonneau R, Fasquel J-B, Lagrange S, Mercier F (2018) LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput Electron Agric 154:71–79CrossRef Malavazi FBP, Guyonneau R, Fasquel J-B, Lagrange S, Mercier F (2018) LiDAR-only based navigation algorithm for an autonomous agricultural robot. Comput Electron Agric 154:71–79CrossRef
12.
go back to reference Su Z, Zhou X, Cheng T, Zhang H, Xu B, Chen W (2018) Global localization of a mobile robot using lidar and visual features. In: 2017 IEEE international conference on robotics and biomimetics. IEEE, pp 2377–2383 Su Z, Zhou X, Cheng T, Zhang H, Xu B, Chen W (2018) Global localization of a mobile robot using lidar and visual features. In: 2017 IEEE international conference on robotics and biomimetics. IEEE, pp 2377–2383
13.
go back to reference Jansson AD (2021) Simulation of obstacle avoidance for multiple autonomous vehicles in a dynamic environment using Q-learning. Int J Comput Inf Eng 15:267–272 Jansson AD (2021) Simulation of obstacle avoidance for multiple autonomous vehicles in a dynamic environment using Q-learning. Int J Comput Inf Eng 15:267–272
14.
go back to reference Sutton RS, Barto AG (2015) Reinforcement learning: an introduction, 2nd edn. The MIT Press, Cambridge, Massachusetts, MAMATH Sutton RS, Barto AG (2015) Reinforcement learning: an introduction, 2nd edn. The MIT Press, Cambridge, Massachusetts, MAMATH
Metadata
Title
Discretization and Representation of a Complex Environment for On-Policy Reinforcement Learning for Obstacle Avoidance for Simulated Autonomous Mobile Agents
Author
Andreas Dyrøy Jansson
Copyright Year
2023
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-2394-4_42