Skip to main content

2023 | OriginalPaper | Buchkapitel

Multi-agent Reinforcement Learning-Based UAS Control for Logistics Environments

verfasst von : Hyungeun Jo, Hoeun Lee, Sangwoo Jeon, Vishnu Kumar Kaliappan, Tuan Anh Nguyen, Dugki Min, Jae-Woo Lee

Erschienen in: The Proceedings of the 2021 Asia-Pacific International Symposium on Aerospace Technology (APISAT 2021), Volume 2

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With recent technological developments, The UAS (unmanned aerial system) has been recognized for its value and usefulness in various fields. Prior researchers have utilized several drones in collaboration to navigate to achieve common goals such as target tracking, rescue operations, and target-finding with multi-UAS systems. Multi-agent reinforcement learning algorithms are a type of artificial intelligence technology in which many agents collaborate to perform tasks. When a multi-UAS cooperative navigation technique is deployed to a complicated environment such as an urban logistics system, the agents’ learning capacities become more tedious. In this study, we present what is termed the improved Multi-Actor-Attention-Critic (iMAAC) approach, a modified multi-agent reinforcement learning method for application to urban air mobility logistic services. A virtual simulation environment based on Unity is created to validate the suggested method. In the virtual environment, the real-world situation of UAS logistics development services is replicated. When the findings are compared to those of other landmark reinforcement algorithms, iMAAC shows a higher learning rate than those by the other algorithms when utilized in multi-agent systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
3.
Zurück zum Zitat Iqbal S, Sha F (2019) Actor-attention-critic for multi-agent reinforcement learning. In: 36th International conference on machine learning, ICML 2019 Iqbal S, Sha F (2019) Actor-attention-critic for multi-agent reinforcement learning. In: 36th International conference on machine learning, ICML 2019
4.
Zurück zum Zitat Muñoz G, Barrado C, Çetin E, Salami E (2019) Deep reinforcement learning for drone delivery. Drones 3(3) Muñoz G, Barrado C, Çetin E, Salami E (2019) Deep reinforcement learning for drone delivery. Drones 3(3)
6.
Zurück zum Zitat Chen X, Ulmer MW, Thomas BW (2021) Deep Q-learning for same-day delivery with vehicles and drones. Eur J Oper Res Chen X, Ulmer MW, Thomas BW (2021) Deep Q-learning for same-day delivery with vehicles and drones. Eur J Oper Res
7.
Zurück zum Zitat Feng L (2020) Reinforcement learning to optimize the logistics distribution routes of unmanned aerial vehicle Feng L (2020) Reinforcement learning to optimize the logistics distribution routes of unmanned aerial vehicle
8.
Zurück zum Zitat Qie H, Shi D, Shen T, Xu X, Li Y, Wang L (2019) Joint optimization of multi-UAV target assignment and path planning based on multi-agent reinforcement learning. IEEE Access 7:146264–146272CrossRef Qie H, Shi D, Shen T, Xu X, Li Y, Wang L (2019) Joint optimization of multi-UAV target assignment and path planning based on multi-agent reinforcement learning. IEEE Access 7:146264–146272CrossRef
Metadaten
Titel
Multi-agent Reinforcement Learning-Based UAS Control for Logistics Environments
verfasst von
Hyungeun Jo
Hoeun Lee
Sangwoo Jeon
Vishnu Kumar Kaliappan
Tuan Anh Nguyen
Dugki Min
Jae-Woo Lee
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-2635-8_71

    Premium Partner