Skip to main content
Top

2024 | OriginalPaper | Chapter

Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Cooperative Data Collection

Authors : Yuqi Miao, Lei Lei, Lijuan Zhang

Published in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the context of UAV trajectory planning for data collection, challenges such as the uncertainty of a large-scale dynamic unknown environment and the need for multi-UAV coordination are prevalent. To address these challenges, this paper proposes a UAV data collection trajectory planning algorithm based on the D3QN (Double Dueling Deep Q-Network) algorithm. The proposed algorithm enables multiple UAVs to dynamically plan their flight paths for data collection in unknown environments through centralized training and distributed application. The algorithm’s performance is improved by incorporating competition mechanisms, candidate node queues, and reward function reshaping techniques. Based on the simulation results, the proposed algorithm outperforms similar algorithms in terms of success rates and task durations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Wei, Z., Zhu, M., Zhang, N., et al.: UAV-assisted data collection for internet of things: a survey. IEEE Internet Things J. 9(17), 15460–15483 (2022)CrossRef Wei, Z., Zhu, M., Zhang, N., et al.: UAV-assisted data collection for internet of things: a survey. IEEE Internet Things J. 9(17), 15460–15483 (2022)CrossRef
2.
go back to reference Zeng, Y., Zhang, R., Lim, T.J.: Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun. Mag. 54(5), 36–42 (2016)CrossRef Zeng, Y., Zhang, R., Lim, T.J.: Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun. Mag. 54(5), 36–42 (2016)CrossRef
3.
go back to reference Mozaffari, M., et al.: A tutorial on UAVs for wireless networks: applications, challenges, and open problems. IEEE Commun. Surv. Tutorials 21(3), 2334–2360 (2019)CrossRef Mozaffari, M., et al.: A tutorial on UAVs for wireless networks: applications, challenges, and open problems. IEEE Commun. Surv. Tutorials 21(3), 2334–2360 (2019)CrossRef
4.
go back to reference Han, S., Zhu, K., Zhou, M.C., et al.: Joint deployment optimization and flight trajectory planning for UAV assisted IoT data collection: a bilevel optimization approach. IEEE Trans. Intell. Transp. Syst. 23(11), 21492–21504 (2022)CrossRef Han, S., Zhu, K., Zhou, M.C., et al.: Joint deployment optimization and flight trajectory planning for UAV assisted IoT data collection: a bilevel optimization approach. IEEE Trans. Intell. Transp. Syst. 23(11), 21492–21504 (2022)CrossRef
5.
go back to reference Hua, M., Yang, L., Wu, Q., et al.: 3D UAV trajectory and communication design for simultaneous uplink and downlink transmission. IEEE Trans. Commun. 68(9), 5908–5923 (2020)CrossRef Hua, M., Yang, L., Wu, Q., et al.: 3D UAV trajectory and communication design for simultaneous uplink and downlink transmission. IEEE Trans. Commun. 68(9), 5908–5923 (2020)CrossRef
6.
go back to reference Wei, Z., Chen, Q., Liu, S., et al.: Capacity of unmanned aerial vehicle assisted data collection in wireless sensor networks. IEEE Access 8, 162819–162829 (2020)CrossRef Wei, Z., Chen, Q., Liu, S., et al.: Capacity of unmanned aerial vehicle assisted data collection in wireless sensor networks. IEEE Access 8, 162819–162829 (2020)CrossRef
7.
go back to reference Hsu, Y.H., Gau, R.H.: Reinforcement learning-based collision avoidance and optimal trajectory planning in UAV communication networks. IEEE Trans. Mob. Comput. 21(1), 306–320 (2020)CrossRef Hsu, Y.H., Gau, R.H.: Reinforcement learning-based collision avoidance and optimal trajectory planning in UAV communication networks. IEEE Trans. Mob. Comput. 21(1), 306–320 (2020)CrossRef
8.
go back to reference Zhang, B., Liu, C.H., Tang, J., et al.: Learning-based energy-efficient data collection by unmanned vehicles in smart cities. IEEE Trans. Industr. Inf. 14(4), 1666–1676 (2017)CrossRef Zhang, B., Liu, C.H., Tang, J., et al.: Learning-based energy-efficient data collection by unmanned vehicles in smart cities. IEEE Trans. Industr. Inf. 14(4), 1666–1676 (2017)CrossRef
9.
go back to reference Wang, X., Gursoy, M.C., Erpek, T., et al.: Learning-based UAV path planning for data collection with integrated collision avoidance. IEEE Internet Things J. 9(17), 16663–16676 (2022)CrossRef Wang, X., Gursoy, M.C., Erpek, T., et al.: Learning-based UAV path planning for data collection with integrated collision avoidance. IEEE Internet Things J. 9(17), 16663–16676 (2022)CrossRef
Metadata
Title
Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Cooperative Data Collection
Authors
Yuqi Miao
Lei Lei
Lijuan Zhang
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_11

Premium Partner