Skip to main content
Top
Published in: Peer-to-Peer Networking and Applications 5/2021

02-07-2021

Cooperative content offloading scheme in air-ocean integrated networks

Authors: Junjie Zhou, Zhou Su, Qichao Xu, Weiwei Chen

Published in: Peer-to-Peer Networking and Applications | Issue 5/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As one of the most promising networks, the air-ocean integrated networks (AOINs) composed of unmanned aerial vehicles (UAVs) and unmanned surface vehicles (USVs) meet a variety of requests from different maritime missions with the characteristics of seamless, high-rate, and reliable transmission. However, due to the limited storage capacities of UAVs and uncertain navigation paths of USVs, it is challenging to accomplish the ocean observation mission. In this paper, a UAV and USV cooperative content offloading scheme in AOINs with Q-learning and game theory is proposed. Specifically, the state evaluation mechanism for both UAV and USV is first designed to make cooperation strategies. Afterward, the interaction between UAV and USV is modeled as the bargaining game, where the Nash equilibrium as the optimal transaction price is obtained by the backward induction method. To realize the maximization of revenue, we devise a Q-learning based algorithm to make path planning for each USV to offload contents as many as possible under the limited energy. Finally, the effectiveness and efficiency of the proposed scheme is conducted by extensive simulations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Qu H, Luo Y, Zhao J, Luan Z (2020) An LBMRE-OLSR routing algorithm under the emergency scenarios in the Space-Air-Ground integrated networks. In: 2020 Information communication technologies conference (ICTC), Nanjing, China, pp 103– 107 Qu H, Luo Y, Zhao J, Luan Z (2020) An LBMRE-OLSR routing algorithm under the emergency scenarios in the Space-Air-Ground integrated networks. In: 2020 Information communication technologies conference (ICTC), Nanjing, China, pp 103– 107
2.
go back to reference Qu H, Xu X, Zhao J, Yue P, An SDN-based space-air-ground integrated network architecture and controller deployment strategy (2020). In: 2020 IEEE 3rd international conference on computer and communication engineering technology (CCET), Beijing, China, pp 138–142 Qu H, Xu X, Zhao J, Yue P, An SDN-based space-air-ground integrated network architecture and controller deployment strategy (2020). In: 2020 IEEE 3rd international conference on computer and communication engineering technology (CCET), Beijing, China, pp 138–142
3.
go back to reference Zhou C, et al. (2021) Deep reinforcement learning for delay-oriented IoT task scheduling in space-air-ground integrated network. IEEE Trans Wirel Commun 20(2):911–925CrossRef Zhou C, et al. (2021) Deep reinforcement learning for delay-oriented IoT task scheduling in space-air-ground integrated network. IEEE Trans Wirel Commun 20(2):911–925CrossRef
4.
go back to reference Wu B, Xu Z (2017) Research on integrated space-air-ground TTC and communication network based on space tracking ship. In: 2017 16th International conference on optical communications and networks (ICOCN). Wuzhen, pp 1–3 Wu B, Xu Z (2017) Research on integrated space-air-ground TTC and communication network based on space tracking ship. In: 2017 16th International conference on optical communications and networks (ICOCN). Wuzhen, pp 1–3
5.
go back to reference Azari M M, Geraci G, Garcia-Rodriguez A, Pollin S (2020) UAV-to-UAV communications in cellular networks. IEEE Trans Wirel Commun 19(9):6130–6144CrossRef Azari M M, Geraci G, Garcia-Rodriguez A, Pollin S (2020) UAV-to-UAV communications in cellular networks. IEEE Trans Wirel Commun 19(9):6130–6144CrossRef
6.
go back to reference Xu Q, Su Z, Dai M, Yu S (2020) APIS: privacy-preserving incentive for sensing task allocation in cloud and edge-cooperation mobile internet of things with SDN. IEEE Internet Things J 7(7):5892–5905CrossRef Xu Q, Su Z, Dai M, Yu S (2020) APIS: privacy-preserving incentive for sensing task allocation in cloud and edge-cooperation mobile internet of things with SDN. IEEE Internet Things J 7(7):5892–5905CrossRef
7.
go back to reference Yang T, Jiang Z, Sun R, Cheng N, Feng H (2020) Maritime search and rescue based on group mobile computing for unmanned aerial vehicles and unmanned surface vehicles. IEEE Trans Ind Inform 16 (12):7700–7708CrossRef Yang T, Jiang Z, Sun R, Cheng N, Feng H (2020) Maritime search and rescue based on group mobile computing for unmanned aerial vehicles and unmanned surface vehicles. IEEE Trans Ind Inform 16 (12):7700–7708CrossRef
8.
go back to reference Xu Q, Su Z, Lu R (2020) Game theory and reinforcement learning based secure edge caching in mobile social networks. IEEE Trans Inf Forensics Secur 15:3415–3429CrossRef Xu Q, Su Z, Lu R (2020) Game theory and reinforcement learning based secure edge caching in mobile social networks. IEEE Trans Inf Forensics Secur 15:3415–3429CrossRef
9.
go back to reference Guo H, Liu J (2020) UAV-enhanced intelligent offloading for internet of things at the edge. IEEE Trans Ind Inform 16(4):2737–2746CrossRef Guo H, Liu J (2020) UAV-enhanced intelligent offloading for internet of things at the edge. IEEE Trans Ind Inform 16(4):2737–2746CrossRef
10.
go back to reference Xu Q, Su Z, Yang Q (2020) Blockchain-based trustworthy edge caching scheme for mobile cyber-physical system. IEEE Internet Things J 7(2):1098–1110CrossRef Xu Q, Su Z, Yang Q (2020) Blockchain-based trustworthy edge caching scheme for mobile cyber-physical system. IEEE Internet Things J 7(2):1098–1110CrossRef
12.
go back to reference Yin H, et al. (2020) A blockchain-based storage system with financial incentives for load-balancing. IEEE Trans Netw Sci Eng Yin H, et al. (2020) A blockchain-based storage system with financial incentives for load-balancing. IEEE Trans Netw Sci Eng
13.
go back to reference Yao P, Zhao R, Zhu Q (2020) A hierarchical architecture using biased min-consensus for USV path planning. IEEE Trans Veh Technol 69(9):9518–9527CrossRef Yao P, Zhao R, Zhu Q (2020) A hierarchical architecture using biased min-consensus for USV path planning. IEEE Trans Veh Technol 69(9):9518–9527CrossRef
14.
go back to reference Xu Q, Su Z, Zhang K, Li P (2020) Intelligent cache pollution attacks detection for edge computing enabled mobile social networks. IEEE Trans Emerg Top Comput Intell 4(3):241–252CrossRef Xu Q, Su Z, Zhang K, Li P (2020) Intelligent cache pollution attacks detection for edge computing enabled mobile social networks. IEEE Trans Emerg Top Comput Intell 4(3):241–252CrossRef
15.
go back to reference Yi C, Cai J, Su Z (2020) A multi-user mobile computation offloading and transmission scheduling mechanism for delay-sensitive applications. IEEE Trans Mob Comput 1(1):29–43CrossRef Yi C, Cai J, Su Z (2020) A multi-user mobile computation offloading and transmission scheduling mechanism for delay-sensitive applications. IEEE Trans Mob Comput 1(1):29–43CrossRef
17.
go back to reference Thi Le T H, Tran N H, Tun Y K, Tran Thi Kim O, Kim K, Hong C S (2020) Sharing incentive mechanism, Task assignment and resource allocation for task offloading in vehicular mobile edge computing. In: NOMS 2020 - 2020 IEEE/IFIP Network operations and management symposium, pp 1–8, DOI https://doi.org/10.1109/NOMS47738.2020.9110346, (to appear in print) Thi Le T H, Tran N H, Tun Y K, Tran Thi Kim O, Kim K, Hong C S (2020) Sharing incentive mechanism, Task assignment and resource allocation for task offloading in vehicular mobile edge computing. In: NOMS 2020 - 2020 IEEE/IFIP Network operations and management symposium, pp 1–8, DOI https://​doi.​org/​10.​1109/​NOMS47738.​2020.​9110346, (to appear in print)
18.
go back to reference Mao G, Zhang Z, Anderson B D O (2016) Cooperative content dissemination and offloading in heterogeneous mobile networks. IEEE Trans Veh Technol 65(8):6573–6587CrossRef Mao G, Zhang Z, Anderson B D O (2016) Cooperative content dissemination and offloading in heterogeneous mobile networks. IEEE Trans Veh Technol 65(8):6573–6587CrossRef
20.
go back to reference Bai T, Wang J, Ren Y, Hanzo L (2019) Energy-efficient computation offloading for secure UAV-edge-computing systems. IEEE Trans Veh Technol 68(6):6074–6087CrossRef Bai T, Wang J, Ren Y, Hanzo L (2019) Energy-efficient computation offloading for secure UAV-edge-computing systems. IEEE Trans Veh Technol 68(6):6074–6087CrossRef
21.
go back to reference Yao H, Zeng D, Huang H, Guo S, Barnawi A, Stojmenovic I (2015) Opportunistic offloading of deadline-constrained bulk cellular traffic in vehicular DTNs. IEEE Trans Comput 1(12):3515–3527MathSciNetCrossRef Yao H, Zeng D, Huang H, Guo S, Barnawi A, Stojmenovic I (2015) Opportunistic offloading of deadline-constrained bulk cellular traffic in vehicular DTNs. IEEE Trans Comput 1(12):3515–3527MathSciNetCrossRef
22.
go back to reference Wang Y, Wang K, Huang H, Miyazaki T, Guo S (2019) Traffic and computation co-offloading with reinforcement learning in fog computing for industrial applications. IEEE Trans Ind Inform 15 (2):976–986CrossRef Wang Y, Wang K, Huang H, Miyazaki T, Guo S (2019) Traffic and computation co-offloading with reinforcement learning in fog computing for industrial applications. IEEE Trans Ind Inform 15 (2):976–986CrossRef
23.
go back to reference Ning Z, et al. (2020) Intelligent edge computing in internet of vehicles: a joint computation offloading and caching solution. IEEE Trans Intell Transp Syst Ning Z, et al. (2020) Intelligent edge computing in internet of vehicles: a joint computation offloading and caching solution. IEEE Trans Intell Transp Syst
24.
go back to reference Liu M, Yu F R, Teng Y, Leung V C M, Song M (2018) Computation offloading and content caching in wireless blockchain networks with mobile edge computing. IEEE Trans Veh Technol 67(11):11008–11021CrossRef Liu M, Yu F R, Teng Y, Leung V C M, Song M (2018) Computation offloading and content caching in wireless blockchain networks with mobile edge computing. IEEE Trans Veh Technol 67(11):11008–11021CrossRef
25.
go back to reference Wang C, Liang C, Yu F R, Chen Q, Tang L (2017) Computation offloading and resource allocation in wireless cellular networks with mobile edge computing. IEEE Trans Wirel Commun 16(8):4924–4938CrossRef Wang C, Liang C, Yu F R, Chen Q, Tang L (2017) Computation offloading and resource allocation in wireless cellular networks with mobile edge computing. IEEE Trans Wirel Commun 16(8):4924–4938CrossRef
26.
go back to reference Wu H, Liu L, Zhang X, Ma H (2016) Quality of video oriented pricing incentive for mobile video offloading. In: IEEE INFOCOM 2016—the 35th annual IEEE international conference on computer communications. San Francisco, pp 1–9 Wu H, Liu L, Zhang X, Ma H (2016) Quality of video oriented pricing incentive for mobile video offloading. In: IEEE INFOCOM 2016—the 35th annual IEEE international conference on computer communications. San Francisco, pp 1–9
27.
go back to reference Chen H, Lou W, Wang Z, Wang Q (2016) A secure credit-based incentive mechanism for message forwarding in noncooperative DTNs. IEEE Trans Veh Technol 65(8):6377–6388CrossRef Chen H, Lou W, Wang Z, Wang Q (2016) A secure credit-based incentive mechanism for message forwarding in noncooperative DTNs. IEEE Trans Veh Technol 65(8):6377–6388CrossRef
28.
go back to reference Chen K, Shen H, Yan L (2015) Multicent: a multifunctional incentive scheme adaptive to diverse performance objectives for DTN routing. IEEE Trans Parallel Distrib Syst 1(6):1643–1653CrossRef Chen K, Shen H, Yan L (2015) Multicent: a multifunctional incentive scheme adaptive to diverse performance objectives for DTN routing. IEEE Trans Parallel Distrib Syst 1(6):1643–1653CrossRef
29.
go back to reference He J, Wang H, Chu X, Zhang T (2019) Incentive mechanism and content provider selection for device-to-device-based content sharing. IEEE Trans Veh Technol 68(3):2946–2957CrossRef He J, Wang H, Chu X, Zhang T (2019) Incentive mechanism and content provider selection for device-to-device-based content sharing. IEEE Trans Veh Technol 68(3):2946–2957CrossRef
30.
go back to reference Lai C, Zhang K, Cheng N, Li H, Shen X (2017) SIRC: a secure incentive scheme for reliable cooperative downloading in highway VANETs. IEEE Trans Intell Transp Syst 18(6):1559–1574 Lai C, Zhang K, Cheng N, Li H, Shen X (2017) SIRC: a secure incentive scheme for reliable cooperative downloading in highway VANETs. IEEE Trans Intell Transp Syst 18(6):1559–1574
31.
go back to reference Kontoudis G P, Vamvoudakis K G (2019) Kinodynamic motion planning with continuous-time q-learning: an online, model-free, and safe navigation framework. IEEE Trans Neural Netw Learn Syst 30(12):3803–3817MathSciNetCrossRef Kontoudis G P, Vamvoudakis K G (2019) Kinodynamic motion planning with continuous-time q-learning: an online, model-free, and safe navigation framework. IEEE Trans Neural Netw Learn Syst 30(12):3803–3817MathSciNetCrossRef
35.
go back to reference Kawamoto Y, Kamei T, Takahashi M, Kato N, Miura A, Toyoshima M (2020) Flexible resource allocation with inter-beam interference in satellite communication systems with a digital channelizer. IEEE Trans Wirel Commun 19(5):2934–2945CrossRef Kawamoto Y, Kamei T, Takahashi M, Kato N, Miura A, Toyoshima M (2020) Flexible resource allocation with inter-beam interference in satellite communication systems with a digital channelizer. IEEE Trans Wirel Commun 19(5):2934–2945CrossRef
36.
go back to reference Li X, Feng W, Chen Y, Wang C, Ge N (2020) Maritime coverage enhancement using UAVs coordinated with hybrid satellite-terrestrial networks. IEEE Trans Commun 68(4):2355–2369CrossRef Li X, Feng W, Chen Y, Wang C, Ge N (2020) Maritime coverage enhancement using UAVs coordinated with hybrid satellite-terrestrial networks. IEEE Trans Commun 68(4):2355–2369CrossRef
Metadata
Title
Cooperative content offloading scheme in air-ocean integrated networks
Authors
Junjie Zhou
Zhou Su
Qichao Xu
Weiwei Chen
Publication date
02-07-2021
Publisher
Springer US
Published in
Peer-to-Peer Networking and Applications / Issue 5/2021
Print ISSN: 1936-6442
Electronic ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-021-01160-z

Other articles of this Issue 5/2021

Peer-to-Peer Networking and Applications 5/2021 Go to the issue

Premium Partner