Skip to main content
Erschienen in: Peer-to-Peer Networking and Applications 4/2020

07.01.2020

AFSndn: A novel adaptive forwarding strategy in named data networking based on Q-learning

verfasst von: Mingchuan Zhang, Xin Wang, Tingting Liu, Junlong Zhu, Qingtao Wu

Erschienen in: Peer-to-Peer Networking and Applications | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Named Data Networking (NDN) is a new network architecture, which employs a new content-centric communication model to replace the traditional host-centric communication model. In TCP/IP network, data packets are forwarded by routers according to routing table established previously. While in NDN, routing nodes can dynamically make forwarding decisions based on network status. By considering this forwarding feature, we proposed a novel adaptive forwarding strategy in Named Data Networking (AFSndn) based on Q-learning to minimize the delivery time. AFSndn is divided into two phases—Exploration phase and Exploitation phase. The Exploration phase aims to collect information, while the Exploitation phase aims to dynamically forward interest packets. Simulation experiment results show that AFSndn has better performance compared to others famous algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Fang C, Yu F, Huang T et al (2015) A survey of green information-centric networking: research issues and challenges. IEEE Commun Surv Tutorials 8(3):1455–1472CrossRef Fang C, Yu F, Huang T et al (2015) A survey of green information-centric networking: research issues and challenges. IEEE Commun Surv Tutorials 8(3):1455–1472CrossRef
2.
Zurück zum Zitat Amadeo M, Campolo C, Quevedo J et al (2016) Information-centric networking for the internet of things: challenges and opportunities. IEEE Netw 30(2):92–100CrossRef Amadeo M, Campolo C, Quevedo J et al (2016) Information-centric networking for the internet of things: challenges and opportunities. IEEE Netw 30(2):92–100CrossRef
3.
Zurück zum Zitat Zhang L, Afanasyev A, Burke J et al (2014) Named data networking. ACM SIGCOMM Comput Commun Rev 44(3):66–73CrossRef Zhang L, Afanasyev A, Burke J et al (2014) Named data networking. ACM SIGCOMM Comput Commun Rev 44(3):66–73CrossRef
4.
Zurück zum Zitat Feng B, Zhang H, Zhou H et al (2017) Locator/identifier Split networking: a promising future internet architecture. IEEE Commun Surv Tutorials 19(4):2927–2948CrossRef Feng B, Zhang H, Zhou H et al (2017) Locator/identifier Split networking: a promising future internet architecture. IEEE Commun Surv Tutorials 19(4):2927–2948CrossRef
5.
Zurück zum Zitat Araújo FRC, de Sousa AM, Sampaio LN (2019) SCaN-Mob: An opportunistic caching strategy to support producer mobility in named data wireless networking. Comput Netw 156:62–74CrossRef Araújo FRC, de Sousa AM, Sampaio LN (2019) SCaN-Mob: An opportunistic caching strategy to support producer mobility in named data wireless networking. Comput Netw 156:62–74CrossRef
6.
Zurück zum Zitat Kumar N, Aleem A, Singh AK, Srivastava S (2019) NBP: Namespace-based privacy to counter timing-based attack in named data networking. J Netw Comput Appl 144:155–170CrossRef Kumar N, Aleem A, Singh AK, Srivastava S (2019) NBP: Namespace-based privacy to counter timing-based attack in named data networking. J Netw Comput Appl 144:155–170CrossRef
7.
Zurück zum Zitat Zhang H, Quan W, Hu B et al (2016) Smart identifier network: a collaborative architecture for the future internet. IEEE Netw 30(3):46–51CrossRef Zhang H, Quan W, Hu B et al (2016) Smart identifier network: a collaborative architecture for the future internet. IEEE Netw 30(3):46–51CrossRef
8.
Zurück zum Zitat Acs G, Conti M, Gasti P, Ghali C, Tsudik G, Wood CA (2019) Privacy-aware caching in information-centric networking. IEEE Trans Dependable Secure Comput 16(2):313–328 Acs G, Conti M, Gasti P, Ghali C, Tsudik G, Wood CA (2019) Privacy-aware caching in information-centric networking. IEEE Trans Dependable Secure Comput 16(2):313–328
9.
Zurück zum Zitat Liu T, Zhang M, Zhu J et al (2018) ACCP: adaptive congestion control protocol in named data networking based on deep learning. Neural Comput Appl 31:4675–4683 Liu T, Zhang M, Zhu J et al (2018) ACCP: adaptive congestion control protocol in named data networking based on deep learning. Neural Comput Appl 31:4675–4683
10.
Zurück zum Zitat Pacifici V, Dán G (2016) Coordinated selfish distributed caching for peering content-centric networks. IEEE/ACM Trans Networking 24(6):3690–3701CrossRef Pacifici V, Dán G (2016) Coordinated selfish distributed caching for peering content-centric networks. IEEE/ACM Trans Networking 24(6):3690–3701CrossRef
11.
Zurück zum Zitat Song F, Ai Z, Li J, Pau G, Collotta M, You I, Zhang H (2017) Smart collaborative caching for information-centric IoT in fog computing. Sensors 17(11):2512CrossRef Song F, Ai Z, Li J, Pau G, Collotta M, You I, Zhang H (2017) Smart collaborative caching for information-centric IoT in fog computing. Sensors 17(11):2512CrossRef
12.
Zurück zum Zitat Feng B, Zhou H, Zhang M et al (2015) Cache-filter: a cache permission policy for information-centric networking. KSII Trans Int Inf Syst 9(12):4912–4933 Feng B, Zhou H, Zhang M et al (2015) Cache-filter: a cache permission policy for information-centric networking. KSII Trans Int Inf Syst 9(12):4912–4933
13.
Zurück zum Zitat Zhang M, Xie P, Zhu J et al (2017) NCPP-based caching and NUR-based resource allocation for information-centric networking. J Ambient Intell Humaniz Comput (4–5):1–7 Zhang M, Xie P, Zhu J et al (2017) NCPP-based caching and NUR-based resource allocation for information-centric networking. J Ambient Intell Humaniz Comput (4–5):1–7
14.
Zurück zum Zitat Li Q, Lee P, Zhang P et al (2017) Capability-based security enforcement in named data networking. IEEE/ACM Trans Networking 25(5):2719–2730CrossRef Li Q, Lee P, Zhang P et al (2017) Capability-based security enforcement in named data networking. IEEE/ACM Trans Networking 25(5):2719–2730CrossRef
15.
Zurück zum Zitat Karami A (2015) ACCPndn: adaptive congestion control protocol in named data networking. J Netw Comput Appl 56(1):1–18CrossRef Karami A (2015) ACCPndn: adaptive congestion control protocol in named data networking. J Netw Comput Appl 56(1):1–18CrossRef
16.
Zurück zum Zitat Qiao X, Ren P, Chen J, Tan W, Blake MB, Xu W (2019) Session persistence for dynamic web applications in Named Data Networking. J Netw Comput Appl 125:220–235CrossRef Qiao X, Ren P, Chen J, Tan W, Blake MB, Xu W (2019) Session persistence for dynamic web applications in Named Data Networking. J Netw Comput Appl 125:220–235CrossRef
17.
Zurück zum Zitat Yang H, Wang X, Yang C, Cong X, Zhang Y (2018) Securing content-centric networks with content-based encryption. J Netw Comput Appl 128:21–32 Yang H, Wang X, Yang C, Cong X, Zhang Y (2018) Securing content-centric networks with content-based encryption. J Netw Comput Appl 128:21–32
18.
Zurück zum Zitat Ben J, Kröse A (1995) Learning from delayed rewards. Robot Auton Syst 15(4):233–223CrossRef Ben J, Kröse A (1995) Learning from delayed rewards. Robot Auton Syst 15(4):233–223CrossRef
19.
Zurück zum Zitat Carofiglio G, Gallo M, Muscariello L et al. (2013) Optimal multipath congestion control and request forwarding in information-centric networks, IEEE international conference on network protocols (ICNP) Carofiglio G, Gallo M, Muscariello L et al. (2013) Optimal multipath congestion control and request forwarding in information-centric networks, IEEE international conference on network protocols (ICNP)
20.
Zurück zum Zitat Udugama A, Zhang X, Kuladinithi K et al. (2014) An On-demand Multi-Path Interest Forwarding Strategy for Content Retrievals in CCN, IEEE/IFIP Network Operations and Management Symposium (NOMS), pp. 1–6 Udugama A, Zhang X, Kuladinithi K et al. (2014) An On-demand Multi-Path Interest Forwarding Strategy for Content Retrievals in CCN, IEEE/IFIP Network Operations and Management Symposium (NOMS), pp. 1–6
21.
Zurück zum Zitat Lei K, Wang J, Yuan J (2015) An entropy-based probabilistic forwarding strategy in named data networking. IEEE international conference on communications (ICC), pp. 5665–5671 Lei K, Wang J, Yuan J (2015) An entropy-based probabilistic forwarding strategy in named data networking. IEEE international conference on communications (ICC), pp. 5665–5671
22.
Zurück zum Zitat Rossini G, Rossi D (2014) Coupling caching and forwarding: benefits, analysis, and implementation. ACM international conference on Information-centric networking, pp. 127–136 Rossini G, Rossi D (2014) Coupling caching and forwarding: benefits, analysis, and implementation. ACM international conference on Information-centric networking, pp. 127–136
23.
Zurück zum Zitat Li C, Huang T, Xie R et al. (2015) A novel multi-path traffic control mechanism in named data networking. IEEE international conference on telecommunications, pp. 60–66 Li C, Huang T, Xie R et al. (2015) A novel multi-path traffic control mechanism in named data networking. IEEE international conference on telecommunications, pp. 60–66
24.
Zurück zum Zitat Qian H, Ravindran R, Wang G et al. (2013) Probability-based adaptive forwarding strategy in named data networking. IFIP/IEEE international symposium on integrated network management, pp. 1094–1101 Qian H, Ravindran R, Wang G et al. (2013) Probability-based adaptive forwarding strategy in named data networking. IFIP/IEEE international symposium on integrated network management, pp. 1094–1101
25.
Zurück zum Zitat Yi C, Afanasyev A, Moiseenko I et al (2013) A case for stateful forwarding plane. Comput Commun 36(7):779–791CrossRef Yi C, Afanasyev A, Moiseenko I et al (2013) A case for stateful forwarding plane. Comput Commun 36(7):779–791CrossRef
26.
Zurück zum Zitat Ng AY, Harada D, Russell S (1999) Policy invariance under reward transformations: theory and application to reward shaping [C]. Sixteenth international conference on machine learning, pp. 278–187 Ng AY, Harada D, Russell S (1999) Policy invariance under reward transformations: theory and application to reward shaping [C]. Sixteenth international conference on machine learning, pp. 278–187
27.
Zurück zum Zitat Bianchi RAC, Celiberto LA, Santos PE et al (2015) Transferring knowledge as heuristics in reinforcement learning: a case-based approach. Artif Intell 226:102–121MathSciNetCrossRef Bianchi RAC, Celiberto LA, Santos PE et al (2015) Transferring knowledge as heuristics in reinforcement learning: a case-based approach. Artif Intell 226:102–121MathSciNetCrossRef
28.
Zurück zum Zitat Bianchi RAC, Santos PE, Silva IJ, Celiberto LA, de Mantaras RL (2018) Heuristically accelerated reinforcement learning by means of case-based reasoning and transfer learning. J Intell Robot Syst 91(2):301–312CrossRef Bianchi RAC, Santos PE, Silva IJ, Celiberto LA, de Mantaras RL (2018) Heuristically accelerated reinforcement learning by means of case-based reasoning and transfer learning. J Intell Robot Syst 91(2):301–312CrossRef
29.
Zurück zum Zitat Ferreira LA, Costa Ribeiro CH, Augusto DCBR (2014) Heuristically accelerated reinforcement learning modularization for multi-agent multi-objective problems. Appl Intell 41(2):551–562CrossRef Ferreira LA, Costa Ribeiro CH, Augusto DCBR (2014) Heuristically accelerated reinforcement learning modularization for multi-agent multi-objective problems. Appl Intell 41(2):551–562CrossRef
30.
Zurück zum Zitat Yogeswaran M, Ponnambalam SG (2012) Reinforcement learning: exploration–exploitation dilemma in multi-agent foraging task. OPSEARCH 49(3):223–236CrossRef Yogeswaran M, Ponnambalam SG (2012) Reinforcement learning: exploration–exploitation dilemma in multi-agent foraging task. OPSEARCH 49(3):223–236CrossRef
31.
Zurück zum Zitat Mastorakis S, Afanasyev A, Moiseenko I, et al. (2015) ndnSIM2.0: A new version of the NDN simulator for NS-3. Technical report NDN-0028 Mastorakis S, Afanasyev A, Moiseenko I, et al. (2015) ndnSIM2.0: A new version of the NDN simulator for NS-3. Technical report NDN-0028
Metadaten
Titel
AFSndn: A novel adaptive forwarding strategy in named data networking based on Q-learning
verfasst von
Mingchuan Zhang
Xin Wang
Tingting Liu
Junlong Zhu
Qingtao Wu
Publikationsdatum
07.01.2020
Verlag
Springer US
Erschienen in
Peer-to-Peer Networking and Applications / Ausgabe 4/2020
Print ISSN: 1936-6442
Elektronische ISSN: 1936-6450
DOI
https://doi.org/10.1007/s12083-019-00845-w

Weitere Artikel der Ausgabe 4/2020

Peer-to-Peer Networking and Applications 4/2020 Zur Ausgabe