Skip to main content

2016 | OriginalPaper | Buchkapitel

Collaborative Q-Learning Based Routing Control in Unstructured P2P Networks

verfasst von : Xiang-Jun Shen, Qing Chang, Jian-Ping Gou, Qi-Rong Mao, Zheng-Jun Zha, Ke Lu

Erschienen in: MultiMedia Modeling

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Query routing among peers whilst locating required resources is still an acute issue discussed P2P networking, especially in unstructured P2P networks. Such an issue becomes worse when there is frequent in and out movement of the peers in the network and also with node failures. We propose a new method to assure alternative routing path to balance the query loads among the peers under higher network churns. The proposed collaborative Q-learning method learns the networks parameters such as processing capacity, number of connections, and number of resources in the peers, along with their state of congestion. By this technique, peers are avoided to forward queries to the congested peers. Our simulation results show that the required resources are located more quickly and queries in the whole network are also balanced. Also our proposed protocol exhibits more robustness and adaptability under high network churns and heavy workloads than that of the random walk method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Risson, J., Moors, T.: Survey of research towards robust peer-to-peer networks: search methods. Comput. Netw. 50(17), 3485–3521 (2006)MATHCrossRef Risson, J., Moors, T.: Survey of research towards robust peer-to-peer networks: search methods. Comput. Netw. 50(17), 3485–3521 (2006)MATHCrossRef
2.
Zurück zum Zitat Lua, E.K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: Survey of research towards robust peer-to-peer networks: search methods. Commun. Surv. Tutorials 7(2), 72–93 (2005)CrossRef Lua, E.K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: Survey of research towards robust peer-to-peer networks: search methods. Commun. Surv. Tutorials 7(2), 72–93 (2005)CrossRef
3.
Zurück zum Zitat Khataniar, G., Goswami, D.: HUP: an unstructured hierarchical peer-to-peer protocol. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, pp. 671–676 (2010) Khataniar, G., Goswami, D.: HUP: an unstructured hierarchical peer-to-peer protocol. In: Proceedings of the International MultiConference of Engineers and Computer Scientists, pp. 671–676 (2010)
4.
Zurück zum Zitat Li, J.-S., Chao, C.-H.: An efficient super-peer overlay construction and broadcasting scheme based on perfect difference graph. IEEE Trans. Parallel Distrib. Syst. 21(5), 594–606 (2010)CrossRef Li, J.-S., Chao, C.-H.: An efficient super-peer overlay construction and broadcasting scheme based on perfect difference graph. IEEE Trans. Parallel Distrib. Syst. 21(5), 594–606 (2010)CrossRef
5.
Zurück zum Zitat Fakasa, G.J., Karakostas, B.: An efficient super-peer overlay construction and broadcasting scheme based on perfect difference graph. Inf. Softw. Technol. 46(6), 423–431 (2004)CrossRef Fakasa, G.J., Karakostas, B.: An efficient super-peer overlay construction and broadcasting scheme based on perfect difference graph. Inf. Softw. Technol. 46(6), 423–431 (2004)CrossRef
6.
Zurück zum Zitat Xu, Z., Bhuyan, L.N.: Effective load balancing in p2p systems. In: IEEE International Symposium on Cluster Computing and the Grid, pp. 81–88 (2006) Xu, Z., Bhuyan, L.N.: Effective load balancing in p2p systems. In: IEEE International Symposium on Cluster Computing and the Grid, pp. 81–88 (2006)
7.
Zurück zum Zitat Sreenu, G., Dhanya, P.M., Thampi, S.M.: Enhancement of bartercast using reinforcement learning to effectively manage freeriders. In: Advances in Computing and Communications, pp. 126–136 (2011) Sreenu, G., Dhanya, P.M., Thampi, S.M.: Enhancement of bartercast using reinforcement learning to effectively manage freeriders. In: Advances in Computing and Communications, pp. 126–136 (2011)
8.
Zurück zum Zitat Merino, L.R., Anta, A.F., Lópze, L., Cholvi, V.: Self-managed topologies in p2p networks. Comput. Netw. 53(10), 1722–1736 (2009)MATHCrossRef Merino, L.R., Anta, A.F., Lópze, L., Cholvi, V.: Self-managed topologies in p2p networks. Comput. Netw. 53(10), 1722–1736 (2009)MATHCrossRef
9.
Zurück zum Zitat Pournaras, E., Exarchakos, G., Antonopoulos, N.: Load-driven neighbourhood reconfiguration of gnutella overlay. Comput. Commun. 31(13), 3030–3039 (2008)CrossRef Pournaras, E., Exarchakos, G., Antonopoulos, N.: Load-driven neighbourhood reconfiguration of gnutella overlay. Comput. Commun. 31(13), 3030–3039 (2008)CrossRef
10.
Zurück zum Zitat Morales, R., Gupta, I.: AVMON: optimal and scalable discovery of consistent availability monitoring overlays for distributed systems. IEEE Trans. Parallel Distrib. Syst. 20(4), 446–459 (2009)CrossRef Morales, R., Gupta, I.: AVMON: optimal and scalable discovery of consistent availability monitoring overlays for distributed systems. IEEE Trans. Parallel Distrib. Syst. 20(4), 446–459 (2009)CrossRef
11.
Zurück zum Zitat Merugu, S., Srinivasan, S., Zegura, E.: Adding structure to unstructured peer-to-peer networks: the use of small-world graphs. J. Parallel Distrib. Comput. 65(2), 142–153 (2005)MATHCrossRef Merugu, S., Srinivasan, S., Zegura, E.: Adding structure to unstructured peer-to-peer networks: the use of small-world graphs. J. Parallel Distrib. Comput. 65(2), 142–153 (2005)MATHCrossRef
12.
Zurück zum Zitat Liu, L., Antonopoulos, N., Mackin, S., Xu, J., Russell, D.: Efficient resource discovery in self-organized unstructured peer-to-peer networks. Concurrency Comput. Pract. Experience 23(2), 159–183 (2009)CrossRef Liu, L., Antonopoulos, N., Mackin, S., Xu, J., Russell, D.: Efficient resource discovery in self-organized unstructured peer-to-peer networks. Concurrency Comput. Pract. Experience 23(2), 159–183 (2009)CrossRef
13.
Zurück zum Zitat Wu, K., Wu, C., Liu, L.: State-based search strategy in unstructured p2p. In: Proceedings of 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing, pp. 381–386 (2010) Wu, K., Wu, C., Liu, L.: State-based search strategy in unstructured p2p. In: Proceedings of 13th IEEE International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing, pp. 381–386 (2010)
14.
Zurück zum Zitat van Hasselt, H.: Reinforcement learning in continuous state and action spaces. In: Wiering, M., van Otterlo, M. (eds.) Reinforcement Learning. ALO, vol. 12, pp. 205–248. Springer, Heidelberg (2012) van Hasselt, H.: Reinforcement learning in continuous state and action spaces. In: Wiering, M., van Otterlo, M. (eds.) Reinforcement Learning. ALO, vol. 12, pp. 205–248. Springer, Heidelberg (2012)
15.
Zurück zum Zitat Gheshlaghi Azar, M., Munos, R., Ghavamzadaeh, M., Kappen, H.J.: Speedy Q-Learning. In: Advances in Neural Information Processing Systems, (NIPS 24), pp. 2411–2419 (2011) Gheshlaghi Azar, M., Munos, R., Ghavamzadaeh, M., Kappen, H.J.: Speedy Q-Learning. In: Advances in Neural Information Processing Systems, (NIPS 24), pp. 2411–2419 (2011)
16.
Zurück zum Zitat Sarolu, S., Gummadi, P.K., Gribble, S.D.: A measurement study of peer-to-peer file sharing systems. In: Proceedings of Multimedia Computing and Networking (2002) Sarolu, S., Gummadi, P.K., Gribble, S.D.: A measurement study of peer-to-peer file sharing systems. In: Proceedings of Multimedia Computing and Networking (2002)
Metadaten
Titel
Collaborative Q-Learning Based Routing Control in Unstructured P2P Networks
verfasst von
Xiang-Jun Shen
Qing Chang
Jian-Ping Gou
Qi-Rong Mao
Zheng-Jun Zha
Ke Lu
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-27671-7_76

Neuer Inhalt