Skip to main content
Erschienen in: The Journal of Supercomputing 1/2017

18.02.2016

High-throughput multi-multicast transfers in data center networks

verfasst von: Raúl H. Palacios, Antonio F. Díaz, Mancia Anguita, Julio Ortega, Cristina Rodríguez-Quintana

Erschienen in: The Journal of Supercomputing | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

It is usual that the applications executed in data centers require the distribution of the same data from one node to others at various execution points and that some of them require to cope with multiple of these diffusions in parallel. Multicast-based communications are an alternative solution to sending data efficiently to multiple nodes. This paper proposes a novel technique which offers reliability and congestion control in the multi-multicast transfers in data center networks. The proposal is based on: (1) a new congestion control mechanism, which monitors the control information of the receivers, reducing the server injection rate, (2) taking advantage of the switch diffusion hardware, and (3) using IGMP snooping, which allows a network switch to multicast a packet just to the output links with host receivers joined to a multicast group. The implementation is made at user level and uses the UDP interface. Evaluation tests are performed in a CentOS-based cluster composed of 12 servers in the presence of multiple diffusions at the same time. Test results show improvements in the global bandwidth, avoid network saturation, and reduce overhead included by unicast communications in data transmission.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat DRBD: Distributed replicated block device DRBD: Distributed replicated block device
2.
Zurück zum Zitat Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST ’10, pp 1–10. IEEE Computer Society, Washington, DC, USA Shvachko K, Kuang H, Radia S, Chansler R (2010) The hadoop distributed file system. In: Proceedings of the 2010 IEEE 26th symposium on mass storage systems and technologies (MSST), MSST ’10, pp 1–10. IEEE Computer Society, Washington, DC, USA
3.
Zurück zum Zitat Postel JB (1981) Transmission control protocol. Internet request for comments, September. RFC 793 Postel JB (1981) Transmission control protocol. Internet request for comments, September. RFC 793
4.
Zurück zum Zitat Lane RG, Daniels S, Yuan X (2007) An empirical study of reliable multicast protocols over ethernet-connected networks. Perform Eval 64(3):210–228CrossRef Lane RG, Daniels S, Yuan X (2007) An empirical study of reliable multicast protocols over ethernet-connected networks. Perform Eval 64(3):210–228CrossRef
5.
Zurück zum Zitat Solensky F, Christensen M, Kimball K (2006) Rfc 4541: considerations for internet group management protocol (IGMP) and multicast listener discovery (MLD) snooping switches Solensky F, Christensen M, Kimball K (2006) Rfc 4541: considerations for internet group management protocol (IGMP) and multicast listener discovery (MLD) snooping switches
6.
Zurück zum Zitat McBride M, Lui H (2012) Multicast in the data center overview. IETF, Internet Draft McBride M, Lui H (2012) Multicast in the data center overview. IETF, Internet Draft
7.
Zurück zum Zitat Atwood JW (2004) A classification of reliable multicast protocols. IEEE Netw 18(3):24–34CrossRef Atwood JW (2004) A classification of reliable multicast protocols. IEEE Netw 18(3):24–34CrossRef
8.
Zurück zum Zitat Obraczka K (1998) Multicast transport protocols: a survey and taxonomy. Commun Mag IEEE 36(1):94–102CrossRef Obraczka K (1998) Multicast transport protocols: a survey and taxonomy. Commun Mag IEEE 36(1):94–102CrossRef
9.
Zurück zum Zitat Chowdhury S, Fatema K (2013) Analysing TCP performance when link experiencing packet loss. Master’s thesis, University of Gothenburg, Göteborg, Sweden (2013) Chowdhury S, Fatema K (2013) Analysing TCP performance when link experiencing packet loss. Master’s thesis, University of Gothenburg, Göteborg, Sweden (2013)
10.
Zurück zum Zitat Yamamoto K, Sawa Y, Yamamoto M, Ikeda H (2000) Performance evaluation of ack-based and nak-based flow control schemes for reliable multicast. In: TENCON 2000. Proceedings, vol 1, pp 341–345 Yamamoto K, Sawa Y, Yamamoto M, Ikeda H (2000) Performance evaluation of ack-based and nak-based flow control schemes for reliable multicast. In: TENCON 2000. Proceedings, vol 1, pp 341–345
13.
Zurück zum Zitat Adamson B, Macker J, Bormann C, Handley M (2009) Rfc 5740: Nack-oriented reliable multicast (NORM) transport protocol. In: Technical report Adamson B, Macker J, Bormann C, Handley M (2009) Rfc 5740: Nack-oriented reliable multicast (NORM) transport protocol. In: Technical report
14.
Zurück zum Zitat Kasera SK, Hjalmtusson G, Towsley DF, Kurose JF (2000) Scalable reliable multicast using multiple multicast channels. IEEE/ACM Trans Netw 8(3):294–310CrossRef Kasera SK, Hjalmtusson G, Towsley DF, Kurose JF (2000) Scalable reliable multicast using multiple multicast channels. IEEE/ACM Trans Netw 8(3):294–310CrossRef
15.
Zurück zum Zitat Gemmell J, Montgomery T, Speakman T, Crowcroft J (2003) The PGM reliable multicast protocol. Netw IEEE 17(1):16–22CrossRef Gemmell J, Montgomery T, Speakman T, Crowcroft J (2003) The PGM reliable multicast protocol. Netw IEEE 17(1):16–22CrossRef
16.
17.
Zurück zum Zitat Paul S, Sabnani KK, Lin JC-H, Bhattacharyya S (1997) Reliable multicast transport protocol (RMTP). IEEE J Sel Areas Commun 15(3):407–421CrossRef Paul S, Sabnani KK, Lin JC-H, Bhattacharyya S (1997) Reliable multicast transport protocol (RMTP). IEEE J Sel Areas Commun 15(3):407–421CrossRef
18.
Zurück zum Zitat Yavatkar R, Griffoen J, Sudan M (1995) A reliable dissemination protocol for interactive collaborative applications. In: Proceedings of the third ACM international conference on multimedia, MULTIMEDIA ’95, pp 333–344. ACM, New York, NY, USA Yavatkar R, Griffoen J, Sudan M (1995) A reliable dissemination protocol for interactive collaborative applications. In: Proceedings of the third ACM international conference on multimedia, MULTIMEDIA ’95, pp 333–344. ACM, New York, NY, USA
19.
Zurück zum Zitat Holbrook HW, Singhal SK, Cheriton DR (1995) Log-based receiver-reliable multicast for distributed interactive simulation. SIGCOMM Comput Commun Rev 25(4):328–341CrossRef Holbrook HW, Singhal SK, Cheriton DR (1995) Log-based receiver-reliable multicast for distributed interactive simulation. SIGCOMM Comput Commun Rev 25(4):328–341CrossRef
20.
Zurück zum Zitat Sheu T-L, Lin S-T (2013) A multicast retransmission scheme using negative ack in wireless networks. In: 2013 IEEE 27th international conference on advanced information networking and applications (AINA), pp 1144–1149 Sheu T-L, Lin S-T (2013) A multicast retransmission scheme using negative ack in wireless networks. In: 2013 IEEE 27th international conference on advanced information networking and applications (AINA), pp 1144–1149
21.
Zurück zum Zitat Palacios RH, Díaz AF, Ortega J, Rodríguez-Quintana C, Anguita M (2015) Analyzing high-throughput multicast traffic in cluster computing. In: Proceedings of the 15th international conference on computational and mathematical methods in science and engineering, CMMSE 2015 6–10 Palacios RH, Díaz AF, Ortega J, Rodríguez-Quintana C, Anguita M (2015) Analyzing high-throughput multicast traffic in cluster computing. In: Proceedings of the 15th international conference on computational and mathematical methods in science and engineering, CMMSE 2015 6–10
Metadaten
Titel
High-throughput multi-multicast transfers in data center networks
verfasst von
Raúl H. Palacios
Antonio F. Díaz
Mancia Anguita
Julio Ortega
Cristina Rodríguez-Quintana
Publikationsdatum
18.02.2016
Verlag
Springer US
Erschienen in
The Journal of Supercomputing / Ausgabe 1/2017
Print ISSN: 0920-8542
Elektronische ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-016-1664-4

Weitere Artikel der Ausgabe 1/2017

The Journal of Supercomputing 1/2017 Zur Ausgabe

Premium Partner