Skip to main content
Erschienen in:
Buchtitelbild

2014 | OriginalPaper | Buchkapitel

1. Introduction

verfasst von : Santosh Kulkarni, Prathima Agrawal

Erschienen in: Analysis of TCP Performance in Data Center Networks

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Growing adoption of Cloud Computing, by both the IT industry and the general public, is driving service providers into creating new data centers. Data centers are facilities that host hundreds of thousands of servers which concurrently support a myriad of distinct services and applications. Cost and compatibility reasons however, persuade many data center administrators to employ Ethernet as their baseline communication fabric. Unfortunately, TCP—the most widely used transport protocol on Ethernet based communication networks, exhibits several shortcomings when employed in high bandwidth, low latency data center environments. One such grave shortcoming is referred to as the Incast problem and will be the main focus of this manuscript.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat S.L. Garfinkel, H. Abelson, Architects of the Information Society: Thirty-Five Years of the Laboratory for Computer Science at MIT (The MIT Press, Cambridge, 1999) S.L. Garfinkel, H. Abelson, Architects of the Information Society: Thirty-Five Years of the Laboratory for Computer Science at MIT (The MIT Press, Cambridge, 1999)
4.
Zurück zum Zitat Z. Mahmood, R. Hill, Cloud Computing for Enterprise Architectures (Springer Publishing Company (Incorporated), London, 2011) Z. Mahmood, R. Hill, Cloud Computing for Enterprise Architectures (Springer Publishing Company (Incorporated), London, 2011)
6.
Zurück zum Zitat J. Rhoton, Cloud Computing Explained: Implementation Handbook for Enterprises. (Recursive Press, London, 2009) J. Rhoton, Cloud Computing Explained: Implementation Handbook for Enterprises. (Recursive Press, London, 2009)
8.
Zurück zum Zitat W.Y. Chang, H. Abu-Amara, J.F. Sanford, Transforming Enterprise Cloud Services. (Springer Publishing Company Incorporated, New York, 2010) W.Y. Chang, H. Abu-Amara, J.F. Sanford, Transforming Enterprise Cloud Services. (Springer Publishing Company Incorporated, New York, 2010)
10.
Zurück zum Zitat M. Miller, Cloud Computing: Web-Based Applications that Change the Way You Work and Collaborate Online. (Que, Indianapolis, 2008) M. Miller, Cloud Computing: Web-Based Applications that Change the Way You Work and Collaborate Online. (Que, Indianapolis, 2008)
11.
Zurück zum Zitat C. Takemura, L.S. Crawford, The Book of Xen: A Practical Guide for the System Administrator. (No Starch Press, San Francisco, 2009) C. Takemura, L.S. Crawford, The Book of Xen: A Practical Guide for the System Administrator. (No Starch Press, San Francisco, 2009)
12.
Zurück zum Zitat J. Arrasjid, K. Balachandran, D. Conde, G. Lamb, S. Kaplan, Deploying the VMware Infrastructure (The USENIX Association, Berkeley, 2010) J. Arrasjid, K. Balachandran, D. Conde, G. Lamb, S. Kaplan, Deploying the VMware Infrastructure (The USENIX Association, Berkeley, 2010)
14.
Zurück zum Zitat K. Murray, Microsoft Office 365: Connect and Collaborate Virtually Anywhere, Anytime, 1st edn. (Microsoft Press, Redmond, Washington, 2011) K. Murray, Microsoft Office 365: Connect and Collaborate Virtually Anywhere, Anytime, 1st edn. (Microsoft Press, Redmond, Washington, 2011)
15.
16.
Zurück zum Zitat B.F. Cooper, E. Baldeschwieler, R. Fonseca, J.J. Kistler, P.P.S. Narayan, C. Neerdaels, T. Negrin, R. Ramakrishnan, A. Silberstein, U. Srivastava, R. Stata, Building a cloud for Yahoo!. IEEE Data. Eng. Bull. 32, 36–43 (2009) B.F. Cooper, E. Baldeschwieler, R. Fonseca, J.J. Kistler, P.P.S. Narayan, C. Neerdaels, T. Negrin, R. Ramakrishnan, A. Silberstein, U. Srivastava, R. Stata, Building a cloud for Yahoo!. IEEE Data. Eng. Bull. 32, 36–43 (2009)
18.
Zurück zum Zitat D. Robinson, Amazon Web Services Made Simple: Learn how Amazon EC2, S3, SimpleDB and SQS Web Services Enables you to Reach Business Goals Faster (Emereo Pty Ltd, London, 2008) D. Robinson, Amazon Web Services Made Simple: Learn how Amazon EC2, S3, SimpleDB and SQS Web Services Enables you to Reach Business Goals Faster (Emereo Pty Ltd, London, 2008)
20.
Zurück zum Zitat F.P. Miller, A.F. Vandome, J. McBrewster, Gmail: Gmail. Webmail, Post Office Protocol, Internet Message Access Protocol, Google, Gmail interface, History of Gmail, Paul Buchheit, Google’s hoaxes, Comparison of webmail providers, Gmail Mobile. (Alpha Press, Orlando, 2009) F.P. Miller, A.F. Vandome, J. McBrewster, Gmail: Gmail. Webmail, Post Office Protocol, Internet Message Access Protocol, Google, Gmail interface, History of Gmail, Paul Buchheit, Google’s hoaxes, Comparison of webmail providers, Gmail Mobile. (Alpha Press, Orlando, 2009)
21.
Zurück zum Zitat A. Greenberg, J.R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, S. Sengupta, VL2: a scalable and flexible data center network, in Proceedings of the ACM SIGCOMM 2009 Conference on Data communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 51–62 [Online]. http://doi.acm.org/10.1145/1592568.1592576 A. Greenberg, J.R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, S. Sengupta, VL2: a scalable and flexible data center network, in Proceedings of the ACM SIGCOMM 2009 Conference on Data communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 51–62 [Online]. http://​doi.​acm.​org/​10.​1145/​1592568.​1592576
27.
Zurück zum Zitat T. Shanley, Infiniband (Addison-Wesley Longman Publishing Co., Inc., Boston, 2002) T. Shanley, Infiniband (Addison-Wesley Longman Publishing Co., Inc., Boston, 2002)
30.
Zurück zum Zitat IEEE Standard for Information Technology—Telecommunications and Information Exchange Between Systems—Local and Metropolitan Area Networks—Specific Requirements—Part 3: Carrier Sense Multiple Access With Collision Detection (CSMA/CD) Access Method and Physical Layer Specifications, LAN/MAN Standards Committee, New York, NY, USA, (2008) [Online]. http://standards.ieee.org/about/get/802/802.3.html IEEE Standard for Information Technology—Telecommunications and Information Exchange Between Systems—Local and Metropolitan Area Networks—Specific Requirements—Part 3: Carrier Sense Multiple Access With Collision Detection (CSMA/CD) Access Method and Physical Layer Specifications, LAN/MAN Standards Committee, New York, NY, USA, (2008) [Online]. http://​standards.​ieee.​org/​about/​get/​802/​802.​3.​html
31.
32.
Zurück zum Zitat U. Hoelzle, L.A. Barroso, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 1st edn. (Morgan and Claypool Publishers, San Rafael, 2009) U. Hoelzle, L.A. Barroso, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 1st edn. (Morgan and Claypool Publishers, San Rafael, 2009)
37.
Zurück zum Zitat N. Jani, K. Kant, SCTP Performance in Data Center Environments, in Proceedings of the 2005 International Symposium on Performance Evaluation of Computer and, Telecommunication Systems (SPECTS’05) (2005) N. Jani, K. Kant, SCTP Performance in Data Center Environments, in Proceedings of the 2005 International Symposium on Performance Evaluation of Computer and, Telecommunication Systems (SPECTS’05) (2005)
39.
Zurück zum Zitat L.S. Brakmo, S.W. O’Malley, L.L. Peterson, TCP Vegas: new techniques for congestion detection and avoidance, in Proceedings of the conference on Communications architectures, protocols and applications, ser. SIGCOMM ’94. (ACM, New York, USA, 1994), pp. 24–35 [Online]. http://doi.acm.org/10.1145/190314.190317 L.S. Brakmo, S.W. O’Malley, L.L. Peterson, TCP Vegas: new techniques for congestion detection and avoidance, in Proceedings of the conference on Communications architectures, protocols and applications, ser. SIGCOMM ’94. (ACM, New York, USA, 1994), pp. 24–35 [Online]. http://​doi.​acm.​org/​10.​1145/​190314.​190317
45.
Zurück zum Zitat ATM Forum Inc., ATM User Network Interface (UNI) Specification Version 3.1, 1st edn. (Prentice Hall, Upper Saddle River, New Jersy, 1995) ATM Forum Inc., ATM User Network Interface (UNI) Specification Version 3.1, 1st edn. (Prentice Hall, Upper Saddle River, New Jersy, 1995)
47.
48.
Zurück zum Zitat H. Balakrishnan, S. Seshan, E. Amir, R.H. Katz, Improving TCP/IP performance over wireless networks, in Proceedings of the 1st Annual International Conference on Mobile Computing and Networking, ser. MobiCom ’95. (ACM, New York, USA, 1995), pp. 2–11 [Online]. http://doi.acm.org/10.1145/215530.215544 H. Balakrishnan, S. Seshan, E. Amir, R.H. Katz, Improving TCP/IP performance over wireless networks, in Proceedings of the 1st Annual International Conference on Mobile Computing and Networking, ser. MobiCom ’95. (ACM, New York, USA, 1995), pp. 2–11 [Online]. http://​doi.​acm.​org/​10.​1145/​215530.​215544
49.
Zurück zum Zitat S.R. Cho, H. Sirisena, K. Pawlikowski, An end-to-end freeze TCP with timestamps for ad hoc networks, in ICC 2005, 40th IEEE International Conference on Communications ed. by B.G. Lee. IEEE Communications Society (Piscataway, NJ, USA, May 2005), pp. 3576–3582 [Online]. http://dx.doi.org/10.1109/ICC.2005.1495084 S.R. Cho, H. Sirisena, K. Pawlikowski, An end-to-end freeze TCP with timestamps for ad hoc networks, in ICC 2005, 40th IEEE International Conference on Communications ed. by B.G. Lee. IEEE Communications Society (Piscataway, NJ, USA, May 2005), pp. 3576–3582 [Online]. http://​dx.​doi.​org/​10.​1109/​ICC.​2005.​1495084
52.
Zurück zum Zitat S.H. Lee, H.G. Ahn, J.S. Lim, S.H. Kwak, S. Kim, Performance analysis of snoop TCP with freezing agent over cdma2000 networks, in Proceedings of the 7th CDMA International Conference on Mobile Communications, ser. CIC’02. (Springer-Verlag, Berlin, Heidelberg 2003), pp. 496–505 [Online]. http://dl.acm.org/citation.cfm?id=1766911.1766973 S.H. Lee, H.G. Ahn, J.S. Lim, S.H. Kwak, S. Kim, Performance analysis of snoop TCP with freezing agent over cdma2000 networks, in Proceedings of the 7th CDMA International Conference on Mobile Communications, ser. CIC’02. (Springer-Verlag, Berlin, Heidelberg 2003), pp. 496–505 [Online]. http://​dl.​acm.​org/​citation.​cfm?​id=​1766911.​1766973
59.
Zurück zum Zitat Y. Chen, R. Griffith, J. Liu, R.H. Katz, A.D. Joseph, Understanding TCP incast throughput collapse in datacenter networks, in Proceedings of the 1st ACM Workshop on Research on Enterprise Networking, ser. WREN ’09. (ACM, New York, USA, 2009), pp. 73–82 [Online]. http://doi.acm.org/10.1145/1592681.1592693 Y. Chen, R. Griffith, J. Liu, R.H. Katz, A.D. Joseph, Understanding TCP incast throughput collapse in datacenter networks, in Proceedings of the 1st ACM Workshop on Research on Enterprise Networking, ser. WREN ’09. (ACM, New York, USA, 2009), pp. 73–82 [Online]. http://​doi.​acm.​org/​10.​1145/​1592681.​1592693
60.
Zurück zum Zitat D. Nagle, D. Serenyi, A. Matthews, The Panasas activescale storage cluster: delivering scalable high bandwidth storage, in Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, ser. SC ’04. (IEEE Computer Society, Washington, DC, USA, 2004), p. 53 [Online]. http://dx.doi.org/10.1109/SC.2004.57 D. Nagle, D. Serenyi, A. Matthews, The Panasas activescale storage cluster: delivering scalable high bandwidth storage, in Proceedings of the 2004 ACM/IEEE Conference on Supercomputing, ser. SC ’04. (IEEE Computer Society, Washington, DC, USA, 2004), p. 53 [Online]. http://​dx.​doi.​org/​10.​1109/​SC.​2004.​57
61.
Zurück zum Zitat A. Phanishayee, E. Krevat, V. Vasudevan, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, Measurement and analysis of TCP throughput collapse in cluster-based storage systems, in Proceedings of the 6th USENIX Conference on File and Storage Technologies, ser. FAST’08. (USENIX Association, Berkeley, CA, USA, 2008), pp. 12:1–12:14 [Online]. http://dl.acm.org/citation.cfm?id=1364813.1364825 A. Phanishayee, E. Krevat, V. Vasudevan, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, Measurement and analysis of TCP throughput collapse in cluster-based storage systems, in Proceedings of the 6th USENIX Conference on File and Storage Technologies, ser. FAST’08. (USENIX Association, Berkeley, CA, USA, 2008), pp. 12:1–12:14 [Online]. http://​dl.​acm.​org/​citation.​cfm?​id=​1364813.​1364825
62.
Zurück zum Zitat E. Krevat, V. Vasudevan, A. Phanishayee, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems, in Proceedings of the 2nd International Workshop on Petascale Data Storage: Held in Conjunction with Supercomputing ’07, ser. PDSW ’07. (ACM, New York, USA, 2007), pp. 1–4 [Online]. http://doi.acm.org/10.1145/1374596.1374598 E. Krevat, V. Vasudevan, A. Phanishayee, D.G. Andersen, G.R. Ganger, G.A. Gibson, S. Seshan, On application-level approaches to avoiding TCP throughput collapse in cluster-based storage systems, in Proceedings of the 2nd International Workshop on Petascale Data Storage: Held in Conjunction with Supercomputing ’07, ser. PDSW ’07. (ACM, New York, USA, 2007), pp. 1–4 [Online]. http://​doi.​acm.​org/​10.​1145/​1374596.​1374598
63.
Zurück zum Zitat S. Kulkarni, P. Agrawal, A Probabilistic Approach to Address TCP Incast in Data Center Networks, in Proceedings of the 2011 31st International Conference on Distributed Computing Systems Workshops, ser. ICDCSW ’11. (IEEE Computer Society, Washington, DC, USA, 2011), pp. 26–33 [Online]. http://dx.doi.org/10.1109/ICDCSW.2011.41 S. Kulkarni, P. Agrawal, A Probabilistic Approach to Address TCP Incast in Data Center Networks, in Proceedings of the 2011 31st International Conference on Distributed Computing Systems Workshops, ser. ICDCSW ’11. (IEEE Computer Society, Washington, DC, USA, 2011), pp. 26–33 [Online]. http://​dx.​doi.​org/​10.​1109/​ICDCSW.​2011.​41
65.
Zurück zum Zitat R.Y. Wang, T.E. Anderson, xFS: A Wide Area Mass Storage File System (University of California at Berkeley, Berkeley, CA, USA, Technical Report, 1993) R.Y. Wang, T.E. Anderson, xFS: A Wide Area Mass Storage File System (University of California at Berkeley, Berkeley, CA, USA, Technical Report, 1993)
66.
Zurück zum Zitat G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, W. Vogels, Dynamo: Amazon’s highly available key-value store, in Proceedings of Twenty-first ACM SIGOPS Symposium on Operating Systems Principles, ser. SOSP ’07. (ACM, New York, USA, 2007), pp. 205–220 [Online]. http://doi.acm.org/10.1145/1294261.1294281 G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, W. Vogels, Dynamo: Amazon’s highly available key-value store, in Proceedings of Twenty-first ACM SIGOPS Symposium on Operating Systems Principles, ser. SOSP ’07. (ACM, New York, USA, 2007), pp. 205–220 [Online]. http://​doi.​acm.​org/​10.​1145/​1294261.​1294281
68.
Zurück zum Zitat S. Chakrabarti, M. van den Berg, B. Dom, Focused crawling: a new approach to topic-specific web resource discovery, in Proceedings of the Eighth International Conference on World Wide Web, ser. WWW ’99. (Elsevier North-Holland, Inc., New York, USA, 1999), pp. 1623–1640 [Online]. http://dl.acm.org/citation.cfm?id=313234.313121 S. Chakrabarti, M. van den Berg, B. Dom, Focused crawling: a new approach to topic-specific web resource discovery, in Proceedings of the Eighth International Conference on World Wide Web, ser. WWW ’99. (Elsevier North-Holland, Inc., New York, USA, 1999), pp. 1623–1640 [Online]. http://​dl.​acm.​org/​citation.​cfm?​id=​313234.​313121
70.
73.
Zurück zum Zitat K. Shvachko, H. Kuang, S. Radia, R. Chansler, The Hadoop distributed file system, in Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), ser. MSST ’10. (IEEE Computer Society, Washington, DC, USA, 2010), pp. 1–10 [Online]. http://dx.doi.org/10.1109/MSST.2010.5496972 K. Shvachko, H. Kuang, S. Radia, R. Chansler, The Hadoop distributed file system, in Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), ser. MSST ’10. (IEEE Computer Society, Washington, DC, USA, 2010), pp. 1–10 [Online]. http://​dx.​doi.​org/​10.​1109/​MSST.​2010.​5496972
74.
Zurück zum Zitat V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D.G. Andersen, G.R. Ganger, G.A. Gibson, B. Mueller, Safe and effective fine-grained TCP retransmissions for datacenter communication, in Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 303–314 [Online]. http://doi.acm.org/10.1145/1592568.1592604 V. Vasudevan, A. Phanishayee, H. Shah, E. Krevat, D.G. Andersen, G.R. Ganger, G.A. Gibson, B. Mueller, Safe and effective fine-grained TCP retransmissions for datacenter communication, in Proceedings of the ACM SIGCOMM 2009 Conference on Data Communication, ser. SIGCOMM ’09. (ACM, New York, USA, 2009), pp. 303–314 [Online]. http://​doi.​acm.​org/​10.​1145/​1592568.​1592604
75.
Zurück zum Zitat M. Alizadeh, A. Greenberg, D.A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, M. Sridharan, Data center TCP (DCTCP), in Proceedings of the ACM SIGCOMM 2010 Conference, ser. SIGCOMM ’10. (ACM, New York, USA, 2010), pp. 63–74 [Online]. http://doi.acm.org/10.1145/1851182.1851192 M. Alizadeh, A. Greenberg, D.A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, M. Sridharan, Data center TCP (DCTCP), in Proceedings of the ACM SIGCOMM 2010 Conference, ser. SIGCOMM ’10. (ACM, New York, USA, 2010), pp. 63–74 [Online]. http://​doi.​acm.​org/​10.​1145/​1851182.​1851192
Metadaten
Titel
Introduction
verfasst von
Santosh Kulkarni
Prathima Agrawal
Copyright-Jahr
2014
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4614-7861-4_1

Neuer Inhalt