Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
Introduction Kapitel lesen Erstes Kapitel lesen

2021 | OriginalPaper | Buchkapitel

6. Data Center Architecture, Operation, and Optimization

verfasst von : Kaiyang Liu, Aqun Zhao, Jianping Pan

Erschienen in: Future Networks, Services and Management

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Modern large-scale data centers are very different than they were just a short time ago, which form the core infrastructure support for the ever-expanding cloud services. In this chapter, we survey representative data center network topologies, highlighting their advantages and disadvantages in terms of network architecture and scalability. Then, the data forwarding and routing schemes that are designed for these topologies are presented and compared based on various criteria. Thereafter, we discuss the traffic optimization techniques that are designed for the efficient operation of data center networks. A full understanding of the state-of-the-art data center networks is beneficial to future network design. We discuss several future trends of data center networks that let network infrastructure meet the ultimate challenges of the upcoming days.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Access and Edge Network Architecture and Management
Nächstes Kapitel Public Cloud Architecture
Fußnoten
1
Unlike Fat-tree and VL2, n is used to represent the number of ports in DCell and BCube.
 
2
If a specific number of servers are fixed for specific applications without agility, data centers may operate at low resource utilization with growing and variable demands.
 
3
The large flows are detected if their rates are larger than 10% of the link capacity.
 
4
The action of parity chunk retrieval for decoding is defined as degraded read.
 
Literatur
1.
Y. Mansouri, A.N. Toosi, R. Buyya, Data storage management in cloud environments: taxonomy, survey, and future directions. ACM Comput. Surv. 50(6), 1–51 (2018)CrossRef
2.
3.
W. Xia, P. Zhao, Y. Wen, H. Xie, A survey on data center networking (DCN): infrastructure and operations. IEEE Commun. Surv. Tuts. 19(1), 640–656 (2017)CrossRef
4.
T. Ye, T.T. Lee, M. Ge, W. Hu, Modular AWG-based interconnection for large-scale data center networks. IEEE Trans. Cloud Comput. 6(3), 785–799 (2018)CrossRef
5.
N. Jones, How to stop data centres from gobbling up the world’s electricity. Nature 561(7722), 163–167 (2018)CrossRef
6.
A.S.G. Andrae, T. Edler, On global electricity usage of communication technology: trends to 2030. Challenges 6(1), 117–157 (2015)CrossRef
7.
8.
T. Benson, A. Akella, D.A. Maltz, Network traffic characteristics of data centers in the wild, in ACM IMC, 2010, pp. 267–280
9.
L. Chen, J. Lingys, K. Chen, F. Liu, AuTO: scaling deep reinforcement learning for datacenter-scale automatic traffic optimization, in ACM SIGCOMM (2018), pp. 191–205
10.
K. Chen, C. Hu, X. Zhang, K. Zheng, Y. Chen, A.V. Vasilakos, Survey on routing in data centers: insights and future directions. IEEE Netw. 25(4), 6–10 (2011)CrossRef
11.
J. Zhang, F.R. Yu, S. Wang, T. Huang, Z. Liu, Y. Liu, Load balancing in data center networks: a survey. IEEE Commun. Surv. Tuts. 20(3), 2324–2352 (2018)CrossRef
12.
E. Baccour, S. Foufou, R. Hamila, A. Erbad, Green data center networks: a holistic survey and design guidelines, in IEEE IWCMC, 2019, pp. 1108–1114
13.
C. Kachris, I. Tomkos, A survey on optical interconnects for data centers. IEEE Commun. Surv. Tuts. 14(4), 1021–1036 (2012)CrossRef
14.
M.F. Bari, R. Boutaba, R. Esteves, L.Z. Granville, M. Podlesny, M.G. Rabbani, Q. Zhang, M.F. Zhani, Data center network virtualization: a survey. IEEE Commun. Surv. Tuts. 15(2), 909–928 (2013)CrossRef
15.
M. Al-Fares, A. Loukissas, A. Vahdat, A scalable, commodity data center network architecture, in ACM SIGCOMM, 2008, pp. 63–74
16.
A. Greenberg, J.R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, S. Sengupta, VL2: a scalable and flexible data center network, in ACM SIGCOMM, 2009, pp. 51–62
17.
Y. Sun, J. Chen, Q. Liu, W. Fang, Diamond: an improved fat-tree architecture for large-scale data centers. J. Commun. 9(1), 91–98 (2014)CrossRef
18.
M. Walraed-Sullivan, A. Vahdat, K. Marzullo, Aspen trees: balancing data center fault tolerance, scalability and cost, in ACM CoNEXT, 2013, pp. 85–96
19.
V. Liu, D. Halperin, A. Krishnamurthy, T. Anderson, F10: a fault-tolerant engineered network, in USENIX NSDI, 2013, pp. 399–412
20.
G. Chen, Y. Zhao, D. Pei, D. Li, Rewiring 2 links is enough: accelerating failure recovery in production data center networks, in IEEE ICDCS, 2015, pp. 569–578
21.
L. Gyarmati, T.A. Trinh, Scafida: a scale-free network inspired data center architecture. ACM SIGCOMM Comput. Commun. Rev. 40(5), 4–12 (2010)CrossRef
22.
J.Y. Shin, B. Wong, E.G. Sirer, Small-world datacenters, in ACM SOCC, 2011, pp. 1–13
23.
A. Singla, C.Y. Hong, L. Popa, P.B. Godfrey, Jellyfish: networking data centers randomly, in USENIX NSDI, 2012, pp. 225–238
24.
X.Y. Lin, Y.C. Chung, T.Y. Huang, A multiple LID routing scheme for fat-tree-based InfiniBand networks, in IEEE IPDPS, 2004, p. 11
25.
C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, S. Lu, DCell: a scalable and fault-tolerant network structure for data centers, in ACM SIGCOMM, 2008, pp. 75–86
26.
C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, S. Lu, BCube: a high performance, server-centric network architecture for modular data centers, in ACM SIGCOMM, 2009, pp. 63–74
27.
D. Li, C. Guo, H. Wu, K. Tan, Y. Zhang, S. Lu, FiConn: using backup port for server interconnection in data centers, in IEEE INFOCOM, 2009, pp. 2276–2285
28.
Y. Liao, D. Yin, L. Gao, DPillar: scalable dual-port server interconnection for data center networks, in IEEE ICCCN, 2010, pp. 1–6
29.
C. Wang, C. Wang, Y. Yuan, Y. Wei, MCube: a high performance and fault-tolerant network architecture for data centers, in IEEE ICCDA, 2010, pp. 423–427
30.
H. Wu, G. Lu, D. Li, C. Guo, Y. Zhang, MDCube: a high performance network structure for modular data center interconnection, in ACM CoNEXT, 2009, pp. 25–36
31.
L. Huang, Q. Jia, X. Wang, S. Yang, B. Li, PCube: improving power efficiency in data center networks, in IEEE CLOUD, 2011, pp. 65–72
32.
X. Liu, S. Yang, L. Guo, S. Wang, H. Song, Snowflake: a new-type network structure of data center. Chin. J. Comput. 34(1), 76–85 (2011)CrossRef
33.
Z. Ding, D. Guo, X. Liu, X. Luo, G. Chen, A MapReduce-supported network structure for data centers. Concurr. Comput. Pract. Exp. 24(12), 1271–1295 (2012)CrossRef
34.
Y. Liu, J.K. Muppala, M. Veeraraghavan, D. Lin, M. Hamdi, Data center network topologies: current state-of-the-art (Springer International Publishing, Cham, 2013), pp. 7–14CrossRef
35.
D. Abts, M.R. Marty, P.M. Wells, P. Klausler, H. Liu, Energy proportional datacenter networks. ACM SIGARCH Comput. Archit. News 38(3), 338–347 (2010)CrossRef
36.
H. Abu-Libdeh, P. Costa, A. Rowstron, G. O’Shea, A. Donnelly, Symbiotic routing in future data centers, in ACM SIGCOMM, 2010, pp. 51–62
37.
D. Lin, Y. Liu, M. Hamdi, J. Muppala, Hyper-BCube: a scalable data center network, IEEE ICC, 2012, pp. 2918–2923
38.
J. Kim, W.J. Dally, D. Abts, Flattened butterfly: a cost-efficient topology for high-radix networks. ACM SIGARCH Comput. Archit. News 35(2), 126–137 (2007)CrossRef
39.
G. Wang, D. Andersen, M. Kaminsky, K. Papagiannaki, T. Ng, M. Kozuch, M. Ryan, c-Through: part-time optics in data centers. ACM SIGCOMM Comput. Commun. Rev. 40(4), 327–338 (2010)CrossRef
40.
N. Farrington, G. Porter, S. Radhakrishnan, H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, A. Vahdat, Helios: a hybrid electrical/optical switch architecture for modular data centers. ACM SIGCOMM Comput. Commun. Rev. 40(4), 339–350 (2010)CrossRef
41.
K. Chen, A. Singla, A. Singh, K. Ramachandran, L. Xu, Y. Zhang, X. Wen, Y. Chen, OSA: an optical switching architecture for data center networks with unprecedented flexibility, in USENIX NSDI, 2012, pp. 239–252
42.
43.
M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, A. Vahdat, Hedera: dynamic flow scheduling for data center networks, in USENIX NSDI, 2010, pp. 89–92
44.
J.P.S. Kandula, P. Bahl, Flyways to de-congest data center networks, in ACM HotNets, 2009, pp. 1–6
45.
D. Halperin, S. Kandula, J. Padhye, P. Bahl, D. Wetherall, Augmenting data center networks with multi-gigabit wireless links, in ACM SIGCOMM, 2011, pp. 38–49
46.
Y. Cui, H. Wang, X. Cheng, B. Chen, Wireless data center networking. IEEE Wirel. Commun. 18(6), 46–53 (2011)CrossRef
47.
48.
A. Cayley, On the theory of groups. Am. J. Math. 11(2), 139–157 (1889)CrossRef
49.
A. Singh, J. Ong, A. Agarwal, G. Anderson, A. Armistead, R. Bannon, S. Boving, G. Desai, B. Felderman, P. Germano et al., Jupiter rising: a decade of Clos topologies and centralized control in Google’s datacenter network, in ACM SIGCOMM, 2015, pp. 183–197
50.
51.
N. Farrington, A. Andreyev, Facebook’s data center network architecture, in IEEE OI, 2013, pp. 49–50
52.
Q. Pu, G. Ananthanarayanan, P. Bodik, S. Kandula, A. Akella, P. Bahl, I. Stoica, Low latency geo-distributed data analytics, in ACM SIGCOMM, 2015, pp. 421–434
53.
O. Khan, R.C. Burns, J.S. Plank, W. Pierce, C. Huang, Rethinking erasure codes for cloud file systems: minimizing I/O for recovery and degraded reads, in USENIX FAST, 2012, pp. 20–33
54.
R. Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, A. Vahdat, Portland: a scalable fault-tolerant layer 2 data center network fabric, in ACM SIGCOMM, 2009, pp. 39–50
55.
S. Hu, K. Chen, H. Wu, W. Bai, C. Lan, H. Wang, C. Guo, Explicit path control in commodity data centers: design and applications, in USENIX NSDI, 2015, pp. 15–28
56.
M. Besta, M. Schneider, K. Cynk, M. Konieczny, E. Henriksson, S. Di Girolamo, T. Hoefler, FatPaths: routing in supercomputers, data centers, and clouds with low-diameter networks when shortest paths fall short. arXiv preprint arXiv:1906.10885 (2019)
57.
A. Zhao, Z. Liu, J. Pan, M. Liang, A simple, cost-effective addressing and routing architecture for fat-tree based datacenter networks, in IEEE INFOCOM Workshop on DCPerf, 2017, pp. 36–41
58.
59.
P. Costa, A. Donnelly, G. O’Shea, A. Rowstron, CamCube: a key-based data center, Technical Report MSR TR-2010-74, Microsoft Research, 2010
60.
C.A. Sunshine, Source routing in computer networks. ACM SIGCOMM Comput. Commun. Rev. 7(1), 29–33 (1977)CrossRef
61.
E. Rosen, A. Viswanathan, R. Callon, Multiprotocol label switching architecture, RFC 3031 (2001)
62.
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, J. Turner, OpenFlow: enabling innovation in campus networks. ACM SIGCOMM Comput. Commun. Rev. 38(2), 69–74 (2008)CrossRef
63.
M. Besta, T. Hoefler, Slim fly: a cost effective low-diameter network topology, in IEEE SC, 2014, pp. 348–359
64.
A. Valadarsky, M. Dinitz, M. Schapira, Xpander: unveiling the secrets of high-performance datacenters, in ACM HotNets, 2015, pp. 1–7
65.
M. Handley, C. Raiciu, A. Agache, A. Voinescu, A.W. Moore, G. Antichi, M. Wójcik, Re-architecting datacenter networks and stacks for low latency and high performance, in ACM SIGCOMM, 2017, pp. 29–42
66.
S. Kandula, S. Sengupta, A. Greenberg, P. Patel, R. Chaiken, The nature of data center traffic: measurements & analysis, in ACM IMC, 2009, pp. 202–208
67.
M. Alizadeh, A. Greenberg, D.A. Maltz, J. Padhye, P. Patel, B. Prabhakar, M. Sridharan, Data center TCP (DCTCP), in ACM SIGCOMM, 2010, pp. 63–74
68.
69.
Q. Liu, Z. Yu, The elasticity and plasticity in semi-containerized co-locating cloud workload: a view from Alibaba trace, in ACM SoCC, 2018, pp. 347–360
70.
A. Kabbani, B. Vamanan, J. Hasan, F. Duchene, FlowBender: flow-level adaptive routing for improved latency and throughput in datacenter networks, in ACM CoNEXT, 2014, pp. 149–160
71.
N. Katta, A. Ghag, M. Hira, I. Keslassy, A. Bergman, C. Kim, J. Rexford, CLOVE: congestion-aware load balancing at the virtual edge, in ACM CoNEXT, 2017, pp. 323–335
72.
M. Alizadeh, T. Edsall, S. Dharmapurikar, R. Vaidyanathan, K. Chu, A. Fingerhut, G. Varghese, CONGA: distributed congestion-aware load balancing for datacenters, in ACM SIGCOMM, 2014, pp. 503–514
73.
N. Katta, M. Hira, C. Kim, A. Sivaraman, J. Rexford, HULA: scalable load balancing using programmable data planes, in ACM SOSR, 2016, pp. 1–12
74.
W. Wang, Y. Sun, K. Zheng, M.A. Kaafar, D. Li, Z. Li, Freeway: adaptively isolating the elephant and mice flows on different transmission paths, in IEEE ICNP, 2014, pp. 362–367
75.
D. Zats, T. Das, P. Mohan, D. Borthakur, R. Katz, DeTail: reducing the flow completion time tail in datacenter networks, in ACM SIGCOMM, 2012, pp. 139–150
76.
S. Ghorbani, Z. Yang, P.B. Godfrey, Y. Ganjali, A. Firoozshahian, Drill: micro load balancing for low-latency data center networks, in ACM SIGCOMM, 2017, pp. 225–238
77.
C.E. Hopps, Multipath issues in unicast and multicast next-hop selection, RFC 2991 (2000)
78.
C. Raiciu, S. Barre, C. Pluntke, A. Greenhalgh, D. Wischik, M. Handley, Improving datacenter performance and robustness with multipath TCP, in ACM SIGCOMM, 2011, pp. 266–277
79.
J. Cao, R. Xia, P. Yang, C. Guo, G. Lu, L. Yuan, Y. Zheng, H. Wu, Y. Xiong, D. Maltz, Per-packet load-balanced, low-latency routing for clos-based data center networks, in ACM CoNEXT, 2013, pp. 49–60
80.
C. Kim, A. Sivaraman, N. Katta, A. Bas, A. Dixit, L.J. Wobkeret, In-band network telemetry via programmable dataplanes, in ACM SIGCOMM, 2015
81.
H. Zhang, L. Chen, B. Yi, K. Chen, M. Chowdhury, Y. Geng, CODA: toward automatically identifying and scheduling coflows in the dark, in ACM SIGCOMM, 2016, pp. 160–173
82.
F. Ruffy, M. Przystupa, I. Beschastnikh, Iroko: a framework to prototype reinforcement learning for data center traffic control, in NIPS, 2018
83.
P. Patel, D. Bansal, L. Yuan, A. Murthy, A. Greenberg, D.A. Maltz, R. Kern, H. Kumar, M. Zikos, H. Wu, C. Kim, N. Karri, Ananta: cloud scale load balancing, in ACM SIGCOMM, 2013, pp. 207–218
84.
D.E. Eisenbud, C. Yi, C. Contavalli, C. Smith, R. Kononov, E. Mann-Hielscher, A. Cilingiroglu, B. Cheyney, W. Shang, J.D. Hosein, Maglev: a fast and reliable software network load balancer, in USENIX NSDI, 2016, pp. 523–535
85.
R. Gandhi, H.H. Liu, Y.C. Hu, G. Lu, J. Padhye, L. Yuan, M. Zhang, Duet: cloud scale load balancing with hardware and software, in ACM SIGCOMM, 2015, pp. 27–38
86.
R. Miao, H. Zeng, C. Kim, J. Lee, M. Yu, Silkroad: making stateful layer-4 load balancing fast and cheap using switching asics, in ACM SIGCOMM, 2017, pp. 15–28
87.
88.
89.
R. Gandhi, Y. C. Hu, M. Zhang, Yoda: a highly available layer-7 load balancer, in EuroSys, 2016, p. 21
90.
91.
B. Yu, J. Pan, A framework of hypergraph-based data placement among geo-distributed datacenters. IEEE Trans. Serv. Comput. 13(3), 395–409 (2020)CrossRef
92.
M. Annamalai, K. Ravichandran, H. Srinivas, I. Zinkovsky, L. Pan, T. Savor, D. Nagle, M. Stumm, Sharding the shards: managing datastore locality at scale with Akkio, in USENIX OSDI, 2018, pp. 445–460
93.
K. Liu, J. Wang, Z. Liao, B. Yu, J. Pan, Learning-based adaptive data placement for low latency in data center networks, in IEEE LCN, 2018, pp. 142–149
94.
K.V. Rashmi, M. Chowdhury, J. Kosaian, I. Stoica, K. Ramchandran, EC-cache: load-balanced, low-latency cluster caching with online erasure coding, in USENIX OSDI, 2016, pp. 401–417
95.
Y. Hu, Y. Wang, B. Liu, D. Niu, C. Huang, Latency reduction and load balancing in coded storage systems, in ACM SoCC, 2017, pp. 365–377
96.
97.
98.
99.
B. Snyder, J. Ringenberg, R. Green, V. Devabhaktuni, M. Alam, Evaluation and design of highly reliable and highly utilized cloud computing systems. J Cloud Comput. 4(1), 1–16 (2015)CrossRef
100.
Metadaten
Titel
Data Center Architecture, Operation, and Optimization
verfasst von
Kaiyang Liu
Aqun Zhao
Jianping Pan
Copyright-Jahr
2021
Buch
Future Networks, Services and Management

Print ISBN: 978-3-030-81960-6

Electronic ISBN: 978-3-030-81961-3

Copyright-Jahr: 2021

DOI
https://doi.org/10.1007/978-3-030-81961-3_6

Neuer Inhalt

    Bildnachweise