Howard Wang
Abstract
Not only do big data applications impose heavy bandwidth demands, they also have diverse communication patterns denoted as *-cast) that mix together unicast, multicast, incast, and all-to-all-cast. Effectively supporting such traffic demands remains an open problem in data center networking. We propose an unconventional approach that leverages physical layer photonic technologies to build custom communication devices for accelerating each *-cast pattern, and integrates such devices into an application-driven, dynamically configurable photonics accelerated data center network. We present preliminary results from a multicast case study to highlight the potential benefits of this approach.
- JGroups - A Toolkit for Reliable Multicast Communication, http://www.jgroups.org/.Google Scholar
- M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In SIGCOMM '08, page 63, New York, New York, USA, 2008. Google ScholarDigital Library
- E. M. Arkin and R. Hassin. On Local Search for Weighted k-Set Packing. Mathematics of Operations Research, 23(3):640--648, Aug. 1998. Google ScholarCross Ref
- A. Borodin. CSC2420 - Fall 2010 - Lecture 5, www.cs.toronto.edu/\ bor/2420f10/L5.pdf, 2010.Google Scholar
- B. Chandra and M. M. Halldórsson. Greedy Local Improvement and Weighted Set Packing Approximation. Journal of Algorithms, 39(2):223--240, May 2001. Google ScholarDigital Library
- K. Chen, A. Singla, A. Singh, K. Ramachandran, L. Xu, Y. Zhang, X. Wen, and Y. Chen. OSA: An Optical Switching Architecture for Data Center Networks with Unprecedented Flexibility. In NSDI '12, San Joes, CA, USA, April 2012. Google ScholarDigital Library
- M. Chowdhury and I. Stoica. Coflow: A Networking Abstraction for Cluster Applications. In Hotnets 12, pages 31--36, Seattle, WA, USA, Oct. 2012. Google ScholarDigital Library
- M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica. Managing Data Transfers in Computer Clusters with Orchestra. In SIGCOMM '11, pages 98--109, Toronto, Canada, Aug. 2011. Google ScholarDigital Library
- J. Edmonds. Paths, trees, and flowers. Canadian Journal of Mathematics, 17:449--467, Jan. 1965.Google ScholarCross Ref
- N. Farrington, G. Porter, Y. Fainman, G. Papen, and A. Vahdat. Hunting Mice with Microsecond Circuit Switches. In ACM HotNets, Redmond, WA, USA, oct 2012. Google ScholarDigital Library
- N. Farrington, G. Porter, S. Radhakrishnan, H. H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat. Helios: A Hybrid Electrical/Optical Switch Architecture for Modular Data Centers. In SIGCOMM '10, page 339, New Delhi, India, Aug. 2010. Google ScholarDigital Library
- A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. VL2: A Scalable and Flexible Data Center Network. In SIGCOMM '09, page 51, New York, New York, USA, 2009. Google ScholarDigital Library
- C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: A High Performance, Server-centric Network Architecture for Modular Data Centers. In SIGCOMM '09, page 63, New York, New York, USA, 2009. Google ScholarDigital Library
- C. Guo, Y. Xiong, and Y. Zhang. Datacast: A Scalable and Efficient Group Data Delivery Service for Data Centers. In ACM CoNEXT 2012, Nice, France, Dec. 2011. Google ScholarDigital Library
- S. Kandula, S. Sengupta, A. Greenberg, P. Patel, and R. Chaiken. The Nature of Data Center Traffic: Measurements and Analysis. In IMC '09, pages 202--208, Chicago, Illinois, USA, Nov. 2009. Google ScholarDigital Library
- V. T. Paschos. A Survey of Approximately Optimal Solutions to Some Covering and Packing Problems. ACM Computing Surveys, 29(2):171--209, June 1997. Google ScholarDigital Library
- R. Ramaswami, K. Sivarajan, and G. H. Sasaki. Optical Networks: A Practical Perspective. Morgan Kaufmann, 3rd edition, 2009. Google ScholarDigital Library
- G. Rouskas. Optical layer multicast: rationale, building blocks, and challenges. Network, IEEE, 17(1):60--65, jan/feb 2003. Google ScholarDigital Library
- B. Stephens. Designing Scalable Networks for Future Large Datacenters. M.s. thesis, Rice University.Google Scholar
- G. Wang, D. G. Andersen, M. Kaminsky, K. Papagiannaki, T. S. E. Ng, M. Kozuch, and M. Ryan. c-Through: Part-time Optics in Data Centers. In SIGCOMM '10, page 327, New Delhi, India, Aug. 2010. Google ScholarDigital Library
- G. Wang, T. S. E. Ng, and A. Shaikh. Programming Your Network at Run-time for Big Data Applications. In HotSDN '12, pages 103--108, Helsinki, Finland, Aug. 2012. Google ScholarDigital Library
- H. Wang, C. Chen, K. Sripanidkulchai, S. Sahu, and K. Bergman. Dynamically Reconfigurable Photonic Resources for Optically Connected Data Center Networks. In Optical Fiber Communication Conference, page OTu1B.2, 2012.Google Scholar
Index Terms
- Rethinking the physical layer of data center networks of the next decade: using optics to enable efficient *-cast connectivity
Recommendations
Analysis for TCP in data center networks
The unfairness caused by bandwidth sharing via TCP in data center networks is called TCP Outcast problem. Some researchers show that the throughput of a flow with small Round Trip Time (RTT) is less than that with large RTT which is completely contrary ...
TCP incast solutions in data center networks: A classification and survey
AbstractIn recent years, Data Centers Networks (DCNs) have been deployed to serve as the backbone to support the extensive variety of services offered through the Internet like social networking, web hosting, and e-commerce. The Transmission ...
High-throughput multi-multicast transfers in data center networks
It is usual that the applications executed in data centers require the distribution of the same data from one node to others at various execution points and that some of them require to cope with multiple of these diffusions in parallel. Multicast-based ...
Comments