Ashok Anand
Abstract
Application-independent Redundancy Elimination (RE), or identifying and removing repeated content from network transfers, has been used with great success for improving network performance on enterprise access links. Recently, there is growing interest for supporting RE as a network-wide service. Such a network-wide RE service benefits ISPs by reducing link loads and increasing the effective network capacity to better accommodate the increasing number of bandwidth-intensive applications. Further, a networkwide RE service democratizes the benefits of RE to all end-to-end traffic and improves application performance by increasing throughput and reducing latencies.
While the vision of a network-wide RE service is appealing, realizing it in practice is challenging. In particular, extending single vantage-point RE solutions designed for enterprise access links to the network-wide case is inefficient and/or requires modifying routing policies. We present SmartRE, a practical and efficient architecture for network-wide RE. We show that SmartRE can enable more effective utilization of the available resources at network devices, and thus can magnify the overall benefits of network-wide RE. We prototype our algorithms using Click and test our framework extensively using several real and synthetic traces.
- Akamai Technologies. http://www.akamai.com.Google Scholar
- BlueCoat: WAN Optimization. http://www.bluecoat.com/.Google Scholar
- Cisco Content Aware Networks -- Some Areas of Interest. http://www.cisco.com/web/about/ac50/ac207/crc_new/ciscoarea/content.html.Google Scholar
- Cisco Wide Area Application Acceleration Services. http://www.cisco.com/en/US/products/ps5680/Products_Sub_Category_Home.html.Google Scholar
- Citrix, application delivery infrastructure. http://www.citrix.com/.Google Scholar
- Computerworld -- WAN optimization continues growth. www.computerworld.com.au/index.php/id;1174462047;fp;16;fpid;0/.Google Scholar
- PeerApp: P2P and Media Caching. http://www.peerapp.com.Google Scholar
- Riverbed Networks: WAN Optimization. http://www.riverbed.com/solutions/optimize/.Google Scholar
- WAN optimization revenues grow 16% -- IT Facts. www.itfacts.biz/wan-optimization-market-to-grow-16/1205/.Google Scholar
- A. Anand and C. Muthukrishnan and A. Akella and R. Ramachandran. Redundancy in Network Traffic: Findings and Implications. In Proc. of SIGMETRICS, 2009. Google ScholarDigital Library
- A. Muthitacharoen, B. Chen, and D. Mazieres. A low-bandwidth network file system. In Proc. of SOSP, 2001. Google ScholarDigital Library
- A. Anand, A. Gupta, A. Akella, S. Seshan, and S. Shenker. Packet Caches on Routers: The Implications of Universal Redundant Traffic Elimination. In Proc. of SIGCOMM, 2008. Google ScholarDigital Library
- H. Ballani and P. Francis. CONMan: A Step Towards Network Manageability. In Proc. of SIGCOMM, 2007. Google ScholarDigital Library
- A. Bavier, N. Feamster, M. Huang, L. Peterson, and J. Rexford. In vini veritas: realistic and controlled network experimentation. In Proc. of SIGCOMM, 2006. Google ScholarDigital Library
- M. Caesar, D. Caldwell, N. Feamster, J. Rexford, A. Shaikh, and J. van der Merwe. Design and implementation of a Routing Control Platform. In Proc. of NSDI, 2005. Google ScholarDigital Library
- F. Dogar, A. Phanishayee, H. Pucha, O. Ruwase, and D. Andersen. Ditto -- A System for Opportunistic Caching in Multi-hop Wireless Mesh Networks. In Proc. of Mobicom, 2008. Google ScholarDigital Library
- N. Duffield and M. Grossglauser. Trajectory Sampling for Direct Traffic Observation. In Proc. of SIGCOMM, 2001. Google ScholarDigital Library
- A. Greenberg, et al. A Clean Slate 4D Approach to Network Control and Management. CCR, 35(5), Oct. 2005. Google ScholarDigital Library
- J. C. Mogul, Y. M. Chan, and T. Kelly. Design, implementation, and evaluation of duplicate transfer detection in HTTP . In Proc. of NSDI, 2004. Google ScholarDigital Library
- J. W. Lockwood et al. NetFPGA -- An Open Platform for Gigabit-rate Network Switching and Routing . In Proc. IEEE MSE, 2007. Google ScholarDigital Library
- R. Morris, E. Kohler, J. Jannotti, and M. F. Kaashoek. The click modular router. SIGOPS Oper. Syst. Rev., 33(5):217--231, 1999. Google ScholarDigital Library
- K. Park, S. Ihm, M. Bowman, and V. Pai. Supporting practical content-addressable caching with CZIP compression. In Proc. of USENIX ATC, 2007. Google ScholarDigital Library
- H. Pucha, D. G. Andersen, and M. Kaminsky. Exploiting similarity for multi-source downloads using file handprints. In Proc. of NSDI, 2007. Google ScholarDigital Library
- M. Rabin. Fingerprinting by random polynomials. Technical report, Harvard University, 1981. Technical Report, TR-15-81.Google Scholar
- M. Roughan et al. Experience in Measuring Internet Backbone Traffic Variability:Models, Metrics, Measurements and Meaning. In ITC, 2003.Google Scholar
- S. Rhea, K. Liang, and E. Brewer. Value-based web caching. In Proc. of WWW, 2003. Google ScholarDigital Library
- A. Shaikh and A. Greenberg. OSPF Monitoring: Architecture, Design and Deployment Experience. In Proc. of NSDI, 2004. Google ScholarDigital Library
- N. Spring, R. Mahajan, and D. Wetherall. Measuring ISP Topologies with Rocketfuel. In Proc. of SIGCOMM, 2002. Google ScholarDigital Library
- N. Spring and D. Wetherall. A protocol-independent technique for eliminating redundant network traffic. In Proc. of SIGCOMM, 2000. Google ScholarDigital Library
- N. Tolia, M. Kaminsky, D. G. Andersen, and S. Patil. An architecture for internet data transfer. In Proc. of NSDI, 2006. Google ScholarDigital Library
- V. Sekar et al. cSamp: A System for Network--Wide Flow Monitoring. In Proc. of NSDI, 2008. Google ScholarDigital Library
- A. Wolman et al. On the scale and performance of cooperative Web proxy caching. In Proc. of SOSP, 1999. Google ScholarDigital Library
Index Terms
- SmartRE: an architecture for coordinated network-wide redundancy elimination
Recommendations
SmartRE: an architecture for coordinated network-wide redundancy elimination
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communicationApplication-independent Redundancy Elimination (RE), or identifying and removing repeated content from network transfers, has been used with great success for improving network performance on enterprise access links. Recently, there is growing interest ...
Intra-AS cooperative caching for content-centric networks
ICN '13: Proceedings of the 3rd ACM SIGCOMM workshop on Information-centric networkingThe default caching scheme in CCN results in a high redundancy along the symmetric request-response path, and makes the caching system inefficient. Since it was first proposed, much work has been done to improve the general caching performance of CCN. ...
Comparison of caching strategies in modern cellular backhaul networks
MobiSys '13: Proceeding of the 11th annual international conference on Mobile systems, applications, and servicesRecent popularity of smartphones drives rapid growth in the demand for cellular network bandwidth. Unfortunately, due to the centralized architecture of cellular networks, increasing the physical backhaul bandwidth is challenging. While content caching ...
Comments