skip to main content
research-article

A Practical Architecture for an Anycast CDN

Published:01 October 2011Publication History
Skip Abstract Section

Abstract

IP Anycast has many attractive features for any service that involve the replication of multiple instances across the Internet. IP Anycast allows multiple instances of the same service to be “naturally” discovered, and requests for this service to be delivered to the closest instance. However, while briefly considered as an enabler for content delivery networks (CDNs) when they first emerged, IP Anycast was deemed infeasible in that environment. The main reasons for this decision were the lack of load awareness of IP Anycast and unwanted side effects of Internet routing changes on the IP Anycast mechanism.

In this article we re-evaluate IP Anycast for CDNs by proposing a load-aware IP Anycast CDN architecture. Our architecture is prompted by recent developments in route control technology, as well as better understanding of the behavior of IP Anycast in operational settings. Our architecture makes use of route control mechanisms to take server and network load into account to realize load-aware Anycast. We show that the resulting redirection requirements can be formulated as a Generalized Assignment Problem and present practical algorithms that address these requirements while at the same time limiting connection disruptions that plague regular IP Anycast. We evaluate our algorithms through trace based simulation using traces obtained from a production CDN network.

References

  1. <scp>3-DNS Controller</scp>. 2005. F5 Networks. http://support.f5.com/kb/en-us/archived_products/3-dns/.Google ScholarGoogle Scholar
  2. <scp>Acharya, A. and Shaikh, A.</scp> 2002. Using mobility support for request routing in IPv6 CDNs. In Proceedings of the 7th International Web Content Caching and Distribution Workshop (WCW).Google ScholarGoogle Scholar
  3. <scp>Aggarwal, G., Motwani, R., and Zhu, A.</scp> 2003. The load rebalancing problem. In Proceedings of the 15th Annual ACM Symposium on Parallel Algorithms and Architectures (SPAA’03). ACM, New York, 258--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. <scp>Al-Qudah, Z., Lee, S., Rabinovich, M., Spatscheck, O., and Van der Merwe, J. E.</scp> 2009. Anycast-aware transport for content delivery networks. In Proceedings of the International Conference on the World-Wide Web (WWW). 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. <scp>ATT ICDS</scp>. 2010. Intelligent content distribution service. http://www.business.att.com/enterprise/Service/digital-media-solutions-enterprise/content-distribution-enterprise/content-distribution-service-enterprise/state=Ohio/.Google ScholarGoogle Scholar
  6. <scp>Ballani, H., Francis, P., and Ratnasamy, S.</scp> 2006. A measurement-based deployment proposal for IP anycast. In Proceedings of the ACM/USENIX Internet Measurements Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. <scp>Barbir, A., Cain, B., Douglis, F., Green, M., Hofmann, M., Nair, R., Potter, D., and Spatscheck, O.</scp> 2003. Known content network (CN) request-routing mechanisms. RFC 3568.Google ScholarGoogle Scholar
  8. <scp>Biliris, A., Cranor, C., Douglis, F., Rabinovich, M., Sibal, S., Spatscheck, O., and Sturm, W.</scp> 2001. CDN brokering. In Proceedings of the 6th International Workshop on Web Caching and Content Distribution.Google ScholarGoogle Scholar
  9. <scp>CacheFly.</scp> CacheFly: Besthop global traffic management. http://www.cachefly.com/video.html.Google ScholarGoogle Scholar
  10. <scp>Cardellini, V., Colajanni, M., and Yu, P. S.</scp> 2003. Request redirection algorithms for distributed web systems. IEEE Trans. Parall. Distrib. Syst. 14, 4, 355--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. <scp>Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y., and Moon, S.</scp> 2007. I tube, you tube, everybody tubes: Analyzing the world’s largest user generated content video system. In Proceedings of the ACM/USENIX Internet Measurement Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. <scp>Chekuri, C. and Khanna, S.</scp> 2000. A PTAS for the multiple knapsack problem. In Proceedings of the 11th Annual ACM-SIAM Symposium on Discrete Algorithms (SODA’00). ACM, 213--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. <scp>Cisco</scp>. 2009. Cisco GSS 4400 series global site selector appliances. http://www.cisco.com/en/US/products/hw/contnetw/ps4162/index.html.Google ScholarGoogle Scholar
  14. <scp>Colajanni, M., Yu, P. S., and Cardellini, V.</scp> 1998. Dynamic load balancing in geographically distributed heterogeneous web servers. In Proceedings of the IEEE International Conference on Device Circuit and Systems (ICDCS). 295--302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. <scp>Duffield, N., Gopalan, K., Hines, M. R., Shaikh, A., and Van der Merwe, J. E.</scp> 2007. Measurement informed route selection. In Proceedings of the Passive and Active Measurement Conference. Extended abstract. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. <scp>Freedman, M. J., Freudenthal, E., and Mazières, D.</scp> 2004. Democratizing content publication with coral. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI). 239--252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. <scp>Hardie, T.</scp> 2002. Distributing authoritative name servers via shared unicast addresses. IETF RFC 3258.Google ScholarGoogle Scholar
  18. <scp>Iyer, S., Rowstron, A., and Druschel, P.</scp> 2002. Squirrel: A decentralized peer-to-peer web cache. In Proceedings of the ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC). 213--222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. <scp>Jung, J., Krishnamurthy, B., and Rabinovich, M.</scp> 2002. Flash crowds and denial of service attacks: Characterization and implications for CDNs and web sites. In Proceedings of 11th World Wide Web Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. <scp>King, A.</scp> 2006. The Average web page. http://www.optimizationweek.com/reviews/average-web-page/.Google ScholarGoogle Scholar
  21. <scp>Kwan, T. T., McCrath, R., and Reed, D. A.</scp> 1995. NCSA’s world wide web server: Design and performance. IEEE Comput. 28, 11, 68--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. <scp>Limelight</scp>. 2010. http://www.limelightnetworks.com/platform/cdn/.Google ScholarGoogle Scholar
  23. <scp>Mao, Z., Cranor, C., Douglis, F., Rabinovich, M., Spatscheck, O., and Wang, J.</scp> 2002. A precise and efficient evaluation of the proximity between web clients and their local DNS servers. In Proceedings of the USENIX Annual Technical Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. <scp>Pang, J., Akella, A., Shaikh, A., Krishnamurthy, B., and Seshan, S.</scp> 2004. On the Responsiveness of DNS-based network control. In Proceedings of the Internet Measurement Conference (IMC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. <scp>Rabinovich, M., Xiao, Z., and Aggarwal, A.</scp> 2003. Computing on the edge: A platform for replicating Internet applications. In Proceedings of the 8th International Workshop on Web Content Caching and Distribution.Google ScholarGoogle Scholar
  26. <scp>Reibman, A., Sen, S., and Van der Merwe, J.</scp> 2004. Network monitoring for video quality over IP. In Proceedings of the Picture Coding Symposium.Google ScholarGoogle Scholar
  27. <scp>ServerIron</scp>. 2008. ServerIron DNSProxy. Fountry networks. http://www.brocade.com/products/all/switches/index.page.Google ScholarGoogle Scholar
  28. <scp>Shaikh, A., Tewari, R., and Agrawal, M.</scp> 2001. On the effectiveness of DNS-based server selection. In Proceedings of the IEEE Annual Conference on Computer Communications (INFOCOM). 1801--1810.Google ScholarGoogle Scholar
  29. <scp>Shmoys, D. and Tardos, E.</scp> 1993. An approximation algorithm for the generalized assignment problem. Math. Prog. 62, 461--474.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. <scp>Shmoys, D. B., Tardos, E., and Aardal, K.</scp> 1997. Approximation algorithms for facility location problems (extended abstract). In Proceedings of the 29th Annual ACM Symposium on Theory of Computing (STOC’97). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. <scp>Stutzbach, D., Zappala, D., and Rejaie, R.</scp> 2005. The scalability of swarming peer-to-peer content delivery. In Proceedings of Networking. 15--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. <scp>Szymaniak, M., Pierre, G., Simons-Nikolova, M., and van Steen, M.</scp> 2007. Enabling service adaptability with versatile anycast. Concurr. Computat. Practice Exp. 19, 13, 1837--1863. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. <scp>Van der Merwe, J., Sen, S., and Kalmanek, C.</scp> 2002. Streaming video traffic: Characterization and network impact. In Proceedings of the 7th International Workshop on Web Content Caching and Distribution (WCW).Google ScholarGoogle Scholar
  34. <scp>Van der Merwe, J., Gausman, P., Cranor, C., and Akhmarov, R.</scp> 2003. Design, implementation and operation of a large enterprise content distribution network. In Proceedings of the 8th International Workshop on Web Content Caching and Distribution.Google ScholarGoogle Scholar
  35. <scp>Van der Merwe, J., Cepleanu, A., D’Souza, K., Freeman, B., Greenberg, A., Knight, D., McMillan, R., Moloney, D., Mulligan, J., Nguyen, H., Nguyen, M., Ramarajan, A., Saad, S., Satterlee, M., Spencer, T., Toll, D., and Zelingher, S.</scp> 2006. Dynamic connectivity management with an intelligent route service control point. In Proceedings of the SIGCOMM Workshop on Internet Network Management (INM’06). ACM, New York, 29--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. <scp>Verkaik, P., Pei, D., Scholl, T., Shaikh, A., Snoeren, A., and Van der Merwe, J.</scp> 2007. Wresting control from BGP: Scalable fine-grained route control. In Proceedings of the USENIX Annual Technical Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A Practical Architecture for an Anycast CDN

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on the Web
          ACM Transactions on the Web  Volume 5, Issue 4
          October 2011
          154 pages
          ISSN:1559-1131
          EISSN:1559-114X
          DOI:10.1145/2019643
          Issue’s Table of Contents

          Copyright © 2011 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 1 October 2011
          • Accepted: 1 September 2010
          • Revised: 1 April 2010
          • Received: 1 October 2009
          Published in tweb Volume 5, Issue 4

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader