skip to main content
10.1145/1015467.1015480acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
Article
Free Access

The feasibility of supporting large-scale live streaming applications with dynamic application end-points

Published:30 August 2004Publication History

ABSTRACT

While application end-point architectures have proven to be viable solutions for large-scale distributed applications such as distributed computing and file-sharing, there is little known about its feasibility for more bandwidth-demanding applications such as live streaming. Heterogeneity in bandwidth resources and dynamic group membership, inherent properties of application end-points, may adversely affect the construction of a usable and efficient overlay. At large scales, the problems become even more challenging. In this paper, we study one of the most prominent architectural issues in overlay multicast: the feasibility of supporting large-scale groups using an application end-point architecture. We look at three key requirements for feasibility: (i) are there enough resources to construct an overlay, (ii) can a stable and connected overlay be maintained in the presence of group dynamics, and (iii) can an efficient overlay be constructed? Using traces from a large content delivery network, we characterize the behavior of users watching live audio and video streams. We show that in many common real-world scenarios, all three requirements are satisfied. In addition, we evaluate the performance of several design alternatives and show that simple algorithms have the potential to meet these requirements in practice. Overall, our results argue for the feasibility of supporting large-scale live streaming using an application end-point architecture.

References

  1. Akamai. http://www.akamai.com/.]]Google ScholarGoogle Scholar
  2. S. Banerjee, B. Bhattacharjee, and C. Kommareddy. Scalable Application Layer Multicast. In Proceedings of ACM SIGCOMM, August 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, Oxford, 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Castro, P. Druschel, A. Kermarrec, A. Nandi, A. Rowstron, and A. Singh. SplitStream: High-bandwidth Content Distribution in Cooperative Environments. In Proceedings of SOSP, 2003.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Castro, P. Druschel, A. Kermarrec, and A. Rowstron. Scribe: A Large-Scale and Decentralized Application-Level Multicast Infrastructure. In IEEE Journal on Selected Areas in Communications Vol. 20 No. 8, Oct 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Y. Chu, J. Chuang, and H. Zhang. A Case for Taxation in Peer-to-Peer Streaming Broadcast. In ACM SIGCOMM Workshop on Practice and Theory of Incentives and Game Theory in Networked Systems (PINS), 2004.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Y. Chu, A. Ganjam, T. S. E. Ng, S. G. Rao, K. Sripanidkulchai, J. Zhan, and H. Zhang. Early Experience with an Internet Broadcast System Based on Overlay Multicast. In Proceedings of USENIX, 2004.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Y. Chu, S. G. Rao, and H. Zhang. A Case for End System Multicast. In Proceedings of ACM Sigmetrics, June 2000.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. P. Francis. Yoid: Your Own Internet Distribution, http://www.aciri.org/yoid/. April 2000.]]Google ScholarGoogle Scholar
  10. A. Ganjam and H. Zhang. Connectivity Restrictions in Overlay Multicast. In Proceedings of NOSSDAV, 2004.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. V. K. Goyal. Multiple Description Coding: Compression Meets the Network. IEEE Signal Processing Magazine, Vol. 18, pages 74--93, 2001.]]Google ScholarGoogle ScholarCross RefCross Ref
  12. J. Jannotti, D. Gifford, K. L. Johnson, M. F. Kaashoek, and J. W. O'Toole Jr. Overcast: Reliable Multicasting with an Overlay Network. In Proceedings of the Fourth Symposium on Operating System Design and Implementation (OSDI), October 2000.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. Kostic, A. Rodriguez, J. Albrecht, and A. Vahdat. Bullet: High Bandwidth Data Dissemination Using an Overlay Mesh. In Proceedings of SOSP, 2003.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. J. Liebeherr and M. Nahas. Application-layer Multicast with Delaunay Triangulations. In Proceedings of IEEE Globecom, November 2001.]]Google ScholarGoogle ScholarCross RefCross Ref
  15. S. McCanne, V. Jacobson, and M. Vetterli. Receiver-driven layered multicast. In Proceedings of ACM SIGCOMM, August 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. S. E. Ng and H. Zhang. Predicting Internet Network Distance with Coordinates-Based Approaches. In Proceedings of INFOCOM, June 2002.]]Google ScholarGoogle ScholarCross RefCross Ref
  17. T.S.E. Ng, Y. Chu, S.G. Rao, K. Sripanidkulchai, and H. Zhang. Measurement-Based Optimization Techniques for Bandwidth-Demanding Peer-to-Peer Systems. In Proceedings of IEEE Infocom, 2003.]]Google ScholarGoogle ScholarCross RefCross Ref
  18. V. N. Padmanabhan, H. J. Wang, P. A. Chou, and K. Sripanidkulchai. Distributing Streaming Media Content Using Cooperative Networking. In Proceedings of NOSSDAV, May 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Planetlab. http://www.planet-lab.org/.]]Google ScholarGoogle Scholar
  20. S. Ratnasamy, M. Handley, R. Karp, and S. Shenker. Application-level Multicast using Content-Addressable Networks. In Proceedings of NGC, 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Real broadcast network. http://www.real.com/.]]Google ScholarGoogle Scholar
  22. R. Renesse, Y. Minsky, and M. Hayden. A Gossip-Style Failure Detection Service. Technical Report TR98-1687, Cornell University Computer Science, 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. J. Rosenberg, J. Weinberger, C. Huitema, and R. Mahy. STUN -Simple Traversal of UDP Through Network Address Translators. IETF-Draft, December 2002.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. W. Wang, D. Helder, S. Jamin, and L. Zhang. Overlay Optimizations for End-host Multicast. In Proceedings of Fourth International Workshop on Networked Group Communication (NGC), October 2002.]]Google ScholarGoogle Scholar
  25. S. Q. Zhuang, B. Y. Zhao, J. D. Kubiatowicz, and A. D. Joseph. Bayeux: An Architecture for Scalable and Fault-Tolerant Wide-Area Data Dissemination. In Proceedings of NOSSDAV, April 2001.]] Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The feasibility of supporting large-scale live streaming applications with dynamic application end-points

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGCOMM '04: Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications
        August 2004
        402 pages
        ISBN:1581138628
        DOI:10.1145/1015467
        • cover image ACM SIGCOMM Computer Communication Review
          ACM SIGCOMM Computer Communication Review  Volume 34, Issue 4
          October 2004
          385 pages
          ISSN:0146-4833
          DOI:10.1145/1030194
          Issue’s Table of Contents

        Copyright © 2004 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 August 2004

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • Article

        Acceptance Rates

        Overall Acceptance Rate554of3,547submissions,16%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader