Petri Jokela
ABSTRACT
A large fraction of today's Internet applications are internally publish/subscribe in nature; the current architecture makes it cumbersome and inept to support them. In essence, supporting efficient publish/subscribe requires data-oriented naming, efficient multicast, and in-network caching. Deployment of native IP-based multicast has failed, and overlay-based multicast systems are inherently inefficient. We surmise that scalable and efficient publish/subscribe will require substantial architectural changes, such as moving from endpoint-oriented systems to information-centric architectures.
In this paper, we propose a novel multicast forwarding fabric, suitable for large-scale topic-based publish/subscribe. Due to very simple forwarding decisions and small forwarding tables, the fabric may be more energy efficient than the currently used ones. To understand the limitations and potential, we provide efficiency and scalability analysis via simulations and early measurements from our two implementations. We show that the system scales up to metropolitan WAN sizes, and we discuss how to interconnect separate networks.
- Rocketfuel ISP topology data. http://www.cs.washington.edu/research/networking/rocketfuel/maps/weights-dist.tar.gz.Google Scholar
- B. Ahlgren, L. Eggert, A. Feldmann, A. Gurtov, and T. R. Henderson. Naming and addressing for next-generation internetworks. Technical report, Dagstuhl, 2007.Google Scholar
- M. Balakrishnan, K. Birman, A. Phanishayee, and S. Pleisch. Ricochet: Lateral Error Correction for Time-Critical Multicast. In NSDI' 07, 2007. Google ScholarDigital Library
- B. Bhargava, E. Mafla, and J. Riedl. Communication in the Raid distributed database system. Comput. Netw. ISDN Syst., 1991. Google ScholarDigital Library
- K. Birman, M. Balakrishnan, D. Dolev, T. Marian, K. Ostrowski, and A. Phanishayee. Scalable Multicast Platforms for a New Generation of Robust Distributed Applications. In COMSWARE' 07, 2007.Google ScholarCross Ref
- B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Commun. ACM, 1970. Google ScholarDigital Library
- R. Boivie, N. Feldman, Y. Imai, W. Livens, and D. Ooms. Explicit multicast (Xcast) concepts and options. IETF RFC 5058, 2007.Google Scholar
- R. Briscoe. The implications of pervasive computing on network design. BT Technology Journal, 22(3):170--190, 2004. Google ScholarDigital Library
- A. Z. Broder and M. Mitzenmacher. Survey: Network applications of Bloom filters: A survey. Internet Mathematics, 2004.Google ScholarCross Ref
- K. L. Calvert, J. Griffioen, and L. Poutievski. Separating Routing and Forwarding: A Clean--Slate Network Layer Design. In In proc. of the Broadnets Conf., 2007.Google Scholar
- M. Cha, P. Rodriguez, S. Moon, and J. Crowcroft. On next-generation telco-managed P2P TV architectures. In IPTPS '08, 2008. Google ScholarDigital Library
- J. Day. Patterns in Network Architecture: A Return to Fundamentals. Prentice Hall, 2008. Google ScholarDigital Library
- S. E. Deering and D. Cheriton. Multicast routing in datagram internetworks and extended LANs. ACM Trans. on Comp. Syst., 1990. Google ScholarDigital Library
- F. Dogar, A. Phanishayee, H. Pucha, O. Ruwase, and D. Andersen. Ditto -- A System for Opportunistic Caching in Multi-hop Wireless Mesh Networks. In ACM Mobicom, 2008. Google ScholarDigital Library
- P. T. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec. The many faces of publish/subscribe. ACM Comput. Surv., 2003. Google ScholarDigital Library
- P. Faratin, D. Clark, P. Gilmore, S. Bauer, A. Berger, and W. Lehr. Complexity of Internet interconnections: Technology, incentives and implications for policy. In TPRC' 07, 2007.Google Scholar
- P. Gill, M. Arlitt, Z. Li, and A. Mahanti. YouTube Traffic Characterization: A View From the Edge. In ACM SIGCOMM IMC'07., 2007. Google ScholarDigital Library
- A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In WWW '05, 2005. Google ScholarDigital Library
- H. Holbrook and B. Cain. Source-specific multicast for IP. RFC 4607. 2006.Google Scholar
- J.D.Touch and V.K.Pingali. The RNA metaprotocol. In ICCCN '08, 2008.Google ScholarCross Ref
- Z. Jerzak and C. Fetzer. Bloom filter based routing for content-based publish/subscribe. In DEBS '08, 2008. Google ScholarDigital Library
- H. T. Kaur, S. Kalyanaraman, A. Weiss, S. Kanwar, and A. Gandhi. Bananas: an evolutionary framework for explicit and multipath routing in the internet. SIGCOMM Comput. Commun. Rev., 2003. Google ScholarDigital Library
- T. Koponen, M. Chawla, B.-G. Chun, A. Ermolinskiy, K. H. Kim, S. Shenker, and I. Stoica. A data-oriented (and beyond) network architecture. In SIGCOMM '07, 2007. Google ScholarDigital Library
- H. Liu, V. Ramasubramanian, and E. G. Sirer. Client behavior and feed characteristics of RSS, a publish--subscribe system for web micronews. In IMC'05, 2005. Google ScholarDigital Library
- J. W. Lockwood, N. McKeown, G. Watson, G. Gibb, P. Hartke, J. Naous, R. Raghuraman, and J. Luo. NetFPGA-an open platform for gigabit-rate network switching and routing. In MSE '07, 2007. Google ScholarDigital Library
- E. Mannie. Generalized Multi-Protocol Label Switching (GMPLS) Architecture. RFC 3945, 2004.Google Scholar
- A. Markopoulou, G. Iannaccone, S. Bhattacharyya, C. Chuah, and C. Diot. Characterization of failures in an IP backbone. In INFOCOM 2004, 2004.Google ScholarCross Ref
- S. Orlowski, M. Pióro, A. Tomaszewski, and R. Wessäly. SNDlib 1.0-Survivable Network Design Library. In INOC' 07, 2007.Google Scholar
- L. B. Poutievski, K. L. Calvert, and J. N. Griffioen. Routing and forwarding with flexible addressing. Journal Of Communication and Networks, 2007.Google ScholarCross Ref
- J. Rajahalme, M. Särelä, P. Nikander, and S. Tarkoma. Incentive-compatible caching and peering in data-oriented networks. In ReArch'08, 2008. Google ScholarDigital Library
- S. Ratnasamy, A. Ermolinskiy, and S. Shenker. Revisiting IP multicast. In SIGCOMM'06, 2006. Google ScholarDigital Library
- M. Särelä, T. Rintaho, and S. Tarkoma. RTFM: Publish/subscribe internetworking architecture. ICT Mobile Summit, 2008.Google Scholar
- J. Scott, J. Crowcroft, P. Hui, and C. Diot. Haggle: a networking architecture designed around mobile users. In Annual IFIP Conference on Wireless On-demand Network Systems and Services, 2006.Google Scholar
- A. Sharma, A. Bestavros, and I. Matta. dPAM: a distributed prefetching protocol for scalable asynchronous multicast in P2P systems. In INFOCOM' 05, 2005.Google ScholarCross Ref
- R. Sherwood, A. Bender, and N. Spring. Discarte: a disjunctive Internet cartographer. SIGCOMM Comput. Commun. Rev., 2008. Google ScholarDigital Library
- I. Stoica, D. Adkins, S. Zhuang, S. Shenker, and S. Surana. Internet indirection infrastructure. In SIGCOMM'02, 2002. Google ScholarDigital Library
- C. A. Sunshine. Source routing in computer networks. SIGCOMM Comput. Commun. Rev., 1977. Google ScholarDigital Library
- M. Szeredi. Filesystem in Userspace. Located at http://fuse. sourceforge. net.Google Scholar
- S. Tarkoma, D. Trossen, and M. Särelä. Black boxed rendezvous based networking. In MobiArch '08, 2008.Google Scholar
- N. Tolia, M. Kozuch, M. Satyanarayanan, B. Karp, and T. Bressoud. Opportunistic use of content addressable storage for distributed file systems. In USENIX' 03, 2003.Google Scholar
- D. Trossen (edit.). Architecture definition, component descriptions, and requirements. Deliverable D2.3, PSIRP project, 2009.Google Scholar
- Y. Vigfusson, H. Abu-Libdeh, M. Balakrishnan, K. Birman, and Y. Tock. Dr. multicast: Rx for datacenter communication scalability. In HotNets-VII, 2008.Google Scholar
- A. Whitaker and D. Wetherall. Forwarding without loops in Icarus. In Proc. of OPENARCH, 2002.Google ScholarCross Ref
- T. Wolf. A credential-based data path architecture for assurable global networking. In IEEE MILCOM, 2007.Google ScholarCross Ref
- A. Zahemszky, A. Csaszar, P. Nikander, and C. Esteve. Exploring the pubsub routing/forwarding space. In International Workshop on the Network of the Future, 2009.Google Scholar
Index Terms
- LIPSIN: line speed publish/subscribe inter-networking
Recommendations
LIPSIN: line speed publish/subscribe inter-networking
SIGCOMM '09A large fraction of today's Internet applications are internally publish/subscribe in nature; the current architecture makes it cumbersome and inept to support them. In essence, supporting efficient publish/subscribe requires data-oriented naming, ...
RACCOOM: A Rate-Based Congestion Control Approach for Multicast
Abstract--As multicast applications have become widely deployed on the Internet, it is increasingly important to ensure these applications respond to network congestion in a TCP-friendly manner so as to coexist with TCP connections (which constitute the ...
MEB: an Efficient and Accurate Multicast using Bloom Filter with Customized Hash Function
APNET '23: Proceedings of the 7th Asia-Pacific Workshop on NetworkingMulticast is widely used to support a huge range of applications with one-to-many or many-to-many communication patterns. However, multicast systems do not scale due to considerable state and communication overheads. Some stateful multicast approaches ...
Comments