research-article

LIPSIN: line speed publish/subscribe inter-networking

Authors:

András Zahemszky,

Christian Esteve Rothenberg,

Somaya Arianfar,

Pekka NikanderAuthors Info & Claims

ACM SIGCOMM Computer Communication Review, Volume 39, Issue 4

Pages 195 - 206

https://doi.org/10.1145/1594977.1592592

Published: 16 August 2009 Publication History

Abstract

A large fraction of today's Internet applications are internally publish/subscribe in nature; the current architecture makes it cumbersome and inept to support them. In essence, supporting efficient publish/subscribe requires data-oriented naming, efficient multicast, and in-network caching. Deployment of native IP-based multicast has failed, and overlay-based multicast systems are inherently inefficient. We surmise that scalable and efficient publish/subscribe will require substantial architectural changes, such as moving from endpoint-oriented systems to information-centric architectures.

In this paper, we propose a novel multicast forwarding fabric, suitable for large-scale topic-based publish/subscribe. Due to very simple forwarding decisions and small forwarding tables, the fabric may be more energy efficient than the currently used ones. To understand the limitations and potential, we provide efficiency and scalability analysis via simulations and early measurements from our two implementations. We show that the system scales up to metropolitan WAN sizes, and we discuss how to interconnect separate networks.

References

[1]

Rocketfuel ISP topology data. http://www.cs.washington.edu/research/networking/rocketfuel/maps/weights-dist.tar.gz.

[2]

B. Ahlgren, L. Eggert, A. Feldmann, A. Gurtov, and T. R. Henderson. Naming and addressing for next-generation internetworks. Technical report, Dagstuhl, 2007.

[3]

M. Balakrishnan, K. Birman, A. Phanishayee, and S. Pleisch. Ricochet: Lateral Error Correction for Time-Critical Multicast. In NSDI' 07, 2007.

Digital Library

[4]

B. Bhargava, E. Mafla, and J. Riedl. Communication in the Raid distributed database system. Comput. Netw. ISDN Syst., 1991.

Digital Library

[5]

K. Birman, M. Balakrishnan, D. Dolev, T. Marian, K. Ostrowski, and A. Phanishayee. Scalable Multicast Platforms for a New Generation of Robust Distributed Applications. In COMSWARE' 07, 2007.

[6]

B. H. Bloom. Space/time trade-offs in hash coding with allowable errors. Commun. ACM, 1970.

Digital Library

[7]

R. Boivie, N. Feldman, Y. Imai, W. Livens, and D. Ooms. Explicit multicast (Xcast) concepts and options. IETF RFC 5058, 2007.

[8]

R. Briscoe. The implications of pervasive computing on network design. BT Technology Journal, 22(3):170--190, 2004.

Digital Library

[9]

A. Z. Broder and M. Mitzenmacher. Survey: Network applications of Bloom filters: A survey. Internet Mathematics, 2004.

[10]

K. L. Calvert, J. Griffioen, and L. Poutievski. Separating Routing and Forwarding: A Clean--Slate Network Layer Design. In In proc. of the Broadnets Conf., 2007.

[11]

M. Cha, P. Rodriguez, S. Moon, and J. Crowcroft. On next-generation telco-managed P2P TV architectures. In IPTPS '08, 2008.

Digital Library

[12]

J. Day. Patterns in Network Architecture: A Return to Fundamentals. Prentice Hall, 2008.

Digital Library

[13]

S. E. Deering and D. Cheriton. Multicast routing in datagram internetworks and extended LANs. ACM Trans. on Comp. Syst., 1990.

Digital Library

[14]

F. Dogar, A. Phanishayee, H. Pucha, O. Ruwase, and D. Andersen. Ditto -- A System for Opportunistic Caching in Multi-hop Wireless Mesh Networks. In ACM Mobicom, 2008.

Digital Library

[15]

P. T. Eugster, P. A. Felber, R. Guerraoui, and A.-M. Kermarrec. The many faces of publish/subscribe. ACM Comput. Surv., 2003.

Digital Library

[16]

P. Faratin, D. Clark, P. Gilmore, S. Bauer, A. Berger, and W. Lehr. Complexity of Internet interconnections: Technology, incentives and implications for policy. In TPRC' 07, 2007.

[17]

P. Gill, M. Arlitt, Z. Li, and A. Mahanti. YouTube Traffic Characterization: A View From the Edge. In ACM SIGCOMM IMC'07., 2007.

Digital Library

[18]

A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In WWW '05, 2005.

Digital Library

[19]

H. Holbrook and B. Cain. Source-specific multicast for IP. RFC 4607. 2006.

[20]

J.D.Touch and V.K.Pingali. The RNA metaprotocol. In ICCCN '08, 2008.

[21]

Z. Jerzak and C. Fetzer. Bloom filter based routing for content-based publish/subscribe. In DEBS '08, 2008.

Digital Library

[22]

H. T. Kaur, S. Kalyanaraman, A. Weiss, S. Kanwar, and A. Gandhi. Bananas: an evolutionary framework for explicit and multipath routing in the internet. SIGCOMM Comput. Commun. Rev., 2003.

Digital Library

[23]

T. Koponen, M. Chawla, B.-G. Chun, A. Ermolinskiy, K. H. Kim, S. Shenker, and I. Stoica. A data-oriented (and beyond) network architecture. In SIGCOMM '07, 2007.

Digital Library

[24]

H. Liu, V. Ramasubramanian, and E. G. Sirer. Client behavior and feed characteristics of RSS, a publish--subscribe system for web micronews. In IMC'05, 2005.

Digital Library

[25]

J. W. Lockwood, N. McKeown, G. Watson, G. Gibb, P. Hartke, J. Naous, R. Raghuraman, and J. Luo. NetFPGA-an open platform for gigabit-rate network switching and routing. In MSE '07, 2007.

Digital Library

[26]

E. Mannie. Generalized Multi-Protocol Label Switching (GMPLS) Architecture. RFC 3945, 2004.

[27]

A. Markopoulou, G. Iannaccone, S. Bhattacharyya, C. Chuah, and C. Diot. Characterization of failures in an IP backbone. In INFOCOM 2004, 2004.

[28]

S. Orlowski, M. Pi&#243;ro, A. Tomaszewski, and R. Wess&#228;ly. SNDlib 1.0-Survivable Network Design Library. In INOC' 07, 2007.

[29]

L. B. Poutievski, K. L. Calvert, and J. N. Griffioen. Routing and forwarding with flexible addressing. Journal Of Communication and Networks, 2007.

[30]

J. Rajahalme, M. S&#228;rel&#228;, P. Nikander, and S. Tarkoma. Incentive-compatible caching and peering in data-oriented networks. In ReArch'08, 2008.

Digital Library

[31]

S. Ratnasamy, A. Ermolinskiy, and S. Shenker. Revisiting IP multicast. In SIGCOMM'06, 2006.

Digital Library

[32]

M. S&#228;rel&#228;, T. Rintaho, and S. Tarkoma. RTFM: Publish/subscribe internetworking architecture. ICT Mobile Summit, 2008.

[33]

J. Scott, J. Crowcroft, P. Hui, and C. Diot. Haggle: a networking architecture designed around mobile users. In Annual IFIP Conference on Wireless On-demand Network Systems and Services, 2006.

[34]

A. Sharma, A. Bestavros, and I. Matta. dPAM: a distributed prefetching protocol for scalable asynchronous multicast in P2P systems. In INFOCOM' 05, 2005.

[35]

R. Sherwood, A. Bender, and N. Spring. Discarte: a disjunctive Internet cartographer. SIGCOMM Comput. Commun. Rev., 2008.

Digital Library

[36]

I. Stoica, D. Adkins, S. Zhuang, S. Shenker, and S. Surana. Internet indirection infrastructure. In SIGCOMM'02, 2002.

Digital Library

[37]

C. A. Sunshine. Source routing in computer networks. SIGCOMM Comput. Commun. Rev., 1977.

Digital Library

[38]

M. Szeredi. Filesystem in Userspace. Located at http://fuse. sourceforge. net.

[39]

S. Tarkoma, D. Trossen, and M. S&#228;rel&#228;. Black boxed rendezvous based networking. In MobiArch '08, 2008.

[40]

N. Tolia, M. Kozuch, M. Satyanarayanan, B. Karp, and T. Bressoud. Opportunistic use of content addressable storage for distributed file systems. In USENIX' 03, 2003.

[41]

D. Trossen (edit.). Architecture definition, component descriptions, and requirements. Deliverable D2.3, PSIRP project, 2009.

[42]

Y. Vigfusson, H. Abu-Libdeh, M. Balakrishnan, K. Birman, and Y. Tock. Dr. multicast: Rx for datacenter communication scalability. In HotNets-VII, 2008.

[43]

A. Whitaker and D. Wetherall. Forwarding without loops in Icarus. In Proc. of OPENARCH, 2002.

[44]

T. Wolf. A credential-based data path architecture for assurable global networking. In IEEE MILCOM, 2007.

[45]

A. Zahemszky, A. Csaszar, P. Nikander, and C. Esteve. Exploring the pubsub routing/forwarding space. In International Workshop on the Network of the Future, 2009.

Cited By

Ur Rehman WSufyan MSalam TAl-Salehi AAli QMalik A(2024)Cooperative Distributed Uplink Cache over B5G small cell networksPLOS ONE10.1371/journal.pone.029969019:4(e0299690)Online publication date: 4-Apr-2024
https://doi.org/10.1371/journal.pone.0299690
Zhang HWang ZZhang SMeng QLuo H(2023)Optimizing Link-Identified Forwarding Framework in LEO Satellite Networks2023 21st International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt)10.23919/WiOpt58741.2023.10349858(1-8)Online publication date: 24-Aug-2023
https://doi.org/10.23919/WiOpt58741.2023.10349858
Chen ZHuang JWang QLiu JLi ZZhou SHe Z(2023)MEB: an Efficient and Accurate Multicast using Bloom Filter with Customized Hash FunctionProceedings of the 7th Asia-Pacific Workshop on Networking10.1145/3600061.3600062(157-163)Online publication date: 29-Jun-2023
https://dl.acm.org/doi/10.1145/3600061.3600062
Show More Cited By

Index Terms

LIPSIN: line speed publish/subscribe inter-networking
1. Networks

Recommendations

LIPSIN: line speed publish/subscribe inter-networking
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication

A large fraction of today's Internet applications are internally publish/subscribe in nature; the current architecture makes it cumbersome and inept to support them. In essence, supporting efficient publish/subscribe requires data-oriented naming, ...
RACCOOM: A Rate-Based Congestion Control Approach for Multicast

Abstract--As multicast applications have become widely deployed on the Internet, it is increasingly important to ensure these applications respond to network congestion in a TCP-friendly manner so as to coexist with TCP connections (which constitute the ...
RFC 8114: Delivery of IPv4 Multicast Services to IPv4 Clients over an IPv6 Multicast Network

Comments

Information & Contributors

Information

Published In

cover image ACM SIGCOMM Computer Communication Review

ACM SIGCOMM Computer Communication Review Volume 39, Issue 4

SIGCOMM '09

October 2009

325 pages

ISSN:0146-4833

DOI:10.1145/1594977

Issue’s Table of Contents

SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication
August 2009
340 pages
ISBN:9781605585949
DOI:10.1145/1592568
General Chairs:
Pablo Rodriguez
Telefonica Research, Spain
,
Ernst Biersack
Eurecom, France
,
Program Chairs:
Konstantina Papagiannaki
Intel Labs Pittsburgh, USA
,
Luigi Rizzo
Università di Pisa, Italy

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 August 2009

Published in SIGCOMM-CCR Volume 39, Issue 4

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

366
Total Citations
View Citations
1,673
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)16

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ur Rehman WSufyan MSalam TAl-Salehi AAli QMalik A(2024)Cooperative Distributed Uplink Cache over B5G small cell networksPLOS ONE10.1371/journal.pone.029969019:4(e0299690)Online publication date: 4-Apr-2024
https://doi.org/10.1371/journal.pone.0299690
Zhang HWang ZZhang SMeng QLuo H(2023)Optimizing Link-Identified Forwarding Framework in LEO Satellite Networks2023 21st International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt)10.23919/WiOpt58741.2023.10349858(1-8)Online publication date: 24-Aug-2023
https://doi.org/10.23919/WiOpt58741.2023.10349858
Chen ZHuang JWang QLiu JLi ZZhou SHe Z(2023)MEB: an Efficient and Accurate Multicast using Bloom Filter with Customized Hash FunctionProceedings of the 7th Asia-Pacific Workshop on Networking10.1145/3600061.3600062(157-163)Online publication date: 29-Jun-2023
https://dl.acm.org/doi/10.1145/3600061.3600062
Li QHuang HLi RLv JYuan ZMa LHan YJiang Y(2023)A comprehensive survey on DDoS defense systemsComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2023.109895233:COnline publication date: 24-Aug-2023
https://dl.acm.org/doi/10.1016/j.comnet.2023.109895
Al-Khalidi MAl-Zaidi RAbubahia APandey HBiswas MHammoudeh M(2022)Global IoT Mobility: A Path Based Forwarding ApproachJournal of Sensor and Actuator Networks10.3390/jsan1103004111:3(41)Online publication date: 1-Aug-2022
https://doi.org/10.3390/jsan11030041
Al-Khalidi MAl-Zaidi RHammoudeh M(2022)Network Mobility Management Challenges, Directions, and Solutions: An Architectural PerspectiveElectronics10.3390/electronics1117269611:17(2696)Online publication date: 28-Aug-2022
https://doi.org/10.3390/electronics11172696
ZHA YCUI PHU YLAN JWANG Y(2022)A Scalable Bitwise Multicast Technology in Named Data NetworkingIEICE Transactions on Information and Systems10.1587/transinf.2022EDP7057E105.D:12(2104-2111)Online publication date: 1-Dec-2022
https://doi.org/10.1587/transinf.2022EDP7057
Lian PYan FLuo HWang ZZhang S(2022)Multicast Source Routing based on Bloomed Link Identifiers for LEO Satellite Network2022 IEEE International Conference on Satellite Computing (Satellite)10.1109/Satellite55519.2022.00011(13-18)Online publication date: Nov-2022
https://doi.org/10.1109/Satellite55519.2022.00011
Barber JYu XZamore LLin JJazayeri VErlich SSavor TStumm M(2021)BladerunnerProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483572(708-723)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483572
Kiss SHosszu ETapolcai JRonyai LRottenstreich O(2021)Bloom Filter With a False Positive Free ZoneIEEE Transactions on Network and Service Management10.1109/TNSM.2021.305907518:2(2334-2349)Online publication date: Jun-2021
https://doi.org/10.1109/TNSM.2021.3059075
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents