Article

Bullet: high bandwidth data dissemination using an overlay mesh

Authors:

Adolfo Rodriguez,

Jeannie Albrecht,

Amin VahdatAuthors Info & Claims

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

Pages 282 - 297

https://doi.org/10.1145/945445.945473

Published: 19 October 2003 Publication History

Abstract

In recent years, overlay networks have become an effective alternative to IP multicast for efficient point to multipoint communication across the Internet. Typically, nodes self-organize with the goal of forming an efficient overlay tree, one that meets performance targets without placing undue burden on the underlying network. In this paper, we target high-bandwidth data distribution from a single source to a large number of receivers. Applications include large-file transfers and real-time multimedia streaming. For these applications, we argue that an overlay mesh, rather than a tree, can deliver fundamentally higher bandwidth and reliability relative to typical tree structures. This paper presents Bullet, a scalable and distributed algorithm that enables nodes spread across the Internet to self-organize into a high bandwidth overlay mesh. We construct Bullet around the insight that data should be distributed in a disjoint manner to strategic points in the network. Individual Bullet receivers are then responsible for locating and retrieving the data from multiple points in parallel.Key contributions of this work include: i) an algorithm that sends data to different points in the overlay such that any data object is equally likely to appear at any node, ii) a scalable and decentralized algorithm that allows nodes to locate and recover missing data items, and iii) a complete implementation and evaluation of Bullet running across the Internet and in a large-scale emulation environment reveals up to a factor two bandwidth improvements under a variety of circumstances. In addition, we find that, relative to tree-based solutions, Bullet reduces the need to perform expensive bandwidth probing. In a tree, it is critical that a node's parent delivers a high rate of application data to each child. In Bullet however, nodes simultaneously receive data from multiple sources in parallel, making it less important to locate any single source capable of sustaining a high transmission rate.

References

[1]

Suman Banerjee, Bobby Bhattacharjee, and Christopher Kommareddy. Scalable Application Layer Multicast. In Proceedings of ACM SIGCOMM, August 2002.

Digital Library

[2]

Kenneth Birman, Mark Hayden, Oznur Ozkasap, Zhen Xiao, Mihai Budiu, and Yaron Minsky. Bimodal Multicast. ACM Transaction on Computer Systems, 17(2), May 1999.

Digital Library

[3]

Bittorrent. http://bitconjurer.org/BitTorrent.

[4]

Burton Bloom. Space/Time Trade-offs in Hash Coding with Allowable Errors. Communication of ACM, 13(7):422--426, July 1970.

Digital Library

[5]

Andrei Broder. On the Resemblance and Containment of Documents. In Proceedings of Compression and Complexity of Sequences (SEQUENCES'97), 1997.

Digital Library

[6]

John W. Byers, Jeffrey Considine, Michael Mitzenmacher, and Stanislav Rost. Informed Content Delivery Across Adaptive Overlay Networks. In Proceedings of ACM SIGCOMM, August 2002.

Digital Library

[7]

John W. Byers, Michael Luby, Michael Mitzenmacher, and Ashutosh Rege. A Digital Fountain Approach to Reliable Distribution of Bulk Data. In SIGCOMM, pages 56--67, 1998.

Digital Library

[8]

Ken Calvert, Matt Doar, and Ellen~W. Zegura. Modeling Internet Topology. IEEE Communications Magazine, June 1997.

Digital Library

[9]

Miguel Castro, Peter Druschel, Anne-Marie Kermarrec, Animesh Nandi, Antony Rowstron, and Atul Singh. Splitstream: High-bandwidth Content Distribution in Cooperative Environments. In Proceedings of the 19th ACM Symposium on Operating System Principles, October 2003.

Digital Library

[10]

Hyunseok Chang, Ramesh Govindan, Sugih Jamin, Scott Shenker, and Walter Willinger. Towards Capturing Representative AS-Level Internet Topologies. In Proceedings of ACM SIGMETRICS, June 2002.

Digital Library

[11]

Ludmila Cherkasova and Jangwon Lee. FastReplica: Efficient Large File Distribution within Content Delivery Networks. In 4th USENIX Symposium on Internet Technologies and Systems, March 2003.

Digital Library

[12]

Reuven Cohen and Gideon Kaempfer. A Unicast-based Approach for Streaming Multicast. In INFOCOM, pages 440--448, 2001.

[13]

Patrick Eugster, Sidath Handurukande, Rachid Guerraoui, Anne-Marie Kermarrec, and Petr Kouznetsov. Lightweight Probabilistic Broadcast. To appear in ACM Transactions on Computer Systems.

Digital Library

[14]

Patrick Eugster, Sidath Handurukande, Rachid Guerraoui, Anne-Marie Kermarrec, and Petr Kouznetsov. Lightweight Probabilistic Broadcast. In Proceedings of The International Conference on Dependable Systems and Networks (DSN), 2001.

Digital Library

[15]

Sally Floyd, Mark Handley, Jitendra Padhye, and Jorg Widmer. Equation-based congestion control for unicast applications. In SIGCOMM 2000, pages 43--56, Stockholm, Sweden, August 2000.

Digital Library

[16]

Sally Floyd, Van Jacobson, Ching-Gung Liu, Steven McCanne, and Lixia Zhang. A Reliable Multicast Framework for Light-weight Sessions and Application Level Framing. IEEE\ACM Transactions on Networking, 5(6):784--803, 1997.

Digital Library

[17]

Vivek K Goyal. Multiple Description Coding: Compression Meets the Network. IEEE Signal Processing Mag., pages 74--93, May 2001.

[18]

Yang hua Chu, Sanjay Rao, and Hui Zhang. A Case For End System Multicast. In Proceedings of the ACM Sigmetrics 2000 International Conference on Measurement and Modeling of Computer Systems, June 2000.

Digital Library

[19]

Yang hua Chu, Sanjay G. Rao, Srinivasan Seshan, and Hui Zhang. Enabling Conferencing Applications on the Internet using an Overlay Multicast Architecture. In Proceedings of ACM SIGCOMM, August 2001.

Digital Library

[20]

Manish Jain and Constantinos Dovrolis. End-to-end Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput. In Proceedings of SIGCOMM 2002, New York, August 19--23 2002.

Digital Library

[21]

John Jannotti, David K. Gifford, Kirk L. Johnson, M. Frans Kaashoek, and Jr. James W. O'Toole. Overcast: Reliable Multicasting with an Overlay Network. In Proceedings of Operating Systems Design and Implementation (OSDI), October 2000.

Digital Library

[22]

Kazaa media desktop. http://www.kazaa.com.

[23]

Min Sik Kim, Simon S. Lam, and Dong-Young Lee. Optimal Distribution Tree for Internet Streaming Media. Technical Report TR-02-48, Department of Computer Sciences, University of Texas at Austin, September 2002.

[24]

Dejan Kostić, Adolfo Rodriguez, Jeannie Albrecht, Abhijeet Bhirud, and Amin Vahdat. Using Random Subsets to Build Scalable Network Services. In Proceedings of the USENIX Symposium on Internet Technologies and Systems, March 2003.

Digital Library

[25]

Michael Luby. LT Codes. In In The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002.

Digital Library

[26]

Michael G. Luby, Michael Mitzenmacher, M. Amin Shokrollahi, Daniel A. Spielman, and Volker Stemann. Practical Loss-Resilient Codes. In Proceedings of the 29th Annual ACM Symposium on the Theory of Computing (STOC '97), pages 150--159, New York, May 1997. Association for Computing Machinery.

Digital Library

[27]

Jitedra Padhye, Victor Firoiu, Don Towsley, and Jim Krusoe. Modeling TCP Throughput: A Simple Model and its Empirical Validation. In ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication, pages 303--314, Vancouver, CA, 1998.

Digital Library

[28]

Venkata N. Padmanabhan, Lili Qiu, and Helen J. Wang. Server-based Inference of Internet Link Lossiness. In Proceedings of the IEEE Infocom, San Francisco, CA, USA, 2003.

[29]

Venkata N. Padmanabhan, Helen J. Wang, and Philip A. Chou. Resilient Peer-to-Peer Streaming. In Proceedings of the 11th ICNP, Atlanta, Georgia, USA, 2003.

Digital Library

[30]

Venkata N. Padmanabhan, Helen~J. Wang, Philip A. Chou, and Kunwadee Sripanidkulchai. Distributing Streaming Media Content Using Cooperative Networking. In ACM/IEEE NOSSDAV, 2002.

Digital Library

[31]

Larry Peterson, Tom Anderson, David Culler, and Timothy Roscoe. A Blueprint for Introducing Disruptive Technology into the Internet. In Proceedings of ACM HotNets-I, October 2002.

[32]

R. C. Prim. Shortest Connection Networks and Some Generalizations. In Bell Systems Technical Journal, pages 1389--1401, November 1957.

[33]

Adolfo Rodriguez, Sooraj Bhat, Charles Killian, Dejan Kostić, and Amin Vahdat. MACEDON: Methodology for Automatically Creating, Evaluating, and Designing Overlay Networks. Technical Report CS-2003-09, Duke University, July 2003.

[34]

Antony Rowstron, Anne-Marie Kermarrec, Miguel Castro, and Peter Druschel. SCRIBE: The Design of a Large-scale Event Notification Infrastructure. In Third International Workshop on Networked Group Communication, November 2001.

Digital Library

[35]

Stefan Savage. Sting: A TCP-based Network Measurement Tool. In Proceedings of the 2nd USENIX Symposium on Internet Technologies and Systems (USITS-99), pages 71--80, Berkeley, CA, October 11--14 1999. USENIX Association.

Digital Library

[36]

Alex C. Snoeren, Kenneth Conley, and David K. Gifford. Mesh-Based Content Routing Using XML. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP '01), October 2001.

Digital Library

[37]

Amin Vahdat, Ken Yocum, Kevin Walsh, Priya Mahadevan, Dejan Kostić, Jeff Chase, and David Becker. Scalability and Accuracy in a Large-Scale Network Emulator. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI), December 2002.

Digital Library

Cited By

Li JLi ZLu RXiao KLi SChen JYang JZong CChen AWu QSun CTyson GLiu HKuipers FOrda A(2022)LiveNetProceedings of the ACM SIGCOMM 2022 Conference10.1145/3544216.3544236(812-825)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1145/3544216.3544236
Zhang YNie XJiang JWang WXu KZhao YReed MChen KWang HYao G(2021)BDS+: An Inter-Datacenter Data Replication System With Dynamic Bandwidth SeparationIEEE/ACM Transactions on Networking10.1109/TNET.2021.305492429:2(918-934)Online publication date: May-2021
https://doi.org/10.1109/TNET.2021.3054924
Zhang YXu KZhang YXu K(2020)The Deployment of Large-Scale Data Synchronization System for Cross-DC NetworksNetwork Management in Cloud and Edge Computing10.1007/978-981-15-0138-8_6(91-120)Online publication date: 7-Mar-2020
https://doi.org/10.1007/978-981-15-0138-8_6
Show More Cited By

Index Terms

Bullet: high bandwidth data dissemination using an overlay mesh

Recommendations

Bullet: high bandwidth data dissemination using an overlay mesh
SOSP '03

In recent years, overlay networks have become an effective alternative to IP multicast for efficient point to multipoint communication across the Internet. Typically, nodes self-organize with the goal of forming an efficient overlay tree, one that meets ...
High-bandwidth data dissemination for large-scale distributed systems

This article focuses on the multireceiver data dissemination problem. Initially, IP multicast formed the basis for efficiently supporting such distribution. More recently, overlay networks have emerged to support point-to-multipoint communication. Both ...
GridDL: an HTTP bandwidth sharing framework
U-NET '09: Proceedings of the 1st ACM workshop on User-provided networking: challenges and opportunities

Peer-to-peer (P2P) applications have become a mainstream technology for content distribution. Yet widely used P2P applications, such as BitTorrent and Gnutella, suffer from flaws that are currently open topics of research---from the problem of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles

October 2003

338 pages

ISBN:1581137575

DOI:10.1145/945445

General Chair:
Michael L. Scott
University of Rochester
,
Program Chair:
Larry Peterson
Princeton University

ACM SIGOPS Operating Systems Review Volume 37, Issue 5
SOSP '03
December 2003
329 pages
ISSN:0163-5980
DOI:10.1145/1165389
Issue’s Table of Contents

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SOSP03

Sponsor:

SOSP03: ACM Symposium on Operating Systems Principles

October 19 - 22, 2003

NY, Bolton Landing, USA

Acceptance Rates

SOSP '03 Paper Acceptance Rate 22 of 128 submissions, 17%;

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '24

Sponsor:
sigops

ACM SIGOPS 30th Symposium on Operating Systems Principles

November 5 - 8, 2024

Austin , TX , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

471
Total Citations
View Citations
2,177
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)4

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li JLi ZLu RXiao KLi SChen JYang JZong CChen AWu QSun CTyson GLiu HKuipers FOrda A(2022)LiveNetProceedings of the ACM SIGCOMM 2022 Conference10.1145/3544216.3544236(812-825)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1145/3544216.3544236
Zhang YNie XJiang JWang WXu KZhao YReed MChen KWang HYao G(2021)BDS+: An Inter-Datacenter Data Replication System With Dynamic Bandwidth SeparationIEEE/ACM Transactions on Networking10.1109/TNET.2021.305492429:2(918-934)Online publication date: May-2021
https://doi.org/10.1109/TNET.2021.3054924
Zhang YXu KZhang YXu K(2020)The Deployment of Large-Scale Data Synchronization System for Cross-DC NetworksNetwork Management in Cloud and Edge Computing10.1007/978-981-15-0138-8_6(91-120)Online publication date: 7-Mar-2020
https://doi.org/10.1007/978-981-15-0138-8_6
Zhang YXu KZhang YXu K(2020)A Survey of Resource Management in Cloud and Edge ComputingNetwork Management in Cloud and Edge Computing10.1007/978-981-15-0138-8_2(15-32)Online publication date: 7-Mar-2020
https://doi.org/10.1007/978-981-15-0138-8_2
Zhang YXu KZhang YXu K(2020)IntroductionNetwork Management in Cloud and Edge Computing10.1007/978-981-15-0138-8_1(1-13)Online publication date: 7-Mar-2020
https://doi.org/10.1007/978-981-15-0138-8_1
FUJITA S(2019)Cloud-Assisted Peer-to-Peer Video Streaming with Minimum LatencyIEICE Transactions on Information and Systems10.1587/transinf.2018EDP7229E102.D:2(239-246)Online publication date: 1-Feb-2019
https://doi.org/10.1587/transinf.2018EDP7229
Roy IMaddali KKaluvakuri SRekabdar BLiu' ZGupta BDebnath N(2019)Efficient Any Source Overlay Multicast In CRT-Based P2P Networks - A Capacity-Constrained Approach2019 IEEE 17th International Conference on Industrial Informatics (INDIN)10.1109/INDIN41052.2019.8972151(1351-1357)Online publication date: Jul-2019
https://doi.org/10.1109/INDIN41052.2019.8972151
Zhang YJiang JXu KNie XReed MWang HYao GZhang MChen KOliveira RFelber PHu Y(2018)BDSProceedings of the Thirteenth EuroSys Conference10.1145/3190508.3190519(1-14)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3190508.3190519
Fujita S(2018)On the Cost of Cloud-Assistance in Tree-Structured P2P Live Streaming2018 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW.2018.00129(820-828)Online publication date: May-2018
https://doi.org/10.1109/IPDPSW.2018.00129
Maddali KRoy ISinha KGupta BHexmoor HKaluvakuri S(2018)Efficient Any Source Capacity-Constrained Overlay Multicast in LDE-Based P2P Networks2018 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)10.1109/ANTS.2018.8710160(1-5)Online publication date: 16-Dec-2018
https://dl.acm.org/doi/10.1109/ANTS.2018.8710160
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents