research-article

Synchronizing Namespaces with Invertible Bloom Filters

Authors:

Hila Ben Abraham,

Patrick CrowleyAuthors Info & Claims

ANCS '15: Proceedings of the Eleventh ACM/IEEE Symposium on Architectures for networking and communications systems

Pages 123 - 134

Published: 07 May 2015 Publication History

Abstract

Data synchronization--long a staple in file systems--is emerging as a significant communications primitive. In a distributed system, data synchronization resolves differences among distributed sets of information. In named data networking (NDN), an information-centric communications architecture, data synchronization between multiple nodes is widely used to support basic services, such as public key distribution, file sharing, and route distribution. While existing NDN synchronization schemes are functional, their implementations rely on log-based representations of information, which creates a limitation on their performance and scalability.

This paper presents iSync, a high performance synchronization protocol for NDN. iSync supports efficient data reconciliation by representing the synchronized datasets using a two-level invertible Bloom filter (IBF) structure. A set-differences can be found by subtracting a remote IBF from a local IBF. The protocol can obtain multiple differences from a single round of data exchange, and does not require prior context in most application scenarios. We evaluated iSync's performance by comparing it to the CCNx synchronization protocol. Experiments show that iSync is about eight times faster across a range of network topologies and sizes, and that it reduces the number of packets sent by about 90%.

References

[1]

Lixia Zhang, Deborah Estrin, and et al. Named data networking project. Relatório Técnico NDN-0001, Xerox Palo Alto Research Center-PARC, 2010.

[2]

Giulio Grassi, Davide Pesavento, Lucas Wang, Giovanni Pau, Rama Vuyyuru, Ryuji Wakikawa, and Lixia Zhang. Vehicular inter-networking via named data. arXiv preprint arXiv:1310.5980, 2013.

[3]

The dropbox website. https://www.dropbox.com/.

[4]

Michael T Goodrich and Michael Mitzenmacher. Invertible bloom lookup tables. In Communication, Control, and Computing (Allerton), 2011 49th Annual Allerton Conference on, pages 792--799. IEEE, 2011.

[5]

David Eppstein, Michael T Goodrich, and et al. What's the difference? efficient set reconciliation without prior context. In ACM SIGCOMM Computer Communication Review, volume 41, pages 218--229. ACM, 2011.

Digital Library

[6]

Content centric networking (CCNx) project website. http://www.ccnx.org.

[7]

Andrew Tridgell and Paul Mackerras. The rsync algorithm,"australian national university. Technical report, TR-CS-96-05, 1996.

[8]

Van Jacobson, Rebecca L Braynard, and et al. Custodian-based information sharing. Communications Magazine, IEEE, 50(7):38--43, 2012.

[9]

Zhenkai Zhu and Alexander Afanasyev. Let°Øs chronosync: Decentralized dataset state synchronization in named data networking. In Proceedings of the 21st IEEE International Conference on Network Protocols (ICNP 2013).

[10]

Zhenkai Zhu and Chaoyi et al. Bian. Chronos: Serverless multi-user chat over ndn. Technical report, Technical Report TR008, UCLA Named Data Networking Project, 2012.

[11]

Ralph C Merkle. A certified digital signature. In Advances in Cryptology Proceedings, pages 218--238. Springer, 1990.

Digital Library

[12]

Sachin Agarwal, Starobinski, and et al. On the scalability of data synchronization protocols for pdas and mobile devices. Network, IEEE, 16(4):22--28, 2002.

Digital Library

[13]

Cedric Westphal. Synchronizing state with strong similarity between local and remote systems. In Proceedings of the Third ACM Workshop on Mobile Cloud Computing and Services, MCS '12, pages 15--20, 2012.

Digital Library

[14]

Bittorrent sync website. http://www.bittorrent.com/sync.

[15]

The Google Drive website. http://www.google.com/drive/about.html.

[16]

NSF future Internet architecture project website. http://www.nets-fia.net/.

[17]

Ralph C Merkle. A fast software one-way hash function. Journal of Cryptology, 3(1):43--58, 1990.

Digital Library

[18]

Jean-Sébastien Coron, Yevgeniy Dodis, and et al. Merkle-damgård revisited: How to construct a hash function. In Advances in Cryptology--CRYPTO 2005, pages 430--448. Springer, 2005.

Digital Library

[19]

Gary D Knott. Expandable open addressing hash table storage and retrieval. In Proceedings of the 1971 ACM SIGFIDET (now SIGMOD) Workshop on Data Description, Access and Control, pages 187--206. ACM, 1971.

Digital Library

[20]

Witold Litwin. Linear hashing: a new tool for file and table addressing. In VLDB, volume 80, pages 1--3, 1980.

Digital Library

[21]

Charlie Wiseman, Jonathan Turner, and et al. A remotely accessible network processor-based router for network experimentation. In Proceedings of the 4th ACM/IEEE Symposium on Architectures for Networking and Communications Systems, pages 20--29. ACM, 2008.

Digital Library

Cited By

Liang TPan JZhang BYeh EOran D(2018)NDNizing existing applicationsProceedings of the 5th ACM Conference on Information-Centric Networking10.1145/3267955.3267969(172-183)Online publication date: 21-Sep-2018
https://dl.acm.org/doi/10.1145/3267955.3267969
Abraham HParwatikar JDeHart JDrescher ACrowley PYeh EOran D(2018)Decoupling information and connectivity via information-centric transportProceedings of the 5th ACM Conference on Information-Centric Networking10.1145/3267955.3267963(54-66)Online publication date: 21-Sep-2018
https://dl.acm.org/doi/10.1145/3267955.3267963
Shang WAfanasyev AZhang LSchmidt TSeedorf J(2017)VectorSyncProceedings of the 4th ACM Conference on Information-Centric Networking10.1145/3125719.3132106(192-193)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3125719.3132106
Show More Cited By

Index Terms

Synchronizing Namespaces with Invertible Bloom Filters
1. Networks
  1. Network protocols
    1. Application layer protocols

Recommendations

iSync: a high performance and scalable data synchronization protocol for named data networking
ACM-ICN '14: Proceedings of the 1st ACM Conference on Information-Centric Networking

This paper presents a high performance synchronization protocol for named data networking (NDN). The protocol, called iSync, uses a two-level invertible Bloom filter (IBF) structure to support efficient data reconciliation. Multiple differences can be ...
Analysis of Synchronizer, Data Loss and Occurrence of Metastability
ICESC '14: Proceedings of the 2014 International Conference on Electronic Systems, Signal Processing and Computing Technologies

The many applications consist of multiple clock domains. There is data transfer between these clock domain systems. Due to different frequencies between sender and receiver there is data loss. Synchronizer is used for data synchronization. Synchronizer ...
Two-phase synchronization with sub-cycle latency

Synchronizers typically incur long latency of multiple-clock cycles, resulting in low throughput. This paper presents two novel fast synchronizers, both based on two-phase protocols: a two-flip-flop synchronizer which reduces the data cycle from 6-12 ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ANCS '15: Proceedings of the Eleventh ACM/IEEE Symposium on Architectures for networking and communications systems

May 2015

224 pages

ISBN:9781467366328

General Chair:
Gordon Brebner
Xilinx, USA
,
Program Chairs:
Alex Bachmutsky
Ericsson, USA
,
Chita Das
Pennsylvania State University, USA

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication
SIGARCH: ACM Special Interest Group on Computer Architecture
USENIX Assoc: USENIX Assoc
IEEE CS

Publisher

IEEE Computer Society

United States

Publication History

Published: 07 May 2015

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Acceptance Rates

Overall Acceptance Rate 88 of 314 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
185
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liang TPan JZhang BYeh EOran D(2018)NDNizing existing applicationsProceedings of the 5th ACM Conference on Information-Centric Networking10.1145/3267955.3267969(172-183)Online publication date: 21-Sep-2018
https://dl.acm.org/doi/10.1145/3267955.3267969
Abraham HParwatikar JDeHart JDrescher ACrowley PYeh EOran D(2018)Decoupling information and connectivity via information-centric transportProceedings of the 5th ACM Conference on Information-Centric Networking10.1145/3267955.3267963(54-66)Online publication date: 21-Sep-2018
https://dl.acm.org/doi/10.1145/3267955.3267963
Shang WAfanasyev AZhang LSchmidt TSeedorf J(2017)VectorSyncProceedings of the 4th ACM Conference on Information-Centric Networking10.1145/3125719.3132106(192-193)Online publication date: 26-Sep-2017
https://dl.acm.org/doi/10.1145/3125719.3132106
Ben Abraham HCrowley P(2017)Controlling Strategy Retransmissions in Named Data NetworkingProceedings of the Symposium on Architectures for Networking and Communications Systems10.1109/ANCS.2017.17(70-81)Online publication date: 18-May-2017
https://dl.acm.org/doi/10.1109/ANCS.2017.17
Shilton KBurke JClaffy KZhang L(2016)Anticipating policy and social implications of named data networkingCommunications of the ACM10.1145/291591559:12(92-101)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1145/2915915

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten