Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Beyond bloom filters: from approximate membership checks to approximate state machines

Published: 11 August 2006 Publication History

Abstract

Many networking applications require fast state lookups in a concurrent state machine,which tracks the state of a large number of flows simultaneously.We consider the question of how to compactly represent such concurrent state machines. To achieve compactness,we consider data structures for Approximate Concurrent State Machines (ACSMs)that can return false positives,false negatives,or a "don 't know "response.We describe three techniques based on Bloom filters and hashing,and evaluate them using both theoretical analysis and simulation.Our analysis leads us to an extremely efficient hashing-based scheme with several parameters that can be chosen to trade off space,computation,and the pact of errors.Our hashing approach also yields a simple alternative structure with the same functionality as a counting Bloom filter that uses much less space.We show how ACSMs can be used for video congestion control.Using an ACSM,a router can implement sophisticated Active Queue Management (AQM)techniques for video traffic (without the need for standards changes to mark packets or change video formats),with a factor of four reduction in memory compared to full-state schemes and with very little error.We also show that ACSMs show promise for real-time detection of P2P traffic.

References

[1]
E. Amir, S. McCanne. M. Vitterli. A Layered DCT coder for Internet Video. In Proc. IEEE International Conference on Image Processing Lausanne, Switzerland, Sept 1996.
[2]
B. Bloom. Space/time tradeoffs in in hash coding with allowable errors. Communications of the ACM 13(7):422--426, 1970.
[3]
A. Broder and M. Mitzenmacher. Using multiple hash functions to improve IP Lookups. In Proceedings of IEEE INFOCOM pp. 1454--1463, 2001.
[4]
A. Broder and M. Mitzenmacher. Network applications of Bloom filters: A survey. Internet Mathematics 1(4):485--509, 2004.
[5]
B. Chazelle, J. Kilian, R. Rubinfeld, and A. Tal. The Bloomier filter: an efficient data structure for static support lookup tables. In Proceedings of the Fifteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA) pp 30--39, 2004.
[6]
F. Bonomi, M. Mitzenmacher, R. Panigrahy, S. Singh, and G. Varghese. An Improved Construction for Counting Bloom Filters. To appear in the 2006 European Symposium on Algorithms.
[7]
S. Dharmapurikar, P. Krishnamurthy, T. Sproull, and J. Lockwood. Deep Packet Inspection using Parallel Bloom Filters. In IEEE Hot Interconnects 12 Stanford, CA, August 2003. IEEE Computer Society Press.
[8]
L. Fan, P. Cao, J. Almeida, and A. Z. Broder. Summary cache: a scalable wide-area Web cache sharing protocol. IEEE/ACM Transactions on Networking 8(3):281--293, 2000.
[9]
D. Forsgren, U. Jennehag. P. Osterberg, Objective Endtoend QoS Gain from Packet Prioritization and Layering in MPEG-2 streaming video. At http://amp.ece.cmu.edu/packetvideo2002/papers/61-ananhseors.pdf
[10]
T. Karargiannis, A. Broido, M. Faloutsos, and K. C. Claffy. Transport Layer Identification of P2P Traffic. In Proceedings of ACM SIGCOMM 2004.
[11]
T. Karargiannis, A. Broido, M. Faloutsos, and K.C.Claffy. BLINC: Multilevel Traffic Classification in the Dark. In Proceedings of ACM SIGCOMM 2005.
[12]
A. Kirsch and M. Mitzenmacher. Simple Summaries for Hashing with Multiple Choices. In Proc. of the Forty-Third Annual Allerton Conference 2005.
[13]
Y. Lu, B. Prabhakar, and F. Bonomi. Bloom Filters: Design Innovations and Novel Applications. In Proc. of the Forty-Third Annual Allerton Conference 2005.
[14]
Steve McCanne. Scalable Compression and Transmission of Internet Multicast Video. Ph. D. Thesis, Berkeley
[15]
M. Mitzenmacher.Compressed Bloom Filters. IEEE/ACM Transactions on Networking 10(5):613--620, 2002.
[16]
M. Mitzenmacher and E. Upfal. Probability and Computing: Randomized Algorithms and Probabilistic Analysis Cambridge University Press, 2005.
[17]
A. Pagh, R. Pagh, and S. Srinivas Rao. An Optimal Bloom Filter Replacement. In Proceedings of the Sixteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA) pp. 823--829, 2005.
[18]
A. Romanow and S. Floyd. Dynamics of TCP Traffic over ATM Networks. IEEE Journal on Selected Areas in Communications 13(4):633--641 (1995).
[19]
S. Sen, O. Spatscheck, and D. Wang. Accurate, Scalable In-network identification of P2P Traffic Using Application Signatures. In 13th International World Wide Web Conference New York City, 17--22 May 2004.
[20]
H. Song, S. Dharmapurikar, J. Turner, and J. Lockwood. Fast hash table lookup using extended Bloom filter: an aid to network processing. In Proceedings of ACM SIGCOMM pp. 181--192, 2005.
[21]
A. Snoeren, C. Partridge, L. Sanchez, C. Jones, F. Tchakountio, B. Schwartz, S. Kent, and W. Strayer. Single-Packet IP Traceback. IEEE/ACM Transactions on Networking 10(6):721--734, 2002.
[22]
Tektronix FTP site, ftp://ftp.tek.com/tv/test/streams/Element/MPEG-Video/625/
[23]
K. Thomson, G. J. Miller, and R. Wilder. Wide-area traffic patterns and characteristics. IEEE Network December 1997.
[24]
B. Vöcking. How asymmetry helps load balancing. In Proceedings of the 40th IEEE-FOCS pp. 131--140, 1999.

Cited By

View all
  • (2024)From CountMin to Super kJoin Sketches for Flow Spread EstimationIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.327966511:3(2353-2370)Online publication date: May-2024
  • (2024)2D-SVRF: A Terabit-Scale Multicast Packet Switching Control Plane for 5G/6G Core NetworksIEEE Internet of Things Journal10.1109/JIOT.2024.340266511:17(28356-28369)Online publication date: 1-Sep-2024
  • (2023)On the Evolutionary of Bloom Filter False Positives - An Information Theoretical Approach to Optimizing Bloom Filter ParametersIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.320004535:7(7316-7327)Online publication date: 1-Jul-2023
  • Show More Cited By

Index Terms

  1. Beyond bloom filters: from approximate membership checks to approximate state machines

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM SIGCOMM Computer Communication Review
    ACM SIGCOMM Computer Communication Review  Volume 36, Issue 4
    Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
    October 2006
    445 pages
    ISSN:0146-4833
    DOI:10.1145/1151659
    Issue’s Table of Contents
    • cover image ACM Conferences
      SIGCOMM '06: Proceedings of the 2006 conference on Applications, technologies, architectures, and protocols for computer communications
      September 2006
      458 pages
      ISBN:1595933085
      DOI:10.1145/1159913
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 August 2006
    Published in SIGCOMM-CCR Volume 36, Issue 4

    Check for updates

    Author Tags

    1. bloom filters
    2. network flows
    3. state machines

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)78
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 26 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)From CountMin to Super kJoin Sketches for Flow Spread EstimationIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.327966511:3(2353-2370)Online publication date: May-2024
    • (2024)2D-SVRF: A Terabit-Scale Multicast Packet Switching Control Plane for 5G/6G Core NetworksIEEE Internet of Things Journal10.1109/JIOT.2024.340266511:17(28356-28369)Online publication date: 1-Sep-2024
    • (2023)On the Evolutionary of Bloom Filter False Positives - An Information Theoretical Approach to Optimizing Bloom Filter ParametersIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.320004535:7(7316-7327)Online publication date: 1-Jul-2023
    • (2023)Securing Fieldable Bioinformatics2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)10.1109/BIBM58861.2023.10385290(3390-3397)Online publication date: 5-Dec-2023
    • (2023)Bloom Filter for named-data networkingBloom Filter10.1016/B978-0-12-823520-1.00017-1(101-115)Online publication date: 2023
    • (2022)BBF: A Bloom Filter Using B Sequences for Multi-set Membership QueryACM Transactions on Knowledge Discovery from Data10.1145/350273516:5(1-26)Online publication date: 9-Mar-2022
    • (2022)Elastic Bloom Filter: Deletable and Expandable Filter Using Elastic FingerprintsIEEE Transactions on Computers10.1109/TC.2021.306771371:4(984-991)Online publication date: 1-Apr-2022
    • (2022)Dynamically Allocated Bloom Filter-Based PIT ArchitecturesIEEE Access10.1109/ACCESS.2022.315836810(28165-28179)Online publication date: 2022
    • (2022)A survey on the roles of Bloom Filter in implementation of the Named Data NetworkingComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2021.108232196:COnline publication date: 22-Apr-2022
    • (2021)Learned FBF: Learning-Based Functional Bloom Filter for Key-Value StorageIEEE Transactions on Computers10.1109/TC.2021.3112079(1-1)Online publication date: 2021
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media