research-article

A fast handshake join implementation on FPGA with adaptive merging network

Authors:

Takefumi Miyoshi,

Hideyuki Kawashima,

Tsutomu YoshinagaAuthors Info & Claims

SSDBM '13: Proceedings of the 25th International Conference on Scientific and Statistical Database Management

Article No.: 44, Pages 1 - 4

https://doi.org/10.1145/2484838.2484868

Published: 29 July 2013 Publication History

Abstract

One of a critical design issues for implementing handshake-join hardware is result collection performed by a merging network. To address the issue, we introduce an adaptive merging network. Our implementation achieves over 3 million tuples per second when the selectivity is 0.1. The proposed implementation attains up to 5.2x higher throughput than original handshake-join hardware. In this demonstration, we apply the proposed technique to filter out malicious packets from packet streams. To the best of our knowledge, our system is the fastest handshake join implementation on FPGA.

References

[1]

"Negi: A packet capturing system." {Online}. Available: https://github.com/westlab/negi

[2]

"Streamspinner." {Online}. Available: http://www.streamspinner.org

[3]

D. J. Abadi, Y. Ahmad, M. Balazinska, U. Çetintemel, M. Cherniack, J.-H. Hwang, W. Lindner, A. Maskey, A. Rasin, E. Ryvkina, N. Tatbul, Y. Xing, and S. B. Zdonik, "The design of the Borealis stream processing engine," in CIDR, 2005, pp. 277--289.

[4]

A. Arasu, S. Babu, and J. Widom, "The CQL continuous query language: semantic foundations and query execution," The VLDB Journal, vol. 15, no. 2, pp. 121--142, Jun. 2006.

Digital Library

[5]

CERT, "Advisory CA-1996-21 TCP SYN Flooding and IP Spoofing Attacks," 1996.

[6]

e-trees.Japan, Inc., "e7PCIe IP-core." {Online}. Available: http://www.e-trees.jp/index.php/en/products/e7pcie-ipcore/

[7]

e-trees.Japan, Inc., "e7UDP/IP IP-core." {Online}. Available: http://www.e-trees.jp/index.php/en/products/e7udpip-ipcore/

[8]

T. Johnson, S. Muthukrishnan, O. Spatscheck, and D. Srivastava, "Streams, security and scalability," in DBSec, 2005, pp. 1--15.

Digital Library

[9]

J. Kang, J. F. Naughton, and S. Viglas, "Evaluating window joins over unbounded streams," in ICDE, 2003, pp. 341--352.

[10]

T. Miyoshi, H. Kawashima, Y. Terada, and T. Yoshinaga, "A coarse grain reconfigurable processor architecture for stream processing engine," in FPL, 2011, pp. 490--495.

Digital Library

[11]

T. Moscibroda and O. Mutlu, "A case for bufferless routing in on-chip networks," in ISCA, 2009, pp. 196--207.

Digital Library

[12]

Y. Oge, T. Miyoshi, H. Kawashima, and T. Yoshinaga, "An implementation of handshake join on FPGA," in ICNC, 2011, pp. 95--104.

Digital Library

[13]

Y. Oge, T. Miyoshi, H. Kawashima, and T. Yoshinaga, "Design and implementation of a handshake join architecture on FPGA," IEICE Transactions, vol. 95-D, no. 12, pp. 2919--2927, 2012.

[14]

Y. Oge, T. Miyoshi, H. Kawashima, and T. Yoshinaga, "Design and implementation of a merging network architecture for handshake join operator on FPGA," in MCSoC, 2012, pp. 84--91.

Digital Library

[15]

N. Tatbul, U. Çetintemel, S. B. Zdonik, M. Cherniack, and M. Stonebraker, "Load shedding in a data stream manager," in VLDB, 2003, pp. 309--320.

Digital Library

[16]

Y. Terada, T. Miyoshi, H. Kawashima, and T. Yoshinaga, "A consideration of window join operator over data streams by using FPGA (in Japanese)," in IEICE Tech. Rep., 2011, pp. 181--186.

[17]

J. Teubner and R. Mueller, "How soccer players would do stream joins," in SIGMOD, 2011, pp. 625--636.

Digital Library

Cited By

Cao BRoss KEdwards SKim M(2017)Deadlock-free joins in DB-mesh, an asynchronous systolic array acceleratorProceedings of the 13th International Workshop on Data Management on New Hardware10.1145/3076113.3076118(1-8)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1145/3076113.3076118
Roy PTeubner JGemulla R(2014)Low-latency handshake joinProceedings of the VLDB Endowment10.14778/2732939.27329447:9(709-720)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.14778/2732939.2732944
Oge YYoshimi MMiyoshi TKawashima HIrie HYoshinaga T(2013)An Efficient and Scalable Implementation of Sliding-Window Aggregate Operator on FPGAProceedings of the 2013 First International Symposium on Computing and Networking10.1109/CANDAR.2013.23(112-121)Online publication date: 4-Dec-2013
https://dl.acm.org/doi/10.1109/CANDAR.2013.23

Recommendations

Design and Implementation of a Merging Network Architecture for Handshake Join Operator on FPGA
MCSOC '12: Proceedings of the 2012 IEEE 6th International Symposium on Embedded Multicore SoCs

A novel merging network architecture is proposed for a handshake join operator in order to achieve much higher data throughput than ever before. Handshake join is a highly parallelized algorithm for window-based stream joins. Result collection performed ...
An Implementation of Handshake Join on FPGA
ICNC '11: Proceedings of the 2011 Second International Conference on Networking and Computing

This paper shows an implementation of handshake join on field-programmable gate array (FPGA). Handshake join is one of stream join algorithms, proposed by Teubner and Mueller. It can support very high degrees of parallelism and attain unprecedented ...
FPGA Implementation of an Adaptive Noise Canceller
ISIP '08: Proceedings of the 2008 International Symposiums on Information Processing

This paper proposes an FPGA implementation of an Adaptive Noise Canceller using the Least Mean Square (LMS) algorithm. The hardware architecture is synthesized using the Xilinx Spartan-3e Starter Kit as the target board. The experimental result of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SSDBM '13: Proceedings of the 25th International Conference on Scientific and Statistical Database Management

July 2013

401 pages

ISBN:9781450319218

DOI:10.1145/2484838

Copyright © 2013 Copyright is held by the owner/author(s).

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2013

Check for updates

Qualifiers

Research-article

Funding Sources

KAKENHI

Conference

SSDBM '13

SSDBM '13: Conference on Scientific and Statistical Database Management

July 29 - 31, 2013

Maryland, Baltimore, USA

Acceptance Rates

Overall Acceptance Rate 56 of 146 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao BRoss KEdwards SKim M(2017)Deadlock-free joins in DB-mesh, an asynchronous systolic array acceleratorProceedings of the 13th International Workshop on Data Management on New Hardware10.1145/3076113.3076118(1-8)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1145/3076113.3076118
Roy PTeubner JGemulla R(2014)Low-latency handshake joinProceedings of the VLDB Endowment10.14778/2732939.27329447:9(709-720)Online publication date: 1-May-2014
https://dl.acm.org/doi/10.14778/2732939.2732944
Oge YYoshimi MMiyoshi TKawashima HIrie HYoshinaga T(2013)An Efficient and Scalable Implementation of Sliding-Window Aggregate Operator on FPGAProceedings of the 2013 First International Symposium on Computing and Networking10.1109/CANDAR.2013.23(112-121)Online publication date: 4-Dec-2013
https://dl.acm.org/doi/10.1109/CANDAR.2013.23

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents