Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3431920.3439291acmconferencesArticle/Chapter ViewAbstractPublication PagesfpgaConference Proceedingsconference-collections
research-article

A Framework for Customizable FPGA-based Image Registration Accelerators

Published: 17 February 2021 Publication History

Abstract

Image Registration is a highly compute-intensive optimization procedure that determines the geometric transformation to align a floating image to a reference one. Generally, the registration targets are images taken from different time instances, acquisition angles, and/or sensor types. Several methodologies are employed in the literature to address the limiting factors of this class of algorithms, among which hardware accelerators seem the most promising solution to boost performance. However, most hardware implementations are either closed-source or tailored to a specific context, limiting their application to different fields. For these reasons, we propose an open-source hardware-software framework to generate a configurable architecture for the most compute-intensive part of registration algorithms, namely the similarity metric computation. This metric is the Mutual Information, a well-known calculus from the Information Theory, used in several optimization procedures. Through different design parameters configurations, we explore several design choices of our highly-customizable architecture and validate it on multiple FPGAs. We evaluated various architectures against an optimized Matlab implementation on an Intel Xeon Gold, reaching a speedup up to 2.86x, and remarkable performance and power efficiency against other state-of-the-art approaches.

Supplementary Material

MP4 File (3431920.3439291.mp4)
Presentation Video

References

[1]
Zeynettin Akkus, Alfiia Galimzianova, Assaf Hoogi, Daniel L Rubin, and Bradley J Erickson. 2017. Deep learning for brain MRI segmentation: state of the art and future directions. Journal of Digital Imaging, Vol. 30, 4 (2017), 449--459.
[2]
MA Aswathy and M Jagannath. 2017. Detection of breast cancer on digital histopathology images: Present status and future possibilities. Informatics in Medicine Unlocked, Vol. 8 (2017), 74--79.
[3]
Lalit Bahl, Peter Brown, Peter De Souza, and Robert Mercer. 1986. Maximum mutual information estimation of hidden Markov model parameters for speech recognition. In ICASSP'86. IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 11. IEEE, 49--52.
[4]
Anton Bardera, Miquel Feixas, Imma Boada, Jaume Rigau, and Mateu Sbert. 2006. Medical image registration based on BSP and quad-tree partitioning. In International Workshop on Biomedical Image Registration. Springer, 1--8.
[5]
Youcef Bentoutou, Nasreddine Taleb, Kidiyo Kpalma, and Joseph Ronsin. 2005. An automatic image registration for applications in remote sensing. IEEE Transactions on Geoscience and Remote Sensing, Vol. 43, 9 (2005), 2127--2137.
[6]
Lisa Gottesfeld Brown. 1992. A survey of image registration techniques. ACM Computing Surveys (CSUR), Vol. 24, 4 (1992), 325--376.
[7]
Atul J Butte and Isaac S Kohane. 1999. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. In Biocomputing 2000. World Scientific, 418--429.
[8]
Carlos R Castro-Pareja, Jogikal M Jagadeesh, and Raj Shekhar. 2003. FAIR: a hardware architecture for real-time 3-D image registration. IEEE Transactions on Information Technology in Biomedicine, Vol. 7, 4 (2003), 426--434.
[9]
Shifu Chen, Jing Qin, Yongming Xie, Wai-Man Pang, and Pheng-Ann Heng. 2009. CUDA-based acceleration and algorithm refinement for volume image registration. In 2009 International Conference on Future BioMedical Information Engineering (FBIE). IEEE, 544--547.
[10]
Kenneth Clark, Bruce Vendt, Kirk Smith, John Freymann, Justin Kirby, Paul Koppel, Stephen Moore, Stanley Phillips, David Maffitt, Michael Pringle, et almbox. 2013. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. Journal of digital imaging, Vol. 26, 6 (2013), 1045--1057.
[11]
Davide Conficconi, Eleonora D'Arnese, Emanuele Del Sozzo, Donatella Sciuto, and Marco D. Santambrogio. 2020. A Framework for Customizable FPGA-based Image Registration Accelerators. https://github.com/necst/iron. https://doi.org/10.5281/zenodo.4432762
[12]
Thomas M Cover and Joy A Thomas. 2012. Elements of information theory. John Wiley & Sons.
[13]
Omkar Dandekar, William Plishker, Shuvra Bhattacharyya, and Raj Shekhar. 2008. Multiobjective optimization of FPGA-based medical image registration. In 2008 16th International Symposium on Field-Programmable Custom Computing Machines. IEEE, 183--192.
[14]
Omkar Dandekar and Raj Shekhar. 2007. FPGA-accelerated deformable image registration for improved target-delineation during CT-guided interventions. IEEE Transactions on Biomedical Circuits and Systems, Vol. 1, 2 (2007), 116--127.
[15]
Pablo A Estévez, Michel Tesmer, Claudio A Perez, and Jacek M Zurada. 2009. Normalized mutual information feature selection. IEEE Transactions on Neural Networks, Vol. 20, 2 (2009), 189--201.
[16]
James D Foley, Foley Dan Van, Andries Van Dam, Steven K Feiner, John F Hughes, Edward Angel, and J Hughes. 1996. Computer graphics: principles and practice. Vol. 12110. Addison-Wesley Professional.
[17]
Derek LG Hill and David J Hawkes. 2000. Across-modality registration using intensity-based cost functions. Handbook of Medical Imaging: Processing and Analysis (2000), 537--553.
[18]
Kei Ikeda, Fumihiko Ino, and Kenichi Hagihara. 2014. Efficient acceleration of mutual information computation for nonrigid registration using CUDA. IEEE Journal of Biomedical and Health Informatics, Vol. 18, 3 (2014), 956--968.
[19]
Ryan Kastner, Janarbek Matai, and Stephen Neuendorffer. 2018. Parallel programming for FPGAs. arXiv preprint arXiv:1805.03648 (2018).
[20]
Taejung Kim and Yong-Jo Im. 2003. Automatic satellite image registration by combination of matching and random sample consensus. IEEE Transactions on Geoscience and Remote Sensing, Vol. 41, 5 (2003), 1111--1117.
[21]
Flavio Lichtenstein, Fernando Antoneli, and Marcelo RS Briones. 2015. MIA: Mutual Information Analyzer, a graphic user interface program that calculates entropy, vertical and horizontal mutual information of molecular sequence sets. BMC Bioinformatics, Vol. 16, 1 (2015), 409.
[22]
Bradley Christopher Lowekamp, David T Chen, Luis Ibá nez, and Daniel Blezek. 2013. The design of SimpleITK. Frontiers in neuroinformatics, Vol. 7 (2013), 45.
[23]
Frederik Maes, Andre Collignon, Dirk Vandermeulen, Guy Marchal, and Paul Suetens. 1997. Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging, Vol. 16, 2 (1997), 187--198.
[24]
Inc MathWorks. 1994-2020. MATLAB, Image Processing Toolbox. https://mathworks.com/products/image.html
[25]
National Cancer Institute Clinical Proteomic Tumor Analysis Consortium (CPTAC). 2018. Radiology Data from the Clinical Proteomic Tumor Analysis Consortium Lung Adenocarcinoma [CPTAC-LUAD] collection [Data set]. The Cancer Imaging Archive (2018). https://doi.org/10.7937/k9/tcia.2018.pat12tbs
[26]
Francisco PM Oliveira and Joao Manuel RS Tavares. 2014. Medical image registration: a review. Computer Methods in Biomechanics and Biomedical Engineering, Vol. 17, 2 (2014), 73--93.
[27]
Ramtin Shams, Parastoo Sadeghi, Rodney Kennedy, and Richard Hartley. 2010a. Parallel computation of mutual information on the GPU with application to real-time registration of 3D medical images. Computer methods and programs in biomedicine, Vol. 99, 2 (2010), 133--146.
[28]
Ramtin Shams, Parastoo Sadeghi, Rodney A Kennedy, and Richard I Hartley. 2010b. A survey of medical image registration on multicore and the GPU . IEEE Signal Processing Magazine, Vol. 27, 2 (2010), 50--60.
[29]
Ioannis Stratakos, Dimitrios Gourounas, Vasileios Tsoutsouras, Theodore Economopoulos, George Matsopoulos, and Dimitrios Soudris. 2019. Hardware Acceleration of Image Registration Algorithm on FPGA-based Systems on Chip. In Proceedings of the International Conference on Omni-Layer Intelligent Systems. 92--97.
[30]
Colin Studholme. 1997. Measures of 3D medical image alignment. Ph.D. Dissertation. University of London.
[31]
Martin Styner, Christian Brechbuhler, G Szckely, and Guido Gerig. 2000. Parametric estimate of intensity inhomogeneities applied to MRI. IEEE transactions on medical imaging, Vol. 19, 3 (2000), 153--165.
[32]
Petra A Van den Elsen, E-JD Pol, and Max A Viergever. 1993. Medical image matching-a review with classification. IEEE Engineering in Medicine and Biology Magazine, Vol. 12, 1 (1993), 26--39.
[33]
Paul Viola and William M Wells III. 1997. Alignment by maximization of mutual information. International Journal of Computer Vision, Vol. 24, 2 (1997), 137--154.
[34]
Peiyuan Wang, Yong Fan, Lingfei Lu, Lu Liu, Lingling Fan, Mengyao Zhao, Yang Xie, Congjian Xu, and Fan Zhang. 2018. NIR-II nanoprobes in-vivo assembly to improve image-guided surgery for metastatic ovarian cancer. Nature Communications, Vol. 9, 1 (2018), 1--10.
[35]
Xilinx. 2016. PYNQ: Python for Productivity for ZYNQ. http://www.pynq.io/.
[36]
Ziv Yaniv, Bradley C Lowekamp, Hans J Johnson, and Richard Beare. 2018. SimpleITK image-analysis notebooks: a collaborative environment for education and reproducible research. Journal of digital imaging, Vol. 31, 3 (2018), 290--303.
[37]
Xiyang Zhi, Junhua Yan, Yiqing Hang, and Shunfei Wang. 2019. Realization of CUDA-based real-time registration and target localization for high-resolution video images. Journal of Real-Time Image Processing, Vol. 16, 4 (2019), 1025--1036.

Cited By

View all
  • (2024)DONGLE 2.0: Direct FPGA-Orchestrated NVMe Storage for HLSACM Transactions on Reconfigurable Technology and Systems10.1145/365003817:3(1-32)Online publication date: 5-Mar-2024
  • (2023) Hephaestus: Codesigning and Automating 3D Image Registration on Reconfigurable ArchitecturesACM Transactions on Embedded Computing Systems10.1145/360792822:5s(1-24)Online publication date: 31-Oct-2023
  • (2023)Faber: A Hardware/SoftWare Toolchain for Image RegistrationIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.321889834:1(291-303)Online publication date: 1-Jan-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
FPGA '21: The 2021 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays
February 2021
240 pages
ISBN:9781450382182
DOI:10.1145/3431920
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 February 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. domain specific accelerator
  2. fpgas
  3. image registration
  4. mutual information
  5. reconfigurable computing

Qualifiers

  • Research-article

Conference

FPGA '21
Sponsor:

Acceptance Rates

Overall Acceptance Rate 125 of 627 submissions, 20%

Upcoming Conference

FPGA '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)74
  • Downloads (Last 6 weeks)8
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)DONGLE 2.0: Direct FPGA-Orchestrated NVMe Storage for HLSACM Transactions on Reconfigurable Technology and Systems10.1145/365003817:3(1-32)Online publication date: 5-Mar-2024
  • (2023) Hephaestus: Codesigning and Automating 3D Image Registration on Reconfigurable ArchitecturesACM Transactions on Embedded Computing Systems10.1145/360792822:5s(1-24)Online publication date: 31-Oct-2023
  • (2023)Faber: A Hardware/SoftWare Toolchain for Image RegistrationIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.321889834:1(291-303)Online publication date: 1-Jan-2023
  • (2023)ATHENA: a GPU-based Framework for Biomedical 3D Rigid Image Registration2023 IEEE Biomedical Circuits and Systems Conference (BioCAS)10.1109/BioCAS58349.2023.10388589(1-5)Online publication date: 19-Oct-2023
  • (2023)Starlight: A kernel optimizer for GPU processingJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104832(104832)Online publication date: Dec-2023
  • (2022)Pushing the Level of Abstraction of Digital System Design: A Survey on How to Program FPGAsACM Computing Surveys10.1145/353298955:5(1-48)Online publication date: 3-Dec-2022
  • (2022)FPGA HLS Today: Successes, Challenges, and OpportunitiesACM Transactions on Reconfigurable Technology and Systems10.1145/353077515:4(1-42)Online publication date: 8-Aug-2022
  • (2022)Surfing the Wavefront of Genome Alignment2022 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS48785.2022.9937706(1754-1758)Online publication date: 28-May-2022
  • (2021)Hardware Architectures for Real-Time Medical ImagingElectronics10.3390/electronics1024311810:24(3118)Online publication date: 15-Dec-2021
  • (2021)Enhancing the Scalability of Multi-FPGA Stencil Computations via Highly Optimized HDL ComponentsACM Transactions on Reconfigurable Technology and Systems10.1145/346147814:3(1-33)Online publication date: 12-Aug-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media