research-article

Cerebrovascular Segmentation in TOF-MRA with Topology Regularization Adversarial Model

Authors:

Huansheng Ning,

Ruoxiu XiaoAuthors Info & Claims

MM '23: Proceedings of the 31st ACM International Conference on Multimedia

Pages 4250 - 4259

https://doi.org/10.1145/3581783.3611718

Published: 27 October 2023 Publication History

Abstract

Time-of-flight magnetic resonance angiography (TOF-MRA) is a common cerebrovascular imaging. Accurate and automatic cerebrovascular segmentation in TOF-MRA images is an important auxiliary method in clinical practice. Due to the complex semantics and noise interference, the existing segmentation methods often fail to pay attention to topological correlation, resulting in the neglect of branch vessels and vascular topology destruction. In this paper, we proposed a topology regularization adversarial model for cerebrovascular segmentation in TOF-MRA images. Firstly, we trained a self-supervised model to learn spatial semantic layout in TOF-MRA images by image context restoration. Subsequently, we exploited initialization based on the self-supervised model and constructed an adversarial model to accomplish parameter optimization. Considering the limitations of uneven distribution of cerebrovascular classes, we introduced skeleton structures as discriminative features to enhance vessel topological strength. We constructed some latest models to test our method over two datasets. Results show that the proposed model attains the highest score. Therefore, our method can obtain accurate connectivity information and higher graph similarity, leading more meaningful clinical utility.

References

[1]

Sebastian Bock and Martin Weiß. 2019. A proof of local convergence for the Adam optimizer. In 2019 international joint conference on neural networks (IJCNN). IEEE, 1--8.

[2]

Arnaud Boutillon, Bhushan Borotikar, Valérie Burdin, and Pierre-Henri Conze. 2022. Multi-structure bone segmentation in pediatric MR images with combined regularization from shape priors and adversarial network. Artificial Intelligence in Medicine, Vol. 132 (2022), 102364.

Digital Library

[3]

Krishna Chaitanya, Ertunc Erdil, Neerav Karani, and Ender Konukoglu. 2020. Contrastive learning of global and local features for medical image segmentation with limited annotations. Advances in neural information processing systems, Vol. 33 (2020), 12546--12558.

[4]

Eric R Chan, Connor Z Lin, Matthew A Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J Guibas, Jonathan Tremblay, Sameh Khamis, et al. 2022. Efficient geometry-aware 3D generative adversarial networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 16123--16133.

[5]

Cheng Chen, Bo Liu, Kangneng Zhou, Wanzhang He, Fei Yan, Zhiliang Wang, and Ruoxiu Xiao. 2021a. CSR-Net: Cross-Scale Residual Network for multi-objective scaphoid fracture segmentation. Computers in Biology and Medicine, Vol. 137 (2021), 104776.

Digital Library

[6]

Cheng Chen, Siyu Qi, Kangneng Zhou, Tong Lu, Huansheng Ning, and Ruoxiu Xiao. 2023 a. Pairwise attention-enhanced adversarial model for automatic bone segmentation in CT images. Physics in Medicine and Biology (2023).

[7]

Cheng Chen, Kangneng Zhou, Xiaoyu Guo, Zhiliang Wang, Ruoxiu Xiao, and Guangzhi Wang. 2022c. Cerebrovascular segmentation in phase-contrast magnetic resonance angiography by multi-feature fusion and vessel completion. Computerized Medical Imaging and Graphics, Vol. 98 (2022), 102070.

[8]

Cheng Chen, Kangneng Zhou, Tong Lu, Huansheng Ning, and Ruoxiu Xiao. 2023 b. Integration-and separation-aware adversarial model for cerebrovascular segmentation from TOF-MRA. Computer Methods and Programs in Biomedicine, Vol. 233 (2023), 107475.

Digital Library

[9]

Cheng Chen, Kangneng Zhou, Siyu Qi, Tong Lu, and Ruoxiu Xiao. 2023 c. A learnable Gabor Convolution kernel for vessel segmentation. Computers in Biology and Medicine (2023), 106892.

[10]

Cheng Chen, Kangneng Zhou, Zhiliang Wang, and Ruoxiu Xiao. 2023 d. Generative Consistency for Semi-Supervised Cerebrovascular Segmentation From TOF-MRA. IEEE Transactions on Medical Imaging, Vol. 42, 2 (2023), 346--353. https://doi.org/10.1109/TMI.2022.3184675

[11]

Cheng Chen, Kangneng Zhou, Zhiliang Wang, Qian Zhang, and Ruoxiu Xiao. 2023 e. All Answers Are in the Images: A Review of Deep Learning for Cerebrovascular Segmentation. Computerized Medical Imaging and Graphics (2023), 102229.

[12]

Cheng Chen, Kangneng Zhou, Muxi Zha, Xiangyan Qu, Xiaoyu Guo, Hongyu Chen, Zhiliang Wang, and Ruoxiu Xiao. 2021b. An effective deep neural network for lung lesions segmentation from COVID-19 CT images. IEEE Transactions on Industrial Informatics, Vol. 17, 9 (2021), 6528--6538.

[13]

Liang Chen, Paul Bentley, Kensaku Mori, Kazunari Misawa, Michitaka Fujiwara, and Daniel Rueckert. 2019. Self-supervised learning for medical image analysis using image context restoration. Medical image analysis, Vol. 58 (2019), 101539.

[14]

Ying Chen, Darui Jin, Bin Guo, and Xiangzhi Bai. 2022a. Attention-Assisted Adversarial Model for Cerebrovascular Segmentation in 3D TOF-MRA Volumes. IEEE Transactions on Medical Imaging, Vol. 41, 12 (2022), 3520--3532.

[15]

Zan Chen, Lei Xie, Yukai Chen, Qingrun Zeng, Qichuan ZhuGe, Jiakai Shen, Caiyun Wen, and Yuanjing Feng. 2022b. Generative adversarial network based cerebrovascular segmentation for time-of-flight magnetic resonance angiography image. Neurocomputing, Vol. 488 (2022), 657--668.

Digital Library

[16]

Yunjey Choi, Youngjung Uh, Jaejun Yoo, and Jung-Woo Ha. 2020. Stargan v2: Diverse image synthesis for multiple domains. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 8188--8197.

[17]

Qiaosong Chu, Shuyan Li, Guangyi Chen, Kai Li, and Xiu Li. 2023. Adversarial Alignment for Source Free Object Detection. arXiv preprint arXiv:2301.04265 (2023).

[18]

Özgün Çiçek, Ahmed Abdulkadir, Soeren S Lienkamp, Thomas Brox, and Olaf Ronneberger. 2016. 3D U-Net: learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer-Assisted Intervention--MICCAI 2016: 19th International Conference, Athens, Greece, October 17-21, 2016, Proceedings, Part II 19. Springer, 424--432.

Digital Library

[19]

Katherine R Gray, Robin Wolz, Rolf A Heckemann, Paul Aljabar, Alexander Hammers, Daniel Rueckert, Alzheimer's Disease Neuroimaging Initiative, et al. 2012. Multi-region analysis of longitudinal FDG-PET for the classification of Alzheimer's disease. NeuroImage, Vol. 60, 1 (2012), 221--229.

[20]

Xiaoyu Guo, Ruoxiu Xiao, Tao Zhang, Cheng Chen, Jiayu Wang, and Zhiliang Wang. 2020. A novel method to model hepatic vascular network using vessel segmentation, thinning, and completion. Medical & biological engineering & computing, Vol. 58 (2020), 709--724.

[21]

Ali Hatamizadeh, Yucheng Tang, Vishwesh Nath, Dong Yang, Andriy Myronenko, Bennett Landman, Holger R Roth, and Daguang Xu. 2022. Unetr: Transformers for 3d medical image segmentation. In Proceedings of the IEEE/CVF winter conference on applications of computer vision. 574--584.

[22]

Tabea Kossen, Pooja Subramaniam, Vince I Madai, Anja Hennemuth, Kristian Hildebrand, Adam Hilbert, Jan Sobesky, Michelle Livne, Ivana Galinovic, Ahmed A Khalil, et al. 2021. Synthesizing anonymized and labeled TOF-MRA patches for brain vessel segmentation using generative adversarial networks. Computers in biology and medicine, Vol. 131 (2021), 104254.

[23]

Rayan Krishnan, Pranav Rajpurkar, and Eric J Topol. 2022. Self-supervised learning in medicine and healthcare. Nature Biomedical Engineering (2022), 1--7.

[24]

David Lesage, Elsa D Angelini, Isabelle Bloch, and Gareth Funka-Lea. 2009. A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes. Medical image analysis, Vol. 13, 6 (2009), 819--845.

[25]

Michelle Livne, Jana Rieger, Orhun Utku Aydin, Abdel Aziz Taha, Ela Marie Akay, Tabea Kossen, Jan Sobesky, John D Kelleher, Kristian Hildebrand, Dietmar Frey, et al. 2019. A U-Net deep learning framework for high performance vessel segmentation in patients with cerebrovascular disease. Frontiers in neuroscience, Vol. 13 (2019), 97.

[26]

Jun Ma, Jianan Chen, Matthew Ng, Rui Huang, Yu Li, Chen Li, Xiaoping Yang, and Anne L Martel. 2021. Loss odyssey in medical image segmentation. Medical Image Analysis, Vol. 71 (2021), 102035.

[27]

Fausto Milletari, Nassir Navab, and Seyed-Ahmad Ahmadi. 2016. V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV). Ieee, 565--571.

[28]

Shervin Minaee, Yuri Boykov, Fatih Porikli, Antonio Plaza, Nasser Kehtarnavaz, and Demetri Terzopoulos. 2021. Image segmentation using deep learning: A survey. IEEE transactions on pattern analysis and machine intelligence, Vol. 44, 7 (2021), 3523--3542.

[29]

Palak Patel, Seyyed Mostafa Mousavi Janbeh Sarayi, Danyang Chen, Adam L Hammond, Robert J Damiano, Jason M Davies, Jinhui Xu, and Hui Meng. 2021. Fast virtual coiling algorithm for intracranial aneurysms using pre-shape path planning. Computers in biology and medicine, Vol. 134 (2021), 104496.

[30]

Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention--MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18. Springer, 234--241.

[31]

Ali Sarrami-Foroushani, Toni Lassila, Michael MacRaild, Joshua Asquith, Kit CB Roes, James V Byrne, and Alejandro F Frangi. 2021. In-silico trial of intracranial flow diverters replicates and expands insights from conventional clinical trials. Nature communications, Vol. 12, 1 (2021), 3861.

[32]

Suprosanna Shit, Johannes C Paetzold, Anjany Sekuboyina, Ivan Ezhov, Alexander Unger, Andrey Zhylka, Josien PW Pluim, Ulrich Bauer, and Bjoern H Menze. 2021. clDice-a novel topology-preserving loss function for tubular structure segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 16560--16569.

[33]

Pooja Subramaniam, Tabea Kossen, Kerstin Ritter, Anja Hennemuth, Kristian Hildebrand, Adam Hilbert, Jan Sobesky, Michelle Livne, Ivana Galinovic, Ahmed A Khalil, et al. 2022. Generating 3D TOF-MRA volumes and segmentation labels using generative adversarial networks. Medical Image Analysis, Vol. 78 (2022), 102396.

[34]

Hiroki Tsuda and Kazuhiro Hotta. 2019. Cell image segmentation by integrating pix2pixs for each class. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 0-0.

[35]

Yan Wang, Xu Wei, Fengze Liu, Jieneng Chen, Yuyin Zhou, Wei Shen, Elliot K Fishman, and Alan L Yuille. 2020. Deep distance transform for tubular structure segmentation in ct scans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3833--3842.

[36]

Qian Wu, Yufei Chen, Ning Huang, and Xiaodong Yue. 2022. Weakly-supervised cerebrovascular segmentation network with shape prior and model indicator. In Proceedings of the 2022 International Conference on Multimedia Retrieval. 668--676.

Digital Library

[37]

Likun Xia, Hao Zhang, Yufei Wu, Ran Song, Yuhui Ma, Lei Mou, Jiang Liu, Yixuan Xie, Ming Ma, and Yitian Zhao. 2022. 3D vessel-like structure segmentation in medical images by an edge-reinforced network. Medical Image Analysis, Vol. 82 (2022), 102581.

[38]

Yuan Xue, Tao Xu, Han Zhang, L Rodney Long, and Xiaolei Huang. 2018. Segan: Adversarial network with multi-scale l 1 loss for medical image segmentation. Neuroinformatics, Vol. 16 (2018), 383--392.

[39]

Siyi Xun, Dengwang Li, Hui Zhu, Min Chen, Jianbo Wang, Jie Li, Meirong Chen, Bing Wu, Hua Zhang, Xiangfei Chai, et al. 2022. Generative adversarial networks in medical image segmentation: a review. Computers in Biology and Medicine, Vol. 140 (2022), 105063.

Digital Library

[40]

Chenyu You, Weicheng Dai, Fenglin Liu, Haoran Su, Xiaoran Zhang, Lawrence Staib, and James S Duncan. 2022a. Mine your own anatomy: Revisiting medical image segmentation with extremely limited labels. arXiv preprint arXiv:2209.13476 (2022).

[41]

Chenyu You, Weicheng Dai, Yifei Min, Fenglin Liu, Xiaoran Zhang, Chen Feng, David A Clifton, S Kevin Zhou, Lawrence Hamilton Staib, and James S Duncan. 2023 a. Rethinking semi-supervised medical image segmentation: A variance-reduction perspective. arXiv preprint arXiv:2302.01735 (2023).

[42]

Chenyu You, Weicheng Dai, Yifei Min, Lawrence Staib, and James S Duncan. 2023 b. Bootstrapping semi-supervised medical image segmentation with anatomical-aware contrastive distillation. In International Conference on Information Processing in Medical Imaging. Springer, 641--653.

Digital Library

[43]

Chenyu You, Weicheng Dai, Yifei Min, Lawrence Staib, Jas Sekhon, and James S Duncan. 2023 c. Action: Improving semi-supervised medical image segmentation with adaptive anatomical contrast. arXiv preprint arXiv:2304.02689 (2023).

[44]

Chenyu You, Ruihan Zhao, Fenglin Liu, Siyuan Dong, Sandeep Chinchali, Ufuk Topcu, Lawrence Staib, and James Duncan. 2022b. Class-aware adversarial transformers for medical image segmentation. Advances in Neural Information Processing Systems, Vol. 35 (2022), 29582--29596.

[45]

Chenyu You, Ruihan Zhao, Lawrence H Staib, and James S Duncan. 2022c. Momentum contrastive voxel-wise representation learning for semi-supervised volumetric medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, 639--652.

Digital Library

[46]

Chenyu You, Yuan Zhou, Ruihan Zhao, Lawrence Staib, and James S Duncan. 2022d. Simcvd: Simple contrastive voxel-wise representation distillation for semi-supervised medical image segmentation. IEEE Transactions on Medical Imaging, Vol. 41, 9 (2022), 2228--2237.

[47]

Hao Zhang, Likun Xia, Ran Song, Jianlong Yang, Huaying Hao, Jiang Liu, and Yitian Zhao. 2020. Cerebrovascular segmentation in MRA via reverse edge attention network. In Medical Image Computing and Computer Assisted Intervention-MICCAI 2020: 23rd International Conference, Lima, Peru, October 4-8, 2020, Proceedings, Part VI 23. Springer, 66--75.

Digital Library

[48]

Junxi Zhu, Spencer Teolis, Nadia Biassou, Amy Tabb, Pierre-Emmanuel Jabin, and Orit Lavi. 2020. Tracking the adaptation and compensation processes of patients' brain arterial network to an evolving glioblastoma. IEEE transactions on pattern analysis and machine intelligence, Vol. 44, 1 (2020), 488--501.

Cited By

Yu SLi COsman YWang SZheng H(2024)Accurate Delineation of Cerebrovascular Structures from TOF-MRA with Connectivity-Reinforced Deep LearningMachine Learning in Medical Imaging10.1007/978-3-031-73284-3_28(280-289)Online publication date: 23-Oct-2024
https://doi.org/10.1007/978-3-031-73284-3_28
Alshenoudy ASabrowsky-Hirsch BScharinger JThumfart SGiretzlehner M(2024)Towards Segmenting Cerebral Arteries from Structural MRIMedical Image Understanding and Analysis10.1007/978-3-031-66955-2_2(19-33)Online publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-66955-2_2

Index Terms

Cerebrovascular Segmentation in TOF-MRA with Topology Regularization Adversarial Model
1. Applied computing
  1. Life and medical sciences
    1. Health informatics

Recommendations

Integration- and separation-aware adversarial model for cerebrovascular segmentation from TOF-MRA
Highlights
- An integration- and separation-aware adversarial model for segmentation.
- Image separation to focus on texture and edge awareness in feature space.
- Diversified discriminations enhance the model robust.
- Experiments and ...
Abstract Purpose
Cerebrovascular segmentation from time-of-flight magnetic resonance angiography (TOF-MRA) is important but challenging for the simulation and measurement of cerebrovascular diseases. Recently, deep learning has promoted the rapid ...
Generative adversarial network based cerebrovascular segmentation for time-of-flight magnetic resonance angiography image
Abstract
The accurate segmentation of cerebral vessels from time-of-flight magnetic resonance angiography (TOF-MRA) data is crucial for the diagnosis and treatment of cerebrovascular diseases. However, cerebrovascular segmentation remains ...
SS-Net: 3D Spatial-Spectral Network for Cerebrovascular Segmentation in TOF-MRA
Artificial Neural Networks and Machine Learning – ICANN 2023
Abstract
The extraction of cerebrovascular structure plays a pivotal role in the diagnosis and analysis of various cerebrovascular diseases. However, cerebrovascular segmentation from time-of-flight magnetic resonance angiography (TOF-MRA) volumes remains ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '23: Proceedings of the 31st ACM International Conference on Multimedia

October 2023

9913 pages

ISBN:9798400701085

DOI:10.1145/3581783

General Chairs:
Abdulmotaleb El Saddik
University of Ottawa, Canada & MBZUAI, UAE
,
Tao Mei
HiDream.ai, China
,
Rita Cucchiara
University of Modena and Reggio Emilia, Italy
,
Program Chairs:
Marco Bertini
University of Florence, Italy
,
Diana Patricia Tobon Vallejo
Unversidad de Medellin, Colombia
,
Pradeep K. Atrey
University at Albany, State University of New York, USA
,
M. Shamim Hossain
M. Shamim Hossain (King Saud University, KSA

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
Major Science and Technology Project of Zhejiang Province Health Commission
China Postdoctoral Science Foundation
Fundamental Research Funds for the Central Universities
Non-profit Central Research Institute Fund of Chinese Academy of Medical Sciences

Conference

MM '23

Sponsor:

SIGMM

MM '23: The 31st ACM International Conference on Multimedia

October 29 - November 3, 2023

Ottawa ON, Canada

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)239
Downloads (Last 6 weeks)9

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu SLi COsman YWang SZheng H(2024)Accurate Delineation of Cerebrovascular Structures from TOF-MRA with Connectivity-Reinforced Deep LearningMachine Learning in Medical Imaging10.1007/978-3-031-73284-3_28(280-289)Online publication date: 23-Oct-2024
https://doi.org/10.1007/978-3-031-73284-3_28
Alshenoudy ASabrowsky-Hirsch BScharinger JThumfart SGiretzlehner M(2024)Towards Segmenting Cerebral Arteries from Structural MRIMedical Image Understanding and Analysis10.1007/978-3-031-66955-2_2(19-33)Online publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-66955-2_2

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents