Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

MSAMS-Net: accurate lung lesion segmentation from COVID-19 CT images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The coronavirus disease 2019 (COVID-19) has emerged as a global pandemic, inflicting significant harm on the health of humans. A crucial objective in combating this disease is the development of a precise and effective technique for automatically segmenting lung lesions, which can help reduce the risk of severe complications. However, lesion segmentation of COVID-19 from CT slices presents numerous challenges. These challenges include the small size of the lesions and the blurred boundaries observed during the early stages of the disease. Additionally, the limited availability of medical image datasets and the considerable variation in symptoms among patients pose significant tests for the generalization ability of the model. In this paper, we develop a novel Multi-path Shuffle Attention module with a master-slave encoder and decoder network (MSAMS-Net) for lesion segmentation of COVID-19, especially those tiny lesions. In our proposed MSAMS-Net, an Efficient Multi-path Shuffle Attention module is presented to compensate for the lack of detail semantics when fusing over long distances. Moreover, we present a parallel attention module to capture both global and local information. To evaluate the performance of our model, we conduct experiments on four datasets which are collected from seven publicly available datasets. The results demonstrate that our proposed model outperforms other models in terms of Dice scores or Hausdorff Distance. Furthermore, the ablation study greatly proves the significance of the multi-path shuffle attention mechanism module. Overall, our proposed model exhibits superior performance compared to other state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data Availability Statement

All datasets are publicly available on the Web. www.kaggle.com.

References

  1. Chen L, Jin Q, Zhou Y, Yang J, Wang Z, Ge K, Yang J, Wang H (2020) Clinical characteristics of 2019 novel coronavirus pneumonia in Zhejiang province. China, Mol Med Rep

    Book  Google Scholar 

  2. Chang D, Lin M, Wei L, Xie L, Zhu G, Dela Cruz CS, Sharma L (2020) Epidemiologic and clinical characteristics of novel coronavirus infections involving 13 patients outside Wuhan, China. JAMA. PMID: 32031568; PMCID: PMC7042871 323(11):1092-1093. https://doi.org/10.1001/jama.2020.1623. Accessed 17 Mar 2020

  3. Wang W, Tang J, Wei F (2019) Updated understanding of the outbreak of 2019 novel coronavirus 2019-nCoV) in Wuhan, China. J Med Virol (Epub ahead of print). https://doi.org/10.1002/jmv.25689. Accessed 29 Jan 2020

  4. Shi S, Qin M, Shen B et al (2020) Association of cardiac injury with mortality in hospitalized patients with COVID-19 in Wuhan. China. JAMA Cardiol. 5(7):802–810. https://doi.org/10.1001/jamacardio.2020.0950

  5. Özkarafakılı MA, Özkurt H, Bardakçı Mİ, Akıllı IK, Yanç U, Altuntaç Y, Özdemir HM (2022) Comparison of chest computed tomography findings of RT-PCR negative and RT-PCR positive cases in COVID-19 patients. Clin Imaging. Epub 2021 Nov 4. PMID: 34768223; PMCID: PMC8567412, 82:7–12. https://doi.org/10.1016/j.clinimag.2021.10.013

  6. Gottlieb M, Jay A, Mogni B (2022) What is the diagnostic accuracy of chest radiography, ultrasound, and computed tomography for COVID-19? Ann Emerg Med, Epub PMID: 34353652; PMCID: PMC8120448 79(1):64–65. https://doi.org/10.1016/j.annemergmed.2021.05.011. Accessed 14 May 2021

  7. Pan F, Ye T, Sun P et al (2020) Time course of lung changes on chest CT during recovery from 2019 novel coronavirus (COVID-19) pneumonia. Radiology

  8. Rao Y, Lv Q, Zeng S, Yi Y, Huang C, Gao Y, Cheng Z, Sun J (2023) COVID-19 CT ground-glass opacity segmentation based on attention mechanism threshold. Biomed Signal Process Control. PMID: 36505089; PMCID: PMC9721288, 81:104486. https://doi.org/10.1016/j.bspc.2022.1044ub. Accessed 5 Dec 2022

  9. Rahmani AM, Azhir E, Naserbakht M et al (2022) Automatic COVID-19 detection mechanisms and approaches from medical images: a systematic review. Multimed Tool Appl 81(20):28779–28798

    Article  Google Scholar 

  10. Anilkumar B, Srividya K, Mary Sowjanya A (2023) Covid-19 classification using sigmoid based hyper-parameter modified DNN for CT scans and chest X-rays. Multimed Tool Appl 82(8):12513–12536

    Article  Google Scholar 

  11. Shi F , Wang J , Shi J et al (2021) Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for COVID-19. IEEE Rev Biomed Eng (99):1–1

  12. Fan DP, Zhou T, Ji GP et al (2020) Inf-Net: automatic COVID-19 lung infection segmentation from CT images. IEEE Trans Med Imaging (99):1–1

  13. Chen C, Zhou K, Zha M et al (2021) An effective deep neural network for lung lesions segmentation from COVID-19 CT images. IEEE Trans Ind Inform (99):1–1

  14. Wang G, Liu X, Li C et al (2020) A noise-robust framework for automatic segmentation of COVID-19 pneumonia lesions from CT images. IEEE Trans Med Imaging (99):1–1

  15. Huang X, Chen J, Chen M et al (2022) TDD-UNet: transformer with double decoder UNet for COVID-19 lesions segmentation. Comput Biol Med 151:106306

  16. Gao K, Su J, Jiang Z et al (2021) Dual-branch combination network (DCN): Towards accurate diagnosis and lesion segmentation of COVID-19 using CT images. Med Image Anal 67:101836

    Article  Google Scholar 

  17. Aaa B, Rmb C, Hua LD et al (2020) Multi-task deep learning based CT imaging analysis for COVID-19 pneumonia: classification and segmentation. Comput Biol Med 126

  18. Yao Q, Xiao L, Liu P et al (2021) Label-free segmentation of COVID-19 lesions in lung CT. IEEE Trans Med Imaging (99):1–1

  19. Fang C, Liu Y, Liu Y et al (2022) Label-free coronavirus disease 2019 lesion segmentation based on synthetic healthy lung image subtraction. Med Phys 7:49

    Google Scholar 

  20. Das D, Biswas SK, Bandyopadhyay S (2022) Perspective of AI system for COVID-19 detection using chest images: a review. Multimed Tool Appl 81(15):21471–21501

    Article  Google Scholar 

  21. Hu J, Shen L, Albanie S et al (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023

  22. Park J, Woo S, Lee J Y et al (2018) Bam: bottleneck attention module. arXiv:1807.06514

  23. Woo S, Park J, Lee J Y et al (2018) Cbam: convolutional block attention module. Proceedings of the European conference on computer vision (ECCV), pp 3–19

  24. Hou Q, Zhou D, Feng J (2021) Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 13713–13722

  25. Zhang H, Zu K, Lu J et al (2022) EPSANet: an efficient pyramid squeeze attention block on convolutional neural network. Proceedings of the Asian conference on computer vision, pp 1161–1177

  26. Oktay O, Schlemper J, Folgoc LL et al (2018) Attention u-net: learning where to look for the pancreas. arXiv:1804.03999

  27. Song X, Guo H, Xu X et al (2021) Cross-modal attention for MRI and ultrasound volume registration. Medical Image Computing and Computer Assisted Intervention-MICCAI 2021 24th International Conference, Strasbourg, France, September 27-October 1, 2021, Proceedings, Part IV 24. Springer International Publishing 2021:66–75

  28. Chen J, Lu Y, Yu Q et al (2021) Transunet: transformers make strong encoders for medical image segmentation. arXiv:2102.04306

  29. Azad R, Arimond R, Aghdam EK et al (2022) DAE-Former: dual attention-guided efficient transformer for medical image segmentation[J]. arXiv:2212.13504

  30. Jha A, Kumar A, Pande S et al (2020) MT-UNET: a novel u-net based multi-task architecture for visual scene understanding. 2020 IEEE Int Conf Image Process (ICIP), IEEE, pp 2191–2195

  31. Singh L K, Khanna M, Thawkar S et al (2023) Deep-learning based system for effective and automatic blood vessel segmentation from Retinal fundus images. Multimed Tool Appl pp1–45

  32. Ukwuoma CC, Qin Z, Agbesi VK et al (2022) Dual_Pachi: attention-based dual path framework with intermediate second order-pooling for Covid-19 detection from chest X-ray images. Comput Biol Med 151:106324

  33. Vupputuri A, Gupta A, Ghosh N (2021) MCA-DN: Multi-path convolution leveraged attention deep network for salvageable tissue detection in ischemic stroke from multi-parametric MRI. Comput Biol Med 136:104724

    Article  Google Scholar 

  34. Wang S, Jiang A, Li X et al (2022) DPBET: a dual-path lung nodules segmentation model based on boundary enhancement and hybrid transformer. Comput Biol Med 151:106330

  35. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention-MICCAI. 18th Int Conf, Munich, Germany, Proceedings, Part III 18. Springer International Publishing pp 234–241. Accessed 5–9 Oct 2015

  36. Wang H, Cao P, Wang J et al (2022) Uctransnet: rethinking the skip connections in u-net from a channel-wise perspective with transformer. Proceedings of the AAAI conference on artificial intelligence, 36(3): 2441–2449

  37. Liu K, Kang G, Zhang N et al (2018) Breast cancer classification based on fully-connected layer first convolutional neural networks. IEEE Access 6:23722–23732

  38. Zhang Q L, Yang YB (2021) Sa-net: shuffle attention for deep convolutional neural networks. ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp 2235–2239

  39. Morozov S et al (2020) MosMedData: chest CT scans with COVID-19 Related findings dataset. arXiv:2005.06465

  40. Jun M et al (2020) COVID-19 CT Lung and Infection Segmentation Dataset. Zenodo, Apr, vol 20

  41. COVID-19 (2020) [Online] http://medicalsegmentation.com/covid19. Accessed 23 Dec 2020

  42. Guyon I (1997) A scaling law for the validation-set training-set size ratio. AT &T Bell Laboratories, 1(11)

  43. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980

  44. Gu Z, Cheng J, Fu H et al (2019) Ce-net: context encoder network for 2d medical image segmentation. IEEE Trans Med Imaging 38(10):2281–2292

  45. Alom MZ, Hasan M, Yakopcic C et al (2018) Recurrent residual convolutional neural network based on u-net (r2u-net) for medical image segmentation. arXiv:1802.06955

  46. Xiao X, Lian S, Luo Z et al (2018) Weighted res-unet for high-quality retina vessel segmentation. 2018 9th Int Conf Inform Technol Med Educ (ITME). IEEE, 327–331

  47. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495

  48. Zhou Z, Rahman Siddiquee MM, Tajbakhsh N et al Unet++: a nested u-net architecture for medical image segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, Proceedings 4. Springer International Publishing, 2018: 3–11. Accessed 20 Sep 2018

  49. Valanarasu JMJ, Patel VM (2022) Unext: Mlp-based rapid medical image segmentation network. Medical Image Computing and Computer Assisted Intervention-MICCAI, 25th International Conference, Singapore, Proceedings. Part V. Cham: Springer Nature Switzerland 2022:23–33. Accessed 18–22 Sep 2022

  50. Lyu B, Haque A (2018) Deep learning based tumor type classification using gene expression data. Proceedings of the 2018 ACM international conference on bioinformatics, computational biology, and health informatics, pp 89–96

  51. Selvaraju RR, Cogswell M, Das A et al (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision, pp 618–626

  52. Khanna M, Singh LK, Thawkar S et al (2023:) Deep learning based computer-aided automatic prediction and grading system for diabetic retinopathy. Multimed Tool Appl pp 1–48

Download references

Acknowledgements

This work is supported in part by the National Natural Science Foundation of China under grant No. 61672084.

Author information

Authors and Affiliations

  1. College of Information and Technology, Beijing University of Chemical Technology, 100029, Beijing, China

    Zhengyu Wang & Haijiang Zhu

  2. Department of Function Test, First Teaching Hospital of Tianjin University of Tradition Chinese Medicine, 300193, Tianjin, China

    Xiaoyu Gao

Authors
  1. Zhengyu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haijiang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaoyu Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Haijiang Zhu.

Ethics declarations

Conflict of Interests

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Z., Zhu, H. & Gao, X. MSAMS-Net: accurate lung lesion segmentation from COVID-19 CT images. Multimed Tools Appl 83, 82849–82870 (2024). https://doi.org/10.1007/s11042-024-18735-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18735-6

Keywords

Search

Navigation