Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Curvilinear object segmentation in medical images based on ODoS filter and deep learning network

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Automatic segmentation of curvilinear objects in medical images plays an important role in the diagnosis and evaluation of human diseases, yet it is a challenging uncertainty in the complex segmentation tasks due to different issues such as various image appearances, low contrast between curvilinear objects and their surrounding backgrounds, thin and uneven curvilinear structures, and improper background illumination conditions. To overcome these challenges, we present a unique curvilinear structure segmentation framework based on an oriented derivative of stick (ODoS) filter and a deep learning network for curvilinear object segmentation in medical images. Currently, a large number of deep learning models emphasize developing deep architectures and ignore capturing the structural features of curvilinear objects, which may lead to unsatisfactory results.In consequence, a new approach that incorporates an ODoS filter as part of a deep learning network is presented to improve the spatial attention of curvilinear objects.Specifically, the input image is transferred into four-channel image constructed by the ODoS filter. In which, the original image is considered the principal part to describe various image appearance and complex background illumination conditions, a multi-step strategy is used to enhance the contrast between curvilinear objects and their surrounding backgrounds, and a vector field is applied to discriminate thin and uneven curvilinear structures. Subsequently, a deep learning framework is employed to extract various structural features for curvilinear object segmentation in medical images.Which can effectively capture the spatial attention of curvature objects. The performance of the computational model is validated in experiments conducted on the publicly available DRIVE, STARE and CHASEDB1 datasets. Compared with ground truths, the presented model acquired high F1 values of 0.826, 0.819 and 0.808, and high accuracy of 0.969, 0.973, and 0.973 on three different datasets, respectively. The experimental results indicate that the presented model yields surprising results compared with those of some state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data Availability

Data underlying the results presented in this paper are available in Ref. [37], Ref. [38] and Ref. [39].

References

  1. Kv R, Pasad K, Yegneswaran PP (2023) Segmentation and classification approaches of clinically relevant curvilinear structures: a review. J Med Syst 47(1):40

    Article  Google Scholar 

  2. Straton, N. (2022) COVID vaccine stigma: detecting stigma across social media platforms with computational model based on deep learning. Appl Intell, pp 1–26

  3. Yang D, Peng B, Al-Huda Z, Malik A, Zhai D (2022) An overview of edge and object contour detection. Neurocomputing. https://doi.org/10.1016/j.neucom.2022.02.079

    Article  Google Scholar 

  4. Ekström AM, Berggren C, Tomson G, Gostin LO, Friberg P, Ottersen OP (2021) The battle for COVID-19 vaccines highlights the need for a new global governance mechanism. Nature Medicine 27(5):739–740

    Article  Google Scholar 

  5. Lian L, Luo X, Pan C, Huang J, Hong W, Xu Z (2022) Lung image segmentation based on DRD U-Net and combined WGAN with Deep Neural Network. Computer Methods and Programs in Biomedicine 226:107097

    Article  Google Scholar 

  6. Li Z, Ma L, Long X, Chen Y, Deng H, Yan F, Gu Q (2021) Hardware-oriented algorithm for high-speed laser centerline extraction based on hessian matrix. IEEE Transactions on Instrumentation and Measurement 70:1–14

    Google Scholar 

  7. Jia D, Zhuang X (2021) Learning-based algorithms for vessel tracking: a review. Computerized Medical Imaging and Graphics 89:101840

    Article  Google Scholar 

  8. Dong J, Ai D, Fan J et al (2021) Local-global active contour model based on tensor-based representation for 3D ultrasound vessel segmentation. Phys Med Biol 66(11):115017

    Article  Google Scholar 

  9. Wang C, Oda M, Hayashi Y, Yoshino Y, Yamamoto T, Frangi AF, Mori K (2020) Tensor-cut: A tensor-based graph-cut blood vessel segmentation method and its application to renal artery segmentation. Medical Image Analysis 60:101623

    Article  Google Scholar 

  10. Peng Y, Xiao C (2018) An oriented derivative of stick filter and post-processing segmentation algorithms for pulmonary fissure detection in CT images. Biomedical Signal Processing and Control 43:278–288

    Article  Google Scholar 

  11. Zhao H, Stoel BC, Staring M, Bakker M, Stolk J, Zhou P, Xiao C (2020) A framework for pulmonary fissure segmentation in 3D CT images using a directional derivative of plate filter. Signal Processing 173:107602

    Article  Google Scholar 

  12. Liu Y (2021) Automatically structuralize the curvilinear glacier using Phase-Coded convolution. IEEE Geoscience and Remote Sensing Letters 19:1–5

    Google Scholar 

  13. Sheka DD, Pylypovskyi OV, Volkov OM, Yershov KV, Kravchuk VP, Makarov D (2022) Fundamentals of curvilinear ferromagnetism: statics and dynamics of geometrically curved wires and narrow ribbons. Small 18(12):2105219

    Article  Google Scholar 

  14. Gharleghi R, Chen N, Sowmya A, Beier S (2022) Towards automated coronary artery segmentation: A systematic review. Computer Methods and Programs in Biomedicine 107015. https://doi.org/10.1016/j.cmpb.2022.107015

  15. Braiki M, Benzinou A, Nasreddine K, Hymery N (2020) Automatic human dendritic cells segmentation using K-means clustering and chan-vese active contour model. Computer Methods and Programs in Biomedicine 195:105520

    Article  Google Scholar 

  16. Li D, Bei L, Bao J, Yuan S, Huang K (2021) Image contour detection based on improved level set in complex environment. Wireless Networks 27(7):4389–4402

    Article  Google Scholar 

  17. Roy R, Mazumdar S, Chowdhury AS. (2020) MDL-IWS: multi-view deep learning with iterative watershed for pulmonary fissure segmentation. In 2020 42nd Annual international conference of the IEEE engineering in medicine & biology society (EMBC) 1282–1285

  18. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2020) Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Transactions on Medical Imaging 39(6):1856–1867

    Article  Google Scholar 

  19. Yan Q, Gu Y, Zhao J, Wu W, Ma Y, Liu J, Zhang J, Zhao Y (2023) Automatic choroid layer segmentation in OCT images via context efficient adaptive network. Appl Intell 53:5554–5566

    Google Scholar 

  20. Zhang C, Lu J, Yang L, Li C (2021) CAAGP: Rethinking channel attention with adaptive global pooling for liver tumor segmentation. Comput Biol Med 138:104875

    Article  Google Scholar 

  21. Peng L, Lin L, Cheng P, He H, Tang X. (2022) Student becomes decathlon master in retinal vessel segmentation via dual-teacher multi-target domain adaptation. Machine Learning in Medical Imaging: 13th International Workshop MICCAI 2022: 32-42

  22. Yang J, Tao Y, Xu Q, Zhang Y, Ma X, Yuan S, Chen Q (2022) Self-supervised sequence recovery for semi-supervised retinal layer segmentation[J]. IEEE J Biomed Health Inform 26(8):3872–3883

    Article  Google Scholar 

  23. Li Y, Zhang Y, Liu JY, Wang K, Zhang K, Zhang G, Liao X, Yang G. (2022) Global transformer and dual local attention network via deep-shallow hierarchical feature fusion for retinal vessel segmentation. IEEE Transactions on Cybernetics

  24. Playout C, Duval R, Boucher MC, Cheriet F (2022) Focused attention in transformers for interpretable classification of retinal images. Medical Image Analysis 82:102608

    Article  Google Scholar 

  25. Xu X, Nguyen MC, Yazici Y, Lu K, Min H, Foo CS (2022) SemiCurv: semi-supervised curvilinear structure segmentation. IEEE Transactions on Image Processing 31:5109–5120

    Article  Google Scholar 

  26. Mou L, Zhao Y, Fu H et al (2021) CS2-Net: Deep learning segmentation of curvilinear structures in medical imaging. Medical Image Analysis 67:101874

    Article  Google Scholar 

  27. Alvarado-Carrillo DE, Ovalle-Magallanes E, Dalmau-Cedeño OS (2021) D-GaussianNet: adaptive distorted gaussian matched filter with convolutional neural network for retinal vessel segmentation. Geometry and Vision: First International Symposium, ISGV 2021. Auckland, New Zealand, Springer International Publishing 2021:378–392

    Google Scholar 

  28. Shi T, Boutry N, Xu Y, Geraud T (2022) Local intensity order transformation for robust curvilinear object segmentation. IEEE Transactions on Image Processing 31:2557–2569

    Article  Google Scholar 

  29. Pu J, Leader JK, Sechrist J, Beeche CA, Singh JP, Ocak IK, Risbano MG (2022) Automated identification of pulmonary arteries and veins depicted in non-contrast chest CT scans. Medical Image Analysis 77:102367

    Article  Google Scholar 

  30. Xiao C, Stoel BC, Bakker ME, Peng Y, Stolk J, Staring M (2016) Pulmonary fissure detection in CT images using a derivative of stick filter. IEEE Transactions on Medical Imaging 35(6):1488–1500

    Article  Google Scholar 

  31. Peng Y, Luan P, Tu H, Xiong Li, Zhou P (2023) Pulmonary fissure segmentation in CT images based on ODoS filter and shape features. Multimedia Tools and Applications 1–22. https://doi.org/10.1007/s11042-023-14931-y

  32. Liu L, Wang M, Zhou S, Cohen ShuM, LD, Chen D. (2023) Curvilinear structure tracking based on dynamic curvature-penalized geodesics. Pattern Recognition 134:109079

  33. Ma D, Lu D, Chen S et al (2021) LF-UNet-a novel anatomical-aware dual-branch cascaded deep neural network for segmentation of retinal layers and fluid from optical coherence tomography images. Computerized Medical Imaging and Graphics 94:101988

    Article  Google Scholar 

  34. Li L, Verma M, Nakashima Y et al (2020) Iternet: Retinal image segmentation utilizing structural redundancy in vessel networks. In Proceedings of the IEEE/CVF winter conference on applications of computer vision 2020:3656–3665

    Google Scholar 

  35. Barua PD, Chan WY, Dogan S et al (2021) Multilevel deep feature generation framework for automated detection of retinal abnormalities using OCT images. Entropy 23(12):1651

    Article  Google Scholar 

  36. Kobat S.G., Baygin N., Yusufoglu E. et al (2022) Automated diabetic retinopathy detection using horizontal and vertical patch division-based pre-trained DenseNET with digital fundus images. Diagnostics 12(8):1975

    Article  Google Scholar 

  37. Staal J, Abràmoff MD, Niemeijer M, Viergever MA, Ginneken BV (2004) Ridge-based vessel segmentation in color images of the retina. IEEE Transactions on Medical Imaging 23(4):501–509

  38. Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Transactions on Medical imaging 19(3):203–210

    Article  Google Scholar 

  39. Owen CG, Rudnicka AR, Mullen R et al (2009) Measuring retinal vessel tortuosity in 10-year-old children: validation of the computer-assisted image analysis of the retina (CAIAR) program. Investigative Ophthalmology & Visual Science 50(5):2004–2010

    Article  Google Scholar 

  40. Sha Y, Zhang Y, Ji X,Hu L. (2021) Transformer-Unet: Raw Image Processing with Unet. arXiv:2109.08417

  41. Cao H, Wang Y, Chen J, Jiang D, Zhang X, Wang M, Swin-unet: Unet-like pure transformer for medical image segmentation. Computer Vision-ECCV, (2022) Workshops: Tel Aviv. Israel, Springer Nature Switzerland 2023:205–218

  42. Chen J, Lu Y, Yu Q, Luo X, Adeli E, Wang Y, Lu L, Yuille AL, Zhou Y. (2021) Transunet: Transformers make strong encoders for medical image segmentation. arXiv:2102.04306

  43. Al-Antari MA, Hua CH, Bang J, Lee S (2021) Fast deep learning computer-aided diagnosis of COVID-19 based on digital chest x-ray images. Applied Intelligence 51(5):2890–2907

    Article  Google Scholar 

  44. Guo S (2022) CSGNet: Cascade semantic guided net for retinal vessel segmentation. Biomedical Signal Processing and Control 78:103930

    Article  Google Scholar 

  45. Pal SK, Pramanik A, Maiti J, Mitra P (2021) Deep learning in multi-object detection and tracking: state of the art. Appl Intell 51(9):6400–6429

    Article  Google Scholar 

  46. Abdulwahab S, Rashwan HA, Garcia MA, Masoumian A, Puig D (2022) Monocular depth map estimation based on a multi-scale deep architecture and curvilinear saliency feature boosting. Neural Computing and Applications 34(19):16423–16440

    Article  Google Scholar 

Download references

Funding

This research was supported by the Jiangxi Provincial Natural Science Foundation (nos. 20212BAB202007, 20202BAB212004, 20204BCJL23035, 20192ACB21004, 20181BAB202017), the Hunan Provincial Natural Science Foundation (no. 2021JJ30165), the Hunan Special Funds for the Construction of Innovative Province(Huxiang High-level Talent Gathering Project-Innovative talents) (no. 2019RS1072), the Educational Science Research Project of China Institute of communications Education (no. JTYB20-33), the Scientific and Technological Research Project of Education Department in Jiangxi Province (nos. GJJ190356, GJJ210645) and the Science and Technology project of Changsha City (no. kq2001014).

Author information

Authors and Affiliations

  1. School of Electrical and Automation Engineering, East China Jiaotong University, 330000, Nanchang, People’s Republic of China

    Yuanyuan Peng, Lin Pan, Pengpeng Luan & Hongbin Tu

  2. School of Computer Science, Northwestern Polytechnical University, 710000, Xi’An, People’s Republic of China

    Yuanyuan Peng

  3. School of Software, East China Jiaotong University, 330000, NanChang, People’s Republic of China

    Xiong Li

Authors
  1. Yuanyuan Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lin Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pengpeng Luan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongbin Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuanyuan Peng.

Ethics declarations

Conflicts of interest

The authors declare no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peng, Y., Pan, L., Luan, P. et al. Curvilinear object segmentation in medical images based on ODoS filter and deep learning network. Appl Intell 53, 23470–23481 (2023). https://doi.org/10.1007/s10489-023-04773-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-023-04773-4

Keywords

Search

Navigation