Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Deep-learning based system for effective and automatic blood vessel segmentation from Retinal fundus images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The segmentation of blood vessels through color fundus images is a difficult and time-consuming task that requires experienced clinicians. Recently, researchers have shown that blood vessel segmentation using methods based on deep neural networks has achieved highly satisfactory results. This motivates us to employ a fast and accurate deep learning-based method that can be used in blood vessel segmentation. Five improved deep learning-based networks (U-Net, DenseU-Net, LadderNet, R2U-Net, and ATTU-Net), along with an enhanced customized R2-ATT U-Net deep learning network, have been employed to segment the retinal blood vessel tree. Segmentation using patches extraction is executed, where we have used 10,000 patches per image, in total, 8000 for training and 2000 for testing public benchmark STARE dataset images. Initially, we performed the training, followed by testing for all six models using the patch extraction approach. All the aspects of the testing phase (test log, ROC curve, precision recall curves, and confusion matrix) and statistical performance measuring metrics (accuracy, sensitivity, specificity, F1 score, precision, and AUC values) are covered in this work and are also shown in the form of tables and graphs. An in-depth performance evaluation analysis of these six implemented improved nets has been performed to evaluate the segmentation process. We got the best result in the case of LadderNet, with an accuracy of 0.971, which is comparable to recent state-of-the-art studies. In terms of accuracy, the enhanced customized R2-ATT U-Net deep learning network is also highly satisfactory, being near the best model, LadderNet. The experiment results demonstrate that the proposed methodology achieves satisfactory performance in the retinal blood vessel extraction domain and can help ophthalmologists predict many eye-related diseases at a preliminary stage.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25

Similar content being viewed by others

References

  1. Annunziata R, Garzelli A, Ballerini L, Mecocci A, Trucco E (2016) Leveraging multiscale hessian-based enhancement with a novel exudate inpainting technique for retinal vessel segmentation. IEEE J Biomed Health Inform 20:1129–1138

    Google Scholar 

  2. Argüello F, Vilariño DL, Heras DB, Nieto A (2018) GPU-based segmentation of retinal blood vessels. J Real-Time Image Proc 14(4):773–782

    Google Scholar 

  3. Asl ME, Koohbanani NA, Frangi AF, Gooya A (2017) Tracking and diameter estimation of retinal vessels using Gaussian process and Radon transform. J Med Imaging 4(3):034006

    Google Scholar 

  4. Biswal B, Pooja T, Subrahmanyam NB (2018) Robust retinal blood vessel segmentation using line detectors with multiple masks. IET Image Proc 12:389–399

    Google Scholar 

  5. Biswas R, Vasan A, Roy SS (2020) Dilated deep neural network for segmentation of retinal blood vessels in fundus images. Iran J Sci Technol Trans Electr Eng 44(1):505–518

    Google Scholar 

  6. Budak Ü, Cömert Z, Çıbuk M, Şengür A (2020) DCCMED-Net: Densely connected and concatenated multi Encoder-Decoder CNNs for retinal vessel extraction from fundus images. Med Hypotheses 134:109426

    Google Scholar 

  7. Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848

    Google Scholar 

  8. Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv:1706.05587

  9. Dai L, Fang R, Li H, Hou X, Sheng B, Wu Q, Jia W (2018) Clinical report guided retinal microaneurysm detection with multi-sieving deep learning. IEEE Trans Med Imaging 37(5):1149–1161

    Google Scholar 

  10. Dong H, Zhang T, Zhang T, Wei L (2022) Supervised learning-based retinal vascular segmentation by m-unet full convolutional neural network. SIViP 16(7):1755–1761

    Google Scholar 

  11. Fan Z, Lu J, Wei C, Huang H, Cai X, Chen X (2018) A hierarchical image matting model for blood vessel segmentation in fundus images. IEEE Trans Image Process 28(5):2367–2377

    MathSciNet  Google Scholar 

  12. Feng S, Zhuo Z, Pan D, Tian Q (2020) CcNet: a cross-connected convolutional network for segmenting retinal vessels using multi-scale features. Neurocomputing 392:268–276

    Google Scholar 

  13. Franklin SW, Rajan SE (2014) Computerized screening of diabetic retinopathy employing blood vessel segmentation in retinal images. Biocybern Biomed Eng 34(2):117–124

    Google Scholar 

  14. Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59:2538–2548

    Google Scholar 

  15. Fu H, Xu Y, Lin S, Kee Wong DW, Liu J (2016) Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. In International conference on medical image computing and computer-assisted intervention (pp. 132–139). Springer, Cham

  16. Gegundez-Arias ME, Marin-Santos D, Perez-Borrero I, Vasallo-Vazquez MJ (2021) A new deep learning method for blood vessel segmentation in retinal images based on convolutional kernels and modified U-Net model. Comput Methods Programs Biomed 205:106081

    Google Scholar 

  17. Girard F, Kavalec C, Cheriet F (2019) Joint segmentation and classification of retinal arteries/veins from fundus images. Artif Intell Med 94:96–109

    Google Scholar 

  18. Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Liu J (2019) CE-net: context encoder network for 2Dmedical image segmentation. IEEE Trans Med Imaging 38:2281–2292

    Google Scholar 

  19. Guo Y, Budak Ü, Şengür A (2018) A novel retinal vessel detection approach based on multiple deep convolution neural networks. Comput Methods Programs Biomed 167:43–48

    Google Scholar 

  20. Guo Y, Budak Ü, Vespa LJ, Khorasani E, Şengür A (2018) A retinal vessel detection approach using convolution neural network with reinforcement sample learning strategy. Measurement 125:586–591

    Google Scholar 

  21. Guo F, Li W, Kuang Z, Tang J (2021) MES-Net: a new network for retinal image segmentation. Multimed Tools Appl 80(10):14767–14788

    Google Scholar 

  22. Guo S, Wang K, Kang H, Zhang Y, Gao Y, Li T (2019) BTS-DSN: Deeply supervised neural network with short connections for retinal vessel segmentation. Int J Med Informatics 126:105–113

    Google Scholar 

  23. Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, ... & Larochelle H (2017) Brain tumor segmentation with deep neural networks. Medical image analysis 35:18–31

  24. Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imaging 19(3):203–210

    Google Scholar 

  25. Hu K, Zhang Z, Niu X, Zhang Y, Cao C, Xiao F, Gao X (2018) Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function. Neurocomputing 309:179–191

    Google Scholar 

  26. Hussain S, Guo F, Li W, Shen Z (2022) DilUnet: A U-net based architecture for blood vessels segmentation. Comput Methods Prog Biomed 218:106732

  27. Iang Y, Yao H, Wu C, Liu W (2020) A multi-scale residual attention network for retinal vessel segmentation. Symmetry 13(1):24

    Google Scholar 

  28. Jayachandran A, Shunmugarathinam G, Perumal TSR (2022) Retinal vessels segmentation of colour fundus images using two stages cascades convolutional neural networks. J Ambient Intell Humanized Comput:1–11

  29. Jiang Z, Zhang H, Wang Y, Ko SB (2018) Retinal blood vessel segmentation using fully convolutional network with transfer learning. Comput Med Imaging Graph 68:1–15

    Google Scholar 

  30. Jin Q, Chen Q, Meng Z, Wang B, Su R (2020) Construction of retinal vessel segmentation models based on convolutional neural network. Neural Process Lett 52:1005–1022

    Google Scholar 

  31. Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R (2019) DUNet: A deformable network for retinal vessel segmentation. Knowl-Based Syst 178:149–162

    Google Scholar 

  32. Khan MAU, Soomro TA, Khan TM, Bailey DG, Gao J, Mir N (2016) Automatic retinal vessel extraction algorithm based on contrast-sensitive schemes. In International Conference on Image and Vision Computing New Zealand (IVCNZ). (pp. 1–5). https://doi.org/10.1109/IVCNZ.2016.7804441

  33. Leopold HA, Orchard J, Zelek JS, Lakshminarayanan V (2019) PixelBNN: augmenting the PixelCNN with batch normalization and the presentation of a fast architecture for retinal vessel segmentation. J Imaging 5(2):26

    Google Scholar 

  34. Li X, Ding J, Tang J, Guo F (2022) Res2Unet: a multi-scale channel attention network for retinal vessel segmentation. Neural Comput Appl 34(14):12001–12015

  35. Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2015) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging 35(1):109–118

    Google Scholar 

  36. Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2016) A crossmodality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging 35:109–118

    Google Scholar 

  37. Lin Y, Zhang H, Hu G (2018) Automatic retinal vessel segmentation via deeply supervised and smoothly regularized network. IEEE Access 7:57717–57724

    Google Scholar 

  38. Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imaging 35(11):2369–2380

    Google Scholar 

  39. Liu Q, Hong X, Li S, Chen Z, Guo Y, Zou B (2019) A spatial-aware joint optic disc and cup segmentation method. Neurocomputing 359:285–297

    Google Scholar 

  40. Lu J, Xu Y, Chen M, Luo Y (2018) A coarse-to-fine fully convolutional neural network for fundus vessel segmentation. Symmetry 10(11):607

    Google Scholar 

  41. Lupascu CA, Tegolo D, Trucco E (2010) Fabc: retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14:1267–1274

    Google Scholar 

  42. Lv Y, Ma H, Li J, Liu S (2020) Attention guided U-net with Atrous convolution for accurate retinal vessels segmentation. IEEE Access 8:32826–32839

    Google Scholar 

  43. Marin D, Aquino A, Gegundez-Arias ME, Bravo JM (2011) A new supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features. IEEE Trans Med Imaging 30:146–158

    Google Scholar 

  44. Melinscak M, Prentasic P, Loncaric S (2015) Retinal vessel segmentation using deep neural networks. VISAPP 2015- 10th international conference on computer vision theory and applications, Berlin, Germany, 1: 577-582

  45. Memari N, Ramli AR, Bin Saripan MI, Mashohor S, Moghbel M (2017) Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier. PLoS ONE 12(12):e0188939

    Google Scholar 

  46. Nguyen UTV, Bhuiyan A, Park LAF, Ramamohanarao K (2013) An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern Recogn 46:703–715

    Google Scholar 

  47. Ni J, Wu J, Tong J, Chen Z, Zhao J (2020) GC-net: global context network for medical image segmentation. Comput Methods Prog Biomed 190:105–121

    Google Scholar 

  48. Oliveira A, Pereira S, Silva CA (2018) Retinal vessel segmentation based on fully convolutional neural networks. Expert Syst Appl 112:229–242

    Google Scholar 

  49. Orlando JI, Blaschko M (2014) Learning fully-connected crfs for blood vessel segmentation in retinal images. In Conference on Medical Image Computing and Computer-Assisted Intervention 17:634–641

  50. Orlando JI, Prokofyeva E, Blaschko MB (2017) A discriminatively trained fully connected conditional random field model for blood vessel segmentation in fundus images. IEEE Trans Biomed Eng 64:16–27

    Google Scholar 

  51. Paul R, Hawkins SH, Hall LO, Goldgof DB, Gillies RJ (2016) Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 002570–002575). IEEE

  52. Peng S, Zheng C, Xu F, Xiao H, Nam HD, Wu Y (2018) Blood vessels segmentation by using cdnet. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 305–310). IEEE

  53. Pinz A, Bernogger S, Datlinger P, Kruger A (1998) Mapping the human retina. IEEE Trans Med Imaging 17(4):606–619

    Google Scholar 

  54. Rani P, Priyadarshini N, Rajkumar ER, Rajamani K (2016) Retinal vessel segmentation under pathological conditions using supervised machine learning. In 2016 International Conference on Systems in Medicine and Biology (ICSMB) (pp. 62–66). IEEE

  55. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234–241). Springer, Cham

  56. Roy S, Mitra A, Roy S, Setua SK (2019) Blood vessel segmentation of retinal image using Clifford matched filter and Clifford convolution. Multimed Tools Appl 78:34839–34865

    Google Scholar 

  57. Roy S, Mitra A, Roy S, Setua SK (2019) Blood vessel segmentation of retinal image using Clifford matched filter and Clifford convolution. Multimed Tools Appl 78(24):34839–34865

    Google Scholar 

  58. Roychowdhury S, Koozekanani DD, Parhi KK (2015) Blood vessel segmentation of fundus images by major vessel extraction and subimage classification. IEEE J Biomed Health Inform 19:1118–1128

    Google Scholar 

  59. Sathananthavathi V, Indumathi G (2022) Dilated Deep Neural Architectures for Improving Retinal Vessel Extraction. Wireless Pers Commun 125(4):3641–3659

    Google Scholar 

  60. Sinthanayothin C, Boyce JF, Cook HL, Williamson TH (1999) Automated localisation of the optic disc, fovea, and retinal blood vessels from digital colour fundus images. Br J Ophthalmol 83(8):902–910

    Google Scholar 

  61. Soares JV, Leandro JJ, Cesar RM, Jelinek HF, Cree MJ (2006) Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans Med Imaging 25(9):1214–1222

    Google Scholar 

  62. Song J, Lee B (2017) Development of automatic retinal vessel segmentation method in fundus images via convolutional neural networks. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 681–684). IEEE

  63. Soomro TA, Afifi AJ, Gao J, Hellwich O, Zheng L, Paul M (2019) Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation. Expert Syst Appl 134:36–52

    Google Scholar 

  64. Soomro TA, Gao J, Lihong Z, Afifi AJ, Soomro S, Paul M (2019) Retinal blood vessels extraction of challenging images. Data Mining. AusDM 2018. Communications in Computer and Information Science,Springer, Singapore, 996

  65. Soomro, T. A., Khan, M. A. U., Gao, J., Khan, T. M., Paul, M., & Mir, N. (2016). Automatic retinal vessel extraction algorithm. In International Conference on Digital Image Computing: Techniques and Applications (DICTA) (pp. 1–8). https://doi.org/10.1109/DICTA.2016.7797013.

  66. Soomro TA, Khan TM, Khan MA, Gao J, Paul M, Zheng L (2018) Impact of ica-based image enhancement technique on retinal blood vessels segmentation. IEEE Access 6:3524–3538

  67. Sule O, Viriri S (2022) Contrast enhancement of RGB retinal fundus images for improved segmentation of blood vessels using convolutional neural networks. J Digit Imaging:1–19

  68. Tang P, Liang Q, Yan X, Zhang D, Coppola G, Sun W (2019) Multi-proportion channel ensemble model for retinal vessel segmentation. Comput Biol Med 111:103352

    Google Scholar 

  69. Tchinda BS, Tchiotsop D, Noubom M, Louis-Dorr V, Wolf D (2021) Retinal blood vessels segmentation using classical edge detection filters and the neural network. Inform Med Unlocked 23:100521

    Google Scholar 

  70. Thangaraj S, Periyasamy V, Balaji R (2018) Retinal vessel segmentation using neural network. IET Image Process 12:669–678

    Google Scholar 

  71. Tian C, Fang T, Fan Y, Wu W (2020) Multi-path convolutional neural network in fundus segmentation of blood vessels. Biocybern Biomed Eng 40(2):583–595

    Google Scholar 

  72. Tolias YA, Panas SM (1998) A fuzzy vessel tracking algorithm for retinal images based on fuzzy clustering. IEEE Trans Med Imaging 17(2):263–273

    Google Scholar 

  73. Uysal E, Güraksin GE (2021) Computer-aided retinal vessel segmentation in retinal images: convolutional neural networks. Multimed Tools Appl 80(3):3505–3528

    Google Scholar 

  74. Uysal E, Güraksin GE (2021) Computer-aided retinal vessel segmentation in retinal images: convolutional neural networks. Multimed Tools Appl 80:3505–3528

    Google Scholar 

  75. Wang Y, Ji G, Lin P, Trucco E (2013) Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition. Pattern Recogn 46(8):2117–2133

    Google Scholar 

  76. Wang C, Zhao Z, Ren Q, Xu Y, Yu Y (2019) Dense U-net based on patch-based learning for retinal vessel segmentation. Entropy 21(2):168

    MathSciNet  Google Scholar 

  77. Wu H, Wang W, Zhong J, Lei B, Wen Z, Qin J (2021) Scs-net: A scale and context sensitive network for retinal vessel segmentation. Med Image Anal 70:102025

    Google Scholar 

  78. Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2020) NFN+: a novel network followed network for retinal vessel segmentation. Neural Netw 126:153–162

    Google Scholar 

  79. Xia H, Wu L, Lan Y, Li H, Song S (2022) HRNet: A hierarchical recurrent convolution neural network for retinal vessel segmentation. Multimed Tools Appl 81(28):39829–39851

    Google Scholar 

  80. Xinge Y, Qinmu P, Yuan Y, Yiu-ming C, Jiajia L (2011) Segmentation of retinal blood vessels using the radial projection and semi-supervised approach. Pattern Recogn 44:10–11

    Google Scholar 

  81. Yan Z, Yang X, Cheng KT (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65(9):1912–1923

    Google Scholar 

  82. Yang X, Li Z, Guo Y, Zhou D (2022) DCU-net: a deformable convolutional neural network based on cascade U-net for retinal vessel segmentation. Multimed Tools Appl 81(11):15593–15607

    Google Scholar 

  83. Yang D, Zhao H, Yu K, Geng L (2023) NAUNet: lightweight retinal vessel segmentation network with nested connections and efficient attention. Multimed Tools Appl:1–23

  84. Yao Z, Zhang Z, Xu LQ (2016) Convolutional neural network for retinal blood vessel segmentation. In 2016 9th international symposium on Computational intelligence and design (ISCID) (Vol. 1, pp. 406–409). IEEE

  85. You X, Peng Q, Yuan Y, Cheung YM, Lei J (2011) Segmentation of retinal blood vessels using the radial projection and semi-supervised approach. Pattern Recogn 44(10–11):2314–2324

    Google Scholar 

  86. Yue K, Zou B, Chen Z, Liu Q (2019) Retinal vessel segmentation using dense U-net with multiscale inputs. J Med imaging 6:034004

    Google Scholar 

  87. Zhang J, Dashtbozorg B, Bekkers E, Pluim JPW, Duits R, terHaar Romeny BM (2016) Robust retinal vessel segmentation via locally adaptive derivative frames in orientation scores. IEEE Trans Med Imaging 35:2631–2642

    Google Scholar 

  88. Zhao Y, Rada L, Chen K, Harding SP, Zheng Y (2015) Automated vessel segmentation using infinite perimeter active contour model with hybrid region information with application to retinal images. IEEE Trans Med Imaging 34:1797–1807

    Google Scholar 

  89. Zhao J, Yang J, Ai D, Song H, Jiang Y, Huang Y, ... & Wang Y (2018) Automatic retinal vessel segmentation using multi-scale superpixel chain tracking. Digit Signal Process 81:26–42

  90. Zhu C, Zou B, Zhao R, Cui J, Duan X, Chen Z (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imag Grap 55:68–77

    Google Scholar 

  91. Zhu C, Zou B, Zhao R, Cui J, Duan X, Chen Z, Liang Y (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imaging Graph 55:68–77

    Google Scholar 

  92. Zhuang J (2018) LadderNet: Multi-path networks based on U-Net for medical image segmentation. arXiv preprint arXiv:1810.07810

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Law Kumar Singh.

Ethics declarations

We declare that

a. This manuscript is the authors' original work and has not been published elsewhere.

b. All authors have checked the manuscript and have agreed to the submission.

c. We also declare that we do not have any conflict of interest.

d. This work is not funded by any external or internal or any government funded agency.

e. The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.

f.The dataset analysed during the current study are available in the internet repository, and can also be made available from the corresponding author on reasonable request

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, L.K., Khanna, M., Thawkar, S. et al. Deep-learning based system for effective and automatic blood vessel segmentation from Retinal fundus images. Multimed Tools Appl 83, 6005–6049 (2024). https://doi.org/10.1007/s11042-023-15348-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15348-3

Keywords