Abstract
The segmentation of blood vessels through color fundus images is a difficult and time-consuming task that requires experienced clinicians. Recently, researchers have shown that blood vessel segmentation using methods based on deep neural networks has achieved highly satisfactory results. This motivates us to employ a fast and accurate deep learning-based method that can be used in blood vessel segmentation. Five improved deep learning-based networks (U-Net, DenseU-Net, LadderNet, R2U-Net, and ATTU-Net), along with an enhanced customized R2-ATT U-Net deep learning network, have been employed to segment the retinal blood vessel tree. Segmentation using patches extraction is executed, where we have used 10,000 patches per image, in total, 8000 for training and 2000 for testing public benchmark STARE dataset images. Initially, we performed the training, followed by testing for all six models using the patch extraction approach. All the aspects of the testing phase (test log, ROC curve, precision recall curves, and confusion matrix) and statistical performance measuring metrics (accuracy, sensitivity, specificity, F1 score, precision, and AUC values) are covered in this work and are also shown in the form of tables and graphs. An in-depth performance evaluation analysis of these six implemented improved nets has been performed to evaluate the segmentation process. We got the best result in the case of LadderNet, with an accuracy of 0.971, which is comparable to recent state-of-the-art studies. In terms of accuracy, the enhanced customized R2-ATT U-Net deep learning network is also highly satisfactory, being near the best model, LadderNet. The experiment results demonstrate that the proposed methodology achieves satisfactory performance in the retinal blood vessel extraction domain and can help ophthalmologists predict many eye-related diseases at a preliminary stage.
Similar content being viewed by others
References
Annunziata R, Garzelli A, Ballerini L, Mecocci A, Trucco E (2016) Leveraging multiscale hessian-based enhancement with a novel exudate inpainting technique for retinal vessel segmentation. IEEE J Biomed Health Inform 20:1129–1138
Argüello F, Vilariño DL, Heras DB, Nieto A (2018) GPU-based segmentation of retinal blood vessels. J Real-Time Image Proc 14(4):773–782
Asl ME, Koohbanani NA, Frangi AF, Gooya A (2017) Tracking and diameter estimation of retinal vessels using Gaussian process and Radon transform. J Med Imaging 4(3):034006
Biswal B, Pooja T, Subrahmanyam NB (2018) Robust retinal blood vessel segmentation using line detectors with multiple masks. IET Image Proc 12:389–399
Biswas R, Vasan A, Roy SS (2020) Dilated deep neural network for segmentation of retinal blood vessels in fundus images. Iran J Sci Technol Trans Electr Eng 44(1):505–518
Budak Ü, Cömert Z, Çıbuk M, Şengür A (2020) DCCMED-Net: Densely connected and concatenated multi Encoder-Decoder CNNs for retinal vessel extraction from fundus images. Med Hypotheses 134:109426
Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848
Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv:1706.05587
Dai L, Fang R, Li H, Hou X, Sheng B, Wu Q, Jia W (2018) Clinical report guided retinal microaneurysm detection with multi-sieving deep learning. IEEE Trans Med Imaging 37(5):1149–1161
Dong H, Zhang T, Zhang T, Wei L (2022) Supervised learning-based retinal vascular segmentation by m-unet full convolutional neural network. SIViP 16(7):1755–1761
Fan Z, Lu J, Wei C, Huang H, Cai X, Chen X (2018) A hierarchical image matting model for blood vessel segmentation in fundus images. IEEE Trans Image Process 28(5):2367–2377
Feng S, Zhuo Z, Pan D, Tian Q (2020) CcNet: a cross-connected convolutional network for segmenting retinal vessels using multi-scale features. Neurocomputing 392:268–276
Franklin SW, Rajan SE (2014) Computerized screening of diabetic retinopathy employing blood vessel segmentation in retinal images. Biocybern Biomed Eng 34(2):117–124
Fraz MM, Remagnino P, Hoppe A, Uyyanonvara B, Rudnicka AR, Owen CG, Barman SA (2012) An ensemble classification-based approach applied to retinal blood vessel segmentation. IEEE Trans Biomed Eng 59:2538–2548
Fu H, Xu Y, Lin S, Kee Wong DW, Liu J (2016) Deepvessel: Retinal vessel segmentation via deep learning and conditional random field. In International conference on medical image computing and computer-assisted intervention (pp. 132–139). Springer, Cham
Gegundez-Arias ME, Marin-Santos D, Perez-Borrero I, Vasallo-Vazquez MJ (2021) A new deep learning method for blood vessel segmentation in retinal images based on convolutional kernels and modified U-Net model. Comput Methods Programs Biomed 205:106081
Girard F, Kavalec C, Cheriet F (2019) Joint segmentation and classification of retinal arteries/veins from fundus images. Artif Intell Med 94:96–109
Gu Z, Cheng J, Fu H, Zhou K, Hao H, Zhao Y, Liu J (2019) CE-net: context encoder network for 2Dmedical image segmentation. IEEE Trans Med Imaging 38:2281–2292
Guo Y, Budak Ü, Şengür A (2018) A novel retinal vessel detection approach based on multiple deep convolution neural networks. Comput Methods Programs Biomed 167:43–48
Guo Y, Budak Ü, Vespa LJ, Khorasani E, Şengür A (2018) A retinal vessel detection approach using convolution neural network with reinforcement sample learning strategy. Measurement 125:586–591
Guo F, Li W, Kuang Z, Tang J (2021) MES-Net: a new network for retinal image segmentation. Multimed Tools Appl 80(10):14767–14788
Guo S, Wang K, Kang H, Zhang Y, Gao Y, Li T (2019) BTS-DSN: Deeply supervised neural network with short connections for retinal vessel segmentation. Int J Med Informatics 126:105–113
Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, ... & Larochelle H (2017) Brain tumor segmentation with deep neural networks. Medical image analysis 35:18–31
Hoover AD, Kouznetsova V, Goldbaum M (2000) Locating blood vessels in retinal images by piecewise threshold probing of a matched filter response. IEEE Trans Med Imaging 19(3):203–210
Hu K, Zhang Z, Niu X, Zhang Y, Cao C, Xiao F, Gao X (2018) Retinal vessel segmentation of color fundus images using multiscale convolutional neural network with an improved cross-entropy loss function. Neurocomputing 309:179–191
Hussain S, Guo F, Li W, Shen Z (2022) DilUnet: A U-net based architecture for blood vessels segmentation. Comput Methods Prog Biomed 218:106732
Iang Y, Yao H, Wu C, Liu W (2020) A multi-scale residual attention network for retinal vessel segmentation. Symmetry 13(1):24
Jayachandran A, Shunmugarathinam G, Perumal TSR (2022) Retinal vessels segmentation of colour fundus images using two stages cascades convolutional neural networks. J Ambient Intell Humanized Comput:1–11
Jiang Z, Zhang H, Wang Y, Ko SB (2018) Retinal blood vessel segmentation using fully convolutional network with transfer learning. Comput Med Imaging Graph 68:1–15
Jin Q, Chen Q, Meng Z, Wang B, Su R (2020) Construction of retinal vessel segmentation models based on convolutional neural network. Neural Process Lett 52:1005–1022
Jin Q, Meng Z, Pham TD, Chen Q, Wei L, Su R (2019) DUNet: A deformable network for retinal vessel segmentation. Knowl-Based Syst 178:149–162
Khan MAU, Soomro TA, Khan TM, Bailey DG, Gao J, Mir N (2016) Automatic retinal vessel extraction algorithm based on contrast-sensitive schemes. In International Conference on Image and Vision Computing New Zealand (IVCNZ). (pp. 1–5). https://doi.org/10.1109/IVCNZ.2016.7804441
Leopold HA, Orchard J, Zelek JS, Lakshminarayanan V (2019) PixelBNN: augmenting the PixelCNN with batch normalization and the presentation of a fast architecture for retinal vessel segmentation. J Imaging 5(2):26
Li X, Ding J, Tang J, Guo F (2022) Res2Unet: a multi-scale channel attention network for retinal vessel segmentation. Neural Comput Appl 34(14):12001–12015
Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2015) A cross-modality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging 35(1):109–118
Li Q, Feng B, Xie L, Liang P, Zhang H, Wang T (2016) A crossmodality learning approach for vessel segmentation in retinal images. IEEE Trans Med Imaging 35:109–118
Lin Y, Zhang H, Hu G (2018) Automatic retinal vessel segmentation via deeply supervised and smoothly regularized network. IEEE Access 7:57717–57724
Liskowski P, Krawiec K (2016) Segmenting retinal blood vessels with deep neural networks. IEEE Trans Med Imaging 35(11):2369–2380
Liu Q, Hong X, Li S, Chen Z, Guo Y, Zou B (2019) A spatial-aware joint optic disc and cup segmentation method. Neurocomputing 359:285–297
Lu J, Xu Y, Chen M, Luo Y (2018) A coarse-to-fine fully convolutional neural network for fundus vessel segmentation. Symmetry 10(11):607
Lupascu CA, Tegolo D, Trucco E (2010) Fabc: retinal vessel segmentation using adaboost. IEEE Trans Inf Technol Biomed 14:1267–1274
Lv Y, Ma H, Li J, Liu S (2020) Attention guided U-net with Atrous convolution for accurate retinal vessels segmentation. IEEE Access 8:32826–32839
Marin D, Aquino A, Gegundez-Arias ME, Bravo JM (2011) A new supervised method for blood vessel segmentation in retinal images by using gray-level and moment invariants-based features. IEEE Trans Med Imaging 30:146–158
Melinscak M, Prentasic P, Loncaric S (2015) Retinal vessel segmentation using deep neural networks. VISAPP 2015- 10th international conference on computer vision theory and applications, Berlin, Germany, 1: 577-582
Memari N, Ramli AR, Bin Saripan MI, Mashohor S, Moghbel M (2017) Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier. PLoS ONE 12(12):e0188939
Nguyen UTV, Bhuiyan A, Park LAF, Ramamohanarao K (2013) An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern Recogn 46:703–715
Ni J, Wu J, Tong J, Chen Z, Zhao J (2020) GC-net: global context network for medical image segmentation. Comput Methods Prog Biomed 190:105–121
Oliveira A, Pereira S, Silva CA (2018) Retinal vessel segmentation based on fully convolutional neural networks. Expert Syst Appl 112:229–242
Orlando JI, Blaschko M (2014) Learning fully-connected crfs for blood vessel segmentation in retinal images. In Conference on Medical Image Computing and Computer-Assisted Intervention 17:634–641
Orlando JI, Prokofyeva E, Blaschko MB (2017) A discriminatively trained fully connected conditional random field model for blood vessel segmentation in fundus images. IEEE Trans Biomed Eng 64:16–27
Paul R, Hawkins SH, Hall LO, Goldgof DB, Gillies RJ (2016) Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 002570–002575). IEEE
Peng S, Zheng C, Xu F, Xiao H, Nam HD, Wu Y (2018) Blood vessels segmentation by using cdnet. In 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC) (pp. 305–310). IEEE
Pinz A, Bernogger S, Datlinger P, Kruger A (1998) Mapping the human retina. IEEE Trans Med Imaging 17(4):606–619
Rani P, Priyadarshini N, Rajkumar ER, Rajamani K (2016) Retinal vessel segmentation under pathological conditions using supervised machine learning. In 2016 International Conference on Systems in Medicine and Biology (ICSMB) (pp. 62–66). IEEE
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234–241). Springer, Cham
Roy S, Mitra A, Roy S, Setua SK (2019) Blood vessel segmentation of retinal image using Clifford matched filter and Clifford convolution. Multimed Tools Appl 78:34839–34865
Roy S, Mitra A, Roy S, Setua SK (2019) Blood vessel segmentation of retinal image using Clifford matched filter and Clifford convolution. Multimed Tools Appl 78(24):34839–34865
Roychowdhury S, Koozekanani DD, Parhi KK (2015) Blood vessel segmentation of fundus images by major vessel extraction and subimage classification. IEEE J Biomed Health Inform 19:1118–1128
Sathananthavathi V, Indumathi G (2022) Dilated Deep Neural Architectures for Improving Retinal Vessel Extraction. Wireless Pers Commun 125(4):3641–3659
Sinthanayothin C, Boyce JF, Cook HL, Williamson TH (1999) Automated localisation of the optic disc, fovea, and retinal blood vessels from digital colour fundus images. Br J Ophthalmol 83(8):902–910
Soares JV, Leandro JJ, Cesar RM, Jelinek HF, Cree MJ (2006) Retinal vessel segmentation using the 2-D Gabor wavelet and supervised classification. IEEE Trans Med Imaging 25(9):1214–1222
Song J, Lee B (2017) Development of automatic retinal vessel segmentation method in fundus images via convolutional neural networks. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 681–684). IEEE
Soomro TA, Afifi AJ, Gao J, Hellwich O, Zheng L, Paul M (2019) Strided fully convolutional neural network for boosting the sensitivity of retinal blood vessels segmentation. Expert Syst Appl 134:36–52
Soomro TA, Gao J, Lihong Z, Afifi AJ, Soomro S, Paul M (2019) Retinal blood vessels extraction of challenging images. Data Mining. AusDM 2018. Communications in Computer and Information Science,Springer, Singapore, 996
Soomro, T. A., Khan, M. A. U., Gao, J., Khan, T. M., Paul, M., & Mir, N. (2016). Automatic retinal vessel extraction algorithm. In International Conference on Digital Image Computing: Techniques and Applications (DICTA) (pp. 1–8). https://doi.org/10.1109/DICTA.2016.7797013.
Soomro TA, Khan TM, Khan MA, Gao J, Paul M, Zheng L (2018) Impact of ica-based image enhancement technique on retinal blood vessels segmentation. IEEE Access 6:3524–3538
Sule O, Viriri S (2022) Contrast enhancement of RGB retinal fundus images for improved segmentation of blood vessels using convolutional neural networks. J Digit Imaging:1–19
Tang P, Liang Q, Yan X, Zhang D, Coppola G, Sun W (2019) Multi-proportion channel ensemble model for retinal vessel segmentation. Comput Biol Med 111:103352
Tchinda BS, Tchiotsop D, Noubom M, Louis-Dorr V, Wolf D (2021) Retinal blood vessels segmentation using classical edge detection filters and the neural network. Inform Med Unlocked 23:100521
Thangaraj S, Periyasamy V, Balaji R (2018) Retinal vessel segmentation using neural network. IET Image Process 12:669–678
Tian C, Fang T, Fan Y, Wu W (2020) Multi-path convolutional neural network in fundus segmentation of blood vessels. Biocybern Biomed Eng 40(2):583–595
Tolias YA, Panas SM (1998) A fuzzy vessel tracking algorithm for retinal images based on fuzzy clustering. IEEE Trans Med Imaging 17(2):263–273
Uysal E, Güraksin GE (2021) Computer-aided retinal vessel segmentation in retinal images: convolutional neural networks. Multimed Tools Appl 80(3):3505–3528
Uysal E, Güraksin GE (2021) Computer-aided retinal vessel segmentation in retinal images: convolutional neural networks. Multimed Tools Appl 80:3505–3528
Wang Y, Ji G, Lin P, Trucco E (2013) Retinal vessel segmentation using multiwavelet kernels and multiscale hierarchical decomposition. Pattern Recogn 46(8):2117–2133
Wang C, Zhao Z, Ren Q, Xu Y, Yu Y (2019) Dense U-net based on patch-based learning for retinal vessel segmentation. Entropy 21(2):168
Wu H, Wang W, Zhong J, Lei B, Wen Z, Qin J (2021) Scs-net: A scale and context sensitive network for retinal vessel segmentation. Med Image Anal 70:102025
Wu Y, Xia Y, Song Y, Zhang Y, Cai W (2020) NFN+: a novel network followed network for retinal vessel segmentation. Neural Netw 126:153–162
Xia H, Wu L, Lan Y, Li H, Song S (2022) HRNet: A hierarchical recurrent convolution neural network for retinal vessel segmentation. Multimed Tools Appl 81(28):39829–39851
Xinge Y, Qinmu P, Yuan Y, Yiu-ming C, Jiajia L (2011) Segmentation of retinal blood vessels using the radial projection and semi-supervised approach. Pattern Recogn 44:10–11
Yan Z, Yang X, Cheng KT (2018) Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation. IEEE Trans Biomed Eng 65(9):1912–1923
Yang X, Li Z, Guo Y, Zhou D (2022) DCU-net: a deformable convolutional neural network based on cascade U-net for retinal vessel segmentation. Multimed Tools Appl 81(11):15593–15607
Yang D, Zhao H, Yu K, Geng L (2023) NAUNet: lightweight retinal vessel segmentation network with nested connections and efficient attention. Multimed Tools Appl:1–23
Yao Z, Zhang Z, Xu LQ (2016) Convolutional neural network for retinal blood vessel segmentation. In 2016 9th international symposium on Computational intelligence and design (ISCID) (Vol. 1, pp. 406–409). IEEE
You X, Peng Q, Yuan Y, Cheung YM, Lei J (2011) Segmentation of retinal blood vessels using the radial projection and semi-supervised approach. Pattern Recogn 44(10–11):2314–2324
Yue K, Zou B, Chen Z, Liu Q (2019) Retinal vessel segmentation using dense U-net with multiscale inputs. J Med imaging 6:034004
Zhang J, Dashtbozorg B, Bekkers E, Pluim JPW, Duits R, terHaar Romeny BM (2016) Robust retinal vessel segmentation via locally adaptive derivative frames in orientation scores. IEEE Trans Med Imaging 35:2631–2642
Zhao Y, Rada L, Chen K, Harding SP, Zheng Y (2015) Automated vessel segmentation using infinite perimeter active contour model with hybrid region information with application to retinal images. IEEE Trans Med Imaging 34:1797–1807
Zhao J, Yang J, Ai D, Song H, Jiang Y, Huang Y, ... & Wang Y (2018) Automatic retinal vessel segmentation using multi-scale superpixel chain tracking. Digit Signal Process 81:26–42
Zhu C, Zou B, Zhao R, Cui J, Duan X, Chen Z (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imag Grap 55:68–77
Zhu C, Zou B, Zhao R, Cui J, Duan X, Chen Z, Liang Y (2017) Retinal vessel segmentation in colour fundus images using extreme learning machine. Comput Med Imaging Graph 55:68–77
Zhuang J (2018) LadderNet: Multi-path networks based on U-Net for medical image segmentation. arXiv preprint arXiv:1810.07810
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
We declare that
a. This manuscript is the authors' original work and has not been published elsewhere.
b. All authors have checked the manuscript and have agreed to the submission.
c. We also declare that we do not have any conflict of interest.
d. This work is not funded by any external or internal or any government funded agency.
e. The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
f.The dataset analysed during the current study are available in the internet repository, and can also be made available from the corresponding author on reasonable request
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Singh, L.K., Khanna, M., Thawkar, S. et al. Deep-learning based system for effective and automatic blood vessel segmentation from Retinal fundus images. Multimed Tools Appl 83, 6005–6049 (2024). https://doi.org/10.1007/s11042-023-15348-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-15348-3