Abstract
Wireless capsule endoscopy (WCE) is a technology that uses a pill-sized camera to visualize images of the digestive tract. It presents several advantages, since it is far less invasive, does not require sedation and has less potential complications compared to standard endoscopy. Hence, it might be exploited as alternative to the standard procedure. WCE is used to diagnosis a variety of gastro-intestinal diseases such as polyps, ulcers, Crohn’s disease and hemorrhages. Nevertheless, WCE videos can contain thousands of images per patient that must be screened by medical specialists, besides, the capsule free mobility and technological limits cause production of a low quality images. In this paper, a Nouvel method based on Dense-UNet deep learning segmentation model is presented. This approach aims at red lesion, ulcer and polyp detection from WCE images. Then, we propose a modified residual attention network for images classification. The proposed methods training and validation accuracies are 97.57% and 92.70%, with training and validation intersection over union and dice coefficients of 75.31%, 71.29%, 83.50% and 80.66%, respectively, in the red lesion dataset. In the polyp dataset, the method achieved a training and validation accuracies of 98.26% and 92.33%, with training and validation intersection over union and dice coefficients of 92.09%, 95.62%, 80.13% and 87.14%, respectively. Besides, the proposed architecture reached an average accuracy of 99.30%, sensitivity, specificity and F1 score of 98.61%, 100% and 99.30%, respectively. These results demonstrate that the proposed approach is satisfactory in polyp and red lesion segmentation and ulcer detection.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data availability
The first dataset analyzed during the current study is available in [https://rdm.inesctec.pt/dataset/nis-2018-003]. The second dataset analyzed during the current study is available publicly in [https://datasetninja.com/cvc-612]. The third dataset analyzed during the current study will be made available from the corresponding author on reasonable request.
References
Allapakam V, Karuna Y (2023) A hybrid feature pyramid network and efficient net-b0-based gist detection and segmentation from fused ct-pet image. Soft Comput 1–17
Bernal J, Sánchez FJ, Fernández-Esparrach G, Gil D, Rodríguez C, Vilariño F (2015) Wm-dova maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput Med Imaging Graph 43:99–111
Cai S, Tian Y, Lui H, Zeng H, Wu Y, Chen G (2020) Dense-unet: a novel multiphoton in vivo cellular image segmentation model based on a convolutional neural network. Quant Imaging Med Surg 10(6):1275
Charisis VS, Katsimerou C, Hadjileontiadis LJ, Liatsos CN, Sergiadis GD (2013) Computer-aided capsule endoscopy images evaluation based on color rotation and texture features: an educational tool to physicians. In: Proceedings of the 26th IEEE International Symposium On Computer-Based Medical Systems, pp 203–208
Chu Y, Huang F, Gao M, Zou D-W, Zhong J, Wu W, Wang Q, Shen X-N, Gong T-T, Li Y-Y et al (2023) Convolutional neural network-based segmentation network applied to image recognition of angiodysplasias lesion under capsule endoscopy. World J Gastroenterol 29(5):879
Coelho P, Pereira A, Salgado M, Cunha A (2018) A deep learning approach for red lesions detection in video capsule endoscopies. In: International Conference Image Analysis and Recognition. Springer, pp 553–561
D’Angelo G, Palmieri F, Robustelli A (2022) A federated approach to android malware classification through perm-maps. Cluster Comput 25(4):2487–2500
D’Angelo G, Farsimadan E, Ficco M, Palmieri F, Robustelli A (2023) Privacy-preserving malware detection in android-based iot devices through federated markov chains. Future Generat Comput Syst 148:93–105
D’Angelo G, Farsimadan E, Palmieri F (2023) Recurrence plots-based network attack classification using cnn-autoencoders. In: International Conference on Computational Science and Its Applications. Springer, pp 191–209
D’Angelo G, Palmieri F, Robustelli A (2021) Effectiveness of video-classification in android malware detection through api-streams and cnn-lstm autoencoders. In: International Symposium on Mobile Internet Security. Springer, pp 171–194
El Jaafari I, Ellahyani A, Charfi S (2021) Parametric rectified nonlinear unit (prenu) for convolution neural networks. Signal Image Video Process 15(2):241–246
Ellahyani A, El Jaafari I, Charfi S, El Ansari M (2020) Detection of abnormalities in wireless capsule endoscopy based on extreme learning machine. Signal Image Video Process 15:1–8
Goel N, Kaur S, Gunjan D, Mahapatra S (2022) Dilated cnn for abnormality detection in wireless capsule endoscopy images. Soft Comput 1–17
Hajabdollahi M, Esfandiarpoor R, Khadivi P, Soroushmehr SR, Karimi N, Najarian K, Samavi S (2019) Segmentation of bleeding regions in wireless capsule endoscopy for detection of informative frames. Biomed Signal Process Control 53:101565
Hajabdollahi M, Esfandiarpoor R, Sabeti E, Karimi N, Soroushmehr SR, Samavi S (2020) Multiple abnormality detection for automatic medical image diagnosis using bifurcated convolutional neural network. Biomed Signal Process Control 57:101792
He J-Y, Wu X, Jiang Y-G, Peng Q, Jain R (2018) Hookworm detection in wireless capsule endoscopy images with deep learning. IEEE Trans Image Process 27(5):2379–2392
He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part IV 14. Springer, pp 630–645
Khan MA, Kadry S, Alhaisoni M, Nam Y, Zhang Y, Rajinikanth V, Sarfraz MS (2020) Computer-aided gastrointestinal diseases analysis from wireless capsule endoscopy: A framework of best features selection. IEEE Access 8:132850–132859
Kim SH, Hwang Y, Oh DJ, Nam JH, Kim KB, Park J, Song HJ, Lim YJ (2020) Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy. Sci Rep 11(1):17479
Lafraxo S, Souaidi M, El Ansari M, Koutti L (2023) Semantic segmentation of digestive abnormalities from wce images by using attresu-net architecture. Life 13(3):719
Laiz P, Vitrià J, Wenzek H, Malagelada C, Azpiroz F, Seguí S (2020) Wce polyp detection with triplet based embeddings. Comput Med Imaging Graph 86:101794
Lan L, Ye C (2021) Recurrent generative adversarial networks for unsupervised wce video summarization. Knowl Based Syst 222:106971
Lou A, Guan S, Loew M (2023) Caranet: Context axial reverse attention network for segmentation of small medical objects. J Med Imaging 10(1):014005–014005
Malik H, Naeem A, Sadeghi-Niaraki A, Naqvi RA, Lee S-W (2023) Multi-classification deep learning models for detection of ulcerative colitis, polyps, and dyed-lifted polyps using wireless capsule endoscopy images. Complex Intell Syst 1–21
Padmavathi P, Harikiran J, Vijaya J (2023) Effective deep learning based segmentation and classification in wireless capsule endoscopy images. Multimed Tools Appl 1–25
Pannu HS, Ahuja S, Dang N, Soni S, Malhi AK (2020) Deep learning based image classification for intestinal hemorrhage. Multimed Tools Appl 79:21941–21966
Rahim T, Usman MA, Shin SY (2020) A survey on contemporary computer-aided tumor, polyp, and ulcer detection methods in wireless capsule endoscopy imaging. Comput Med Imaging Graph 85:101767
Soffer S, Klang E, Shimon O, Nachmias N, Eliakim R, Ben-Horin S, Kopylov U, Barash Y (2020) Deep learning for wireless capsule endoscopy: a systematic review and meta-analysis. Gastrointest Endosc 92:831
Sunitha S, Sujatha S (2021) An improved bleeding detection method for wireless capsule endoscopy (wce) images based on alexnet. In: 2021 3rd International Conference on Signal Processing and Communication (ICPSC), pp 11–15
Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 31
Vani V, Prashanth KVM (2022) Ulcer detection in wireless capsule endoscopy images using deep cnn. J King Saud Univ Comput Inf Sci 34(6):3319–3331. https://doi.org/10.1016/j.jksuci.2020.09.008
Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1492–1500
Xu L, Fan S, Fan Y, Li L (2018) Automatic detection of small bowel polyp in wireless capsule endoscopy images. In: Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications, International Society for Optics and Photonics, vol 10579, p 1057919
Yin J, Wang C, Liu L, Yang H, Sun X, Wang Y (2023) Research on improving transunet network for feature classification. In: Sixth International Conference on Computer Information Science and Application Technology (CISAT 2023), vol 12800, pp 822–831
Yue G, Han W, Li S, Zhou T, Lv J, Wang T (2022) Automated polyp segmentation in colonoscopy images via deep network with lesion-aware feature selection and refinement. Biomed Signal Process Control 78:103846
Zhang H, Liu C, Zhang Z, Xing Y, Liu X, Dong R, He Y, Xia L, Liu F (2021) Recurrence plot-based approach for cardiac arrhythmia classification using inception-resnet-v2. Front Physiol 12:648950
Acknowledgements
This work was supported by the Ministry of Higher Education, Scientific Research, and Innovation (MHESRI), The Ministry of Industry, Trade and Green and Digital Economy (MITGDE), Digital Development Agency (DDA) and National Center for Scientific and Technical Research (NCSTR). Project number: ALKHAWARIZMI/2020/20.
Funding
This work was funded by the Ministry of Higher Education, Scientific Research, and Innovation (MHESRI), The Ministry of Industry, Trade and Green and Digital Economy (MITGDE), Digital Development Agency (DDA) and National Center for Scientific and Technical Research (NCSTR) (ALKHAWARIZMI/2020/20).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interests regarding the publication of this article.
Ethical approval
The authors state that this research complies with ethical standards. This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Charfi, S., Ansari, M.E., Koutti, L. et al. Modified residual attention network for abnormalities segmentation and detection in WCE images. Soft Comput 28, 6923–6936 (2024). https://doi.org/10.1007/s00500-023-09576-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-023-09576-w