GastroVision: A Multi-class Endoscopy Image Dataset for Computer Aided Gastrointestinal Disease Detection
Authors: 
Debesh Jha, Vanshali Sharma, Neethi Dasu, Nikhil Kumar Tomar, 
Steven Hicks, M. K. Bhuyan, Pradip K. Das, 
Michael A. Riegler, 
Pål Halvorsen, Ulas Bagci, Thomas de LangeAuthors Info & Claims
Debesh Jha, Vanshali Sharma, Neethi Dasu, Nikhil Kumar Tomar, Steven Hicks, M. K. Bhuyan, Pradip K. Das, Michael A. Riegler, Pål Halvorsen, Ulas Bagci, Thomas de LangeAuthors Info & ClaimsPages 125 - 140
Abstract
Integrating real-time artificial intelligence (AI) systems in clinical practices faces challenges such as scalability and acceptance. These challenges include data availability, biased outcomes, data quality, lack of transparency, and underperformance on unseen datasets from different distributions. The scarcity of large-scale, precisely labeled, and diverse datasets are the major challenge for clinical integration. This scarcity is also due to the legal restrictions and extensive manual efforts required for accurate annotations from clinicians. To address these challenges, we present GastroVision, a multi-center open-access gastrointestinal (GI) endoscopy dataset that includes different anatomical landmarks, pathological abnormalities, polyp removal cases and normal findings (a total of 27 classes) from the GI tract. The dataset comprises 8,000 images acquired from Bærum Hospital in Norway and Karolinska University Hospital in Sweden and was annotated and verified by experienced GI endoscopists. Furthermore, we validate the significance of our dataset with extensive benchmarking based on the popular deep learning based baseline models. We believe our dataset can facilitate the development of AI-based algorithms for GI disease detection and classification. Our dataset is available at https://osf.io/84e7f/.
References
[1]
Abadir AP, Ali MF, Karnes W, and Samarasena JB Artificial intelligence in gastrointestinal endoscopy Clin. Endosc. 2020 53 2 132-141
[2]
Ahn SB, Han DS, Bae JH, Byun TJ, Kim JP, and Eun CS The miss rate for colorectal adenoma determined by quality-adjusted, back-to-back colonoscopies Gut Liver 2012 6 1 64
[3]
Ali S et al. Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy Med. Image Anal. 2021 70
[4]
Ali, S., et al.: Endoscopy disease detection challenge 2020. arXiv preprint arXiv:2003.03376 (2020)
[5]
Ali S et al. A multi-centre polyp detection and segmentation dataset for generalisability assessment Sci. Data 2023 10 1 75
[6]
Areia M et al. Cost-effectiveness of artificial intelligence for screening colonoscopy: a modelling study Lancet Digit. Health 2022 4 6 e436-e444
[7]
Arnold M et al. Global burden of 5 major types of gastrointestinal cancer Gastroenterology 2020 159 1 335-349
[8]
Bernal, J., Aymeric, H.: MICCAI endoscopic vision challenge polyp detection and segmentation (2017)
[9]
Bernal, J., Sánchez, F.J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., Vilariño, F.: WM-DOVA maps for accurate polyp highlighting in colonoscopy: validation vs. saliency maps from physicians. Comput. Med. Imaging Graph. 43, 99–111 (2015)
[10]
Bernal J, Sánchez J, and Vilarino F Towards automatic polyp detection with a polyp appearance model Pattern Recogn. 2012 45 9 3166-3182
[11]
Borgli H et al. Hyperkvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy Sci. Data 2020 7 1 1-14
[12]
Crafa, P., Diaz-Cano, S.J.: Changes in colonic structure and mucosal inflammation. In: Colonic Diverticular Disease, pp. 41–61 (2022)
[13]
Globocan: Cancer today (2020). https://gco.iarc.fr/today/fact-sheets-cancers
[14]
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)
[15]
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)
[16]
Jha D et al. Real-time polyp detection, localization and segmentation in colonoscopy using deep learning IEEE Access 2021 9 40496-40510
[17]
Jha, D., et al.: Kvasir-SEG: a segmented polyp dataset. In: Proceedings of the International Conference on Multimedia Modeling (MMM), pp. 451–462 (2020)
[18]
Koulaouzidis A et al. Kid project: an internet-based digital video atlas of capsule endoscopy for research purposes Endosc. Int. Open 2017 5 6 E477
[19]
Li, K., et al.: Colonoscopy polyp detection and classification: dataset creation and comparative evaluations. arXiv preprint arXiv:2104.10824 (2021)
[20]
Mahmud N, Cohen J, Tsourides K, and Berzin TM Computer vision and augmented reality in gastrointestinal endoscopy Gastroenterol. Rep. 2015 3 3 179-184
[21]
Misawa, M., et al.: Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video). Gastrointest. Endosc. 93(4), 960–967 (2021)
[22]
Pogorelov, K., et al.: Kvasir: a multi-class image dataset for computer aided gastrointestinal disease detection. In: Proceedings of the 8th ACM on Multimedia Systems Conference, pp. 164–169 (2017)
[23]
Silva J, Histace A, Romain O, Dray X, and Granado B Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer Int. J. Comput. Assist. Radiol. Surg. 2014 9 2 283-293
[24]
Smedsrud PH et al. Kvasir-capsule, a video capsule endoscopy dataset Sci. Data 2021 8 1 1-10
[25]
Tajbakhsh N, Gurudu SR, and Liang J Automated polyp detection in colonoscopy videos using shape and context information IEEE Trans. Med. Imaging 2015 35 2 630-644
[26]
Tan, M., Le, Q.: Efficientnet: rethinking model scaling for convolutional neural networks. In: Proceedings of the International Conference on Machine Learning, pp. 6105–6114 (2019)
[27]
Thambawita, V., et al.: The medico-task 2018: disease detection in the gastrointestinal tract using global features and deep learning. In: Proceedings of the MediaEval 2018 Workshop (2018)
Index Terms
- GastroVision: A Multi-class Endoscopy Image Dataset for Computer Aided Gastrointestinal Disease Detection
Index terms have been assigned to the content through auto-classification.
Recommendations
Computer-Aided Gastrointestinal Disease Analysis Based on Artificial Intelligence Method
The diagnosis and treatment of gastrointestinal diseases are challenging because of the long incubation period. Although it has made progress at present, the overall prospect is still not optimistic. In this paper, a computer-aided gastrointestinal ...
Computer-aided gastrointestinal hemorrhage detection in wireless capsule endoscopy videos
HighlightsAn automated GI hemorrhage detection scheme from WCE images is proposed..Features from the NGLCM of the spectrum of the frames and SVM are employed.We introduce difference average- a new feature that operates on NGLCM.Validity of the method is ...
Propofol Combined with Fentanyl Is Superior to Propofol Alone in Sedation Protocols for Painless Gastrointestinal Endoscopy
Sufficient propofol or fentanyl doses necessary to prevent the response to skin incision do not necessarily reduce hemodynamic responses during surgery. The purpose of this study was to characterize the pharmacodynamic interaction between propofol ...
Comments
Information & Contributors
Information
Published In
Jul 2023
199 pages
ISBN:978-3-031-47678-5
DOI:10.1007/978-3-031-47679-2
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 26 November 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Jan 2025