Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3637732.3637745acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbbeConference Proceedingsconference-collections
research-article
Open access

Multi-Class Gastroesophageal Reflux Disease Classification System Using Deep Learning Techniques

Published: 28 February 2024 Publication History

Abstract

Gastroesophageal reflux disease (GERD) has been a ubiquitous health problem for centuries. Its symptoms are hard to distinguish and endoscopists with less experience usually find it difficult to diagnose the severity of GERD, and this disease might progress to more severe diseases like Barrett’s esophagus without adequate treatment. Therefore, we proposed a multi-class classification system, which comprised a deep learning (DL) model and graphical user interface (GUI), to classify GERD grading from endoscopic images so as to provide finer predictions on erosive esophagus and easier assessment to the system. The Los Angeles Classification system (LACS) was selected as the standard for severity grading. We collected 3,654 white light (WL) esophagoscopic images from the database engine of Xiangyang Centre Hospital. We built the DL model using pre-trained convolutional neural network (CNN) model as the backbone, and different pre-trained models were used and compared. We also evaluated the effectiveness of applying data resampling and attention map to the DL model for optimizing model performance. Besides, data augmentation was also employed. After the best model was selected, we built the GUI using HuggingFace. Experimental results showed that DenseNet121 with oversampling and attention map achieved the best results with an accuracy of 0.7469, recall of 0.7057 and Cohen’s kappa of 0.7757. It was also discovered that the experimental groups using both techniques outperformed the others, while using DenseNet121 obtained better results considering all experimental groups. The model outputs were displayed in terms of the predicted label, probabilities for each grade and a heatmap containing highlighted attention. In conclusion, a multi-class DL classification system was developed for GERD grading classification, and it exhibited its potentially acceptable efficacy for GERD diagnosis based on the LACS.

References

[1]
Chandradeep Bhatt, Indrajeet Kumar, V Vijayakumar, Kamred Udham Singh, and Abhishek Kumar. 2021. The state of the art of deep learning models in medical science and their challenges. Multimedia Systems 27, 4 (2021), 599–613.
[2]
Ekin D Cubuk, Barret Zoph, Dandelion Mane, Vijay Vasudevan, and Quoc V Le. 2018. Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501 (2018).
[3]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248–255.
[4]
John Dent. 2008. Endoscopic grading of reflux oesophagitis: the past, present and future. Best Practice & Research Clinical Gastroenterology 22, 4 (2008), 585–599.
[5]
Wenju Du, Nini Rao, Dingyun Liu, Hongxiu Jiang, Chengsi Luo, Zhengwen Li, Tao Gan, and Bing Zeng. 2019. Review on the applications of deep learning in the analysis of gastrointestinal endoscopy images. Ieee Access 7 (2019), 142053–142069.
[6]
M Fullard, JY Kang, P Neild, A Poullis, and JD Maxwell. 2006. Systematic review: does gastro-oesophageal reflux disease progress?Alimentary pharmacology & therapeutics 24, 1 (2006), 33–45.
[7]
Hailong Ge, Xin Zhou, Yu Wang, Jian Xu, Feng Mo, Chen Chao, Jinzhou Zhu, Weixin Yu, 2023. Development and Validation of Deep Learning Models for the Multiclassification of Reflux Esophagitis Based on the Los Angeles Classification. Journal of Healthcare Engineering 2023 (2023).
[8]
Zhenyang Ge, Bowen Wang, Jiuyang Chang, Zequn Yu, Zhenyuan Zhou, Jing Zhang, and Zhijun Duan. 2023. Using deep learning and explainable artificial intelligence to assess the severity of gastroesophageal reflux disease according to the Los Angeles Classification System. Scandinavian Journal of Gastroenterology (2023), 1–9.
[9]
Amir Ghahremani and Christoph Lofi. 2023. ImECGnet: Cardiovascular Disease Classification from Image-Based ECG Data Using a Multi-branch Convolutional Neural Network. Journal of Image and Graphics 11, 1 (2023).
[10]
Jiuxiang Gu, Zhenhua Wang, Jason Kuen, Lianyang Ma, Amir Shahroudy, Bing Shuai, Ting Liu, Xingxing Wang, Gang Wang, Jianfei Cai, 2018. Recent advances in convolutional neural networks. Pattern recognition 77 (2018), 354–377.
[11]
Along He, Tao Li, Ning Li, Kai Wang, and Huazhu Fu. 2020. CABNet: category attention block for imbalanced diabetic retinopathy grading. IEEE Transactions on Medical Imaging 40, 1 (2020), 143–153.
[12]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.
[13]
Tiberiu Hershcovici and Ronnie Fass. 2010. Nonerosive reflux disease (NERD)-an update. Journal of neurogastroenterology and motility 16, 1 (2010), 8.
[14]
Mohammad Hossin and Md Nasir Sulaiman. 2015. A review on evaluation metrics for data classification evaluations. International journal of data mining & knowledge management process 5, 2 (2015), 1.
[15]
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017).
[16]
Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 4700–4708.
[17]
Peter J Kahrilas. 1996. Gastroesophageal reflux disease. Jama 276, 12 (1996), 983–988.
[18]
Motoyasu Kusano, Kyoko Ino, Takuro Yamada, Osamu Kawamura, Munetoshi Toki, Tsuneo Ohwada, Kazuma Kikuchi, Tohko Shirota, Masayuki Kimura, Makoto Miyazaki, 1999. Interobserver and intraobserver variation in endoscopic assessment of GERD using the “Los Angeles” classification. Gastrointestinal endoscopy 49, 6 (1999), 700–704.
[19]
Junkai Liao, Hak-Keung Lam, Guangyu Jia, Shraddha Gulati, Julius Bernth, Dmytro Poliyivets, Yujia Xu, Hongbin Liu, and Bu Hayee. 2021. A case study on computer-aided diagnosis of nonerosive reflux disease using deep learning techniques. Neurocomputing 445 (2021), 149–166.
[20]
Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen Awm Van Der Laak, Bram Van Ginneken, and Clara I Sánchez. 2017. A survey on deep learning in medical image analysis. Medical image analysis 42 (2017), 60–88.
[21]
LR Lundell, J Dent, JR Bennett, AL Blum, D Armstrong, JP Galmiche, F Johnson, M Hongo, JE Richter, SJ Spechler, 1999. Endoscopic assessment of oesophagitis: clinical and functional correlates and further validation of the Los Angeles classification. Gut 45, 2 (1999), 172–180.
[22]
Agnieszka Mikołajczyk and Michał Grochowski. 2018. Data augmentation for improving deep learning in image classification problem. In 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, 117–122.
[23]
Jun Ki Min, Min Seob Kwak, and Jae Myung Cha. 2019. Overview of deep learning in gastrointestinal endoscopy. Gut and liver 13, 4 (2019), 388.
[24]
Roweida Mohammed, Jumanah Rawashdeh, and Malak Abdullah. 2020. Machine learning with oversampling and undersampling techniques: overview study and experimental results. In 2020 11th international conference on information and communication systems (ICICS). IEEE, 243–248.
[25]
Phuong-Thao Nguyen, Thanh-Hai Tran, Viet-Hang Dao, and Hai Vu. 2022. Improving gastroesophageal reflux diseases classification diagnosis from endoscopic images using stylegan2-ada. In Artificial Intelligence in Data and Big Data Processing: Proceedings of ICABDE 2021. Springer, 381–393.
[26]
John E Pandolfino, Nimish B Vakil, and Peter J Kahrilas. 2002. Comparison of inter-and intraobserver consistency for grading of esophagitis by expert and trainee endoscopists. Gastrointestinal endoscopy 56, 5 (2002), 639–643.
[27]
Edoardo Savarino, Elisa Marabotto, Giorgia Bodini, Gaia Pellegatta, Claudia Coppo, Elisa Giambruno, Matteo Brunacci, Patrizia Zentilin, and Vincenzo Savarino. 2017. Epidemiology and natural history of gastroesophageal reflux disease.Minerva gastroenterologica e dietologica 63, 3 (2017), 175–183.
[28]
Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision. 618–626.
[29]
Dinggang Shen, Guorong Wu, and Heung-Il Suk. 2017. Deep learning in medical image analysis. Annual review of biomedical engineering 19 (2017), 221–248.
[30]
Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alexander A Alemi. 2017. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-first AAAI conference on artificial intelligence.
[31]
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. 2016. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2818–2826.
[32]
Alaa Tharwat. 2020. Classification assessment methods. Applied Computing and Informatics (2020).
[33]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
[34]
Chi-Chih Wang, Yu-Ching Chiu, Wei-Liang Chen, Tzu-Wei Yang, Ming-Chang Tsai, and Ming-Hseng Tseng. 2021. A deep learning model for classification of endoscopic gastroesophageal reflux disease. International journal of environmental research and public health 18, 5 (2021), 2428.
[35]
Tao Yan. 2022. Intelligent Diagnosis of Precancerous Lesions in Gastrointestinal Endoscopy Based on Advanced Deep Learning Techniques and Limited Data. Ph. D. Dissertation. University of Macau.
[36]
Hsu-Heng Yen, Hui-Yu Tsai, Chi-Chih Wang, Ming-Chang Tsai, and Ming-Hseng Tseng. 2022. An Improved Endoscopic Automatic Classification Model for Gastroesophageal Reflux Disease Using Deep Learning Integrated Machine Learning. Diagnostics 12, 11 (2022), 2827.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICBBE '23: Proceedings of the 2023 10th International Conference on Biomedical and Bioinformatics Engineering
November 2023
295 pages
ISBN:9798400708343
DOI:10.1145/3637732
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. conventional endoscopy
  2. convolutional neural networks
  3. deep learning
  4. gastroesophageal reflux disease classification

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Shenzhen Joint Fund (Guangdong-Shenzhen Joint Fund) Guangdong-Hong Kong-Macau Research Team Project
  • the Science and Technology Development Fund of Macau
  • Guangdong Basic and Applied Basic Research Fund and the Key Research and Development Program of Hubei Province

Conference

ICBBE 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 149
    Total Downloads
  • Downloads (Last 12 months)149
  • Downloads (Last 6 weeks)32
Reflects downloads up to 24 Jan 2025

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media