Patch-Based Coupled Attention Network to Predict MSI Status in Colon Cancer
Pages 132 - 139
Abstract
Identifying and diagnosing key markers from WSI images is the key to accurate diagnosis and treatment of colon cancer (CC). However, how to extract marker-related features from huge scale WSI images is a challenge faced by AI models. In this study, we propose a patch-based coupled attention neural network (CovAttnNet) designed to predict Microsatellite Instability (MSI) status from WSI images. CovAttnNet consists of a transformer based backbone network and a neural network based on convolutional operations. A global and local feature attention module based on patch coupling is proposed to extract and fuse key features. We validated the performance of the model on the publicly available dataset TCGA-COAD, and the experimental results demonstrated the superior ability of CovAttnNet in predicting the status of colon cancer MSI status. This study provides a new method for deep learning in marker prediction research.
References
[1]
Boland CR and Goel A Microsatellite instability in colorectal cancer Gastroenterology 2010 138 6 2073-2087
[2]
Siegel, R.L., et al.: Colorectal cancer statistics, 2020. CA: Cancer J. Clin. 70(3), 145–164 (2020)
[3]
Vilar E and Gruber SB Microsatellite instability in colorectal cancer-the stable evidence Nat. Rev. Clin. Oncol. 2010 7 3 153-162
[4]
Simanjuntak, B., Jeo, W., Krisnuhoni, E.: Correlation between microsatellite instability (msi) and 5-year survival in patients with colorectal cancer. J. Phys.: Conf. Series. 1073, 042021. IOP Publishing (2018)
[5]
Chen ML et al. Comparison of microsatellite status detection methods in colorectal carcinoma Int. J. Clin. Exp. Pathol. 2018 11 3 1431
[6]
Greeenson JK et al. Pathologic predictors of microsatellite instability in colorectal cancer Am. J. Surg. Pathol. 2009 33 1 126-133
[7]
Kather JN et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer Nat. Med. 2019 25 7 1054-1056
[8]
Lee SH, Song IH, and Jang HJ Feasibility of deep learning-based fully automated classification of microsatellite instability in tissue slides of colorectal cancer Int. J. Cancer 2021 149 3 728-740
[9]
Echle A et al. Clinical-grade detection of microsatellite instability in colorectal tumors by deep learning Gastroenterology 2020 159 4 1406-1416
[10]
Schrammen PL et al. Weakly supervised annotation-free cancer detection and prediction of genotype in routine histopathology J. Pathol. 2022 256 1 50-60
[11]
Schirris Y, Gavves E, Nederlof I, Horlings HM, and Teuwen J Deepsmile: contrastive self-supervised pre-training benefits MSI and HRD classification directly from h &e whole-slide images in colorectal and breast cancer Med. Image Anal. 2022 79
[12]
Ashish, V.: Attention is all you need. In: Advances in Neural Information Processing Systems 30, I (2017)
[13]
Dosovitskiy, A., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)
[14]
Paoletti ME, Haut JM, Fernandez-Beltran R, Plaza J, Plaza AJ, and Pla F Deep pyramidal residual networks for spectral-spatial hyperspectral image classification IEEE Trans. Geosci. Remote Sens. 2018 57 2 740-754
[15]
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
[16]
Smith, L.N.: Cyclical learning rates for training neural networks. In: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 464–472. IEEE (2017)
[17]
Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017)
[18]
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
[19]
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Recommendations
A comprehensive review of deep learning in colon cancer
AbstractDeep learning has emerged as a leading machine learning tool in object detection and has attracted attention with its achievements in progressing medical image analysis. Convolutional Neural Networks (CNNs) are the most preferred ...
Highlights- Deep learning is one of the most promising techniques in medical image processing.
Colon cancer diagnosis and staging classification based on machine learning and bioinformatics analysis
AbstractAdvanced metastasis of colon cancer makes it more difficult to treat colon cancer. Finding the markers of colon cancer (Colon Cancer) can diagnose the stage of cancer in time and improve the prognosis with timely treatment. This paper uses gene ...
Highlights- Machine learning analysis combined with bioinformatics analysis to screen for markers.
- Random forests perform best in both colon cancer and colon cancer staging diagnosis.
- The accuracy of colon cancer diagnosis is greater than 98%.
Deep learning for colon cancer histopathological images analysis
AbstractNowadays, digital pathology plays a major role in the diagnosis and prognosis of tumours. Unfortunately, existing methods remain limited when faced with the high resolution and size of Whole Slide Images (WSIs) coupled with the lack of ...
Graphical abstractDisplay Omitted
Highlights- A novel training strategy to perform accurate segmentation of sparsely annotated histopathological data is introduced.
Comments
Information & Contributors
Information
Published In
Jul 2024
514 pages
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 19 July 2024
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in