Abstract
Sentinel lymph node status is a crucial prognosis factor for melanomas; nonetheless, the invasive surgery required to obtain it always puts the patient at risk. In this study, we develop a Deep Learning-based approach to predict lymph node metastasis from Whole Slide Images of primary tumours. Albeit very informative, these images come with complexities that hamper their use in machine learning applications, namely their large size and limited datasets. We propose a pre-training strategy based on self-supervised contrastive learning to extract better image feature representations and an attention-based Multiple Instance Learning approach to enhance the model’s performance. With this work, we quantitatively demonstrate that combining both methods improves various classification metrics and qualitatively show that contrastive learning encourages the network to output higher attention scores to tumour tissue and lower scores to image artifacts.
Work supported by the Spanish Research Agency (AEI) under project PID2020-116907RB-I00 of the call MCIN/AEI/10.13039/501100011033 and the project 718/C/2019 funded by Fundació la Marato de TV3.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akdeniz, M., Hahnel, E., Ulrich, C., Blume-Peytavi, U., Kottner, J.: Prevalence and associated factors of skin cancer in aged nursing home residents: a multicenter prevalence study. PLoS ONE 14(4), e0215379 (2019)
Barata, C., Santiago, C.: Improving the explainability of skin cancer diagnosis using CBIR. In: de Bruijne, M., et al. (eds.) MICCAI 2021. LNCS, vol. 12903, pp. 550–559. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87199-4_52
Brinker, T.J., Kiehl, L., Schmitt, M., et al.: Deep learning approach to predict sentinel lymph node status directly from routine histology of primary melanoma tumours. Eur. J. Cancer 154, 227–234 (2021)
Chen, T., Kornblith, S., et al.: A simple framework for contrastive learning of visual representations. In: International Conference on Machine Learning, pp. 1597–1607. PMLR (2020)
Combalia, M., et al.: Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: the 2019 international skin imaging collaboration grand challenge. Lancet Digital Health 4(5), e330–e339 (2022)
Gareau, D.S., et al.: Deep learning-level melanoma detection by interpretable machine learning and imaging biomarker cues. J. Biomed. Opt. 25(11), 112906 (2020)
Gershenwald, J.E., et al.: Melanoma staging: evidence-based changes in the American joint committee on cancer eighth edition cancer staging manual. CA Cancer J. Clin. 67(6), 472–492 (2017)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Ilse, M., Tomczak, J., Welling, M.: Attention-based deep multiple instance learning. In: International Conference on Machine Learning, pp. 2127–2136. PMLR (2018)
Jaiswal, A., Babu, A.R., Zadeh, M.Z., Banerjee, D., Makedon, F.: A survey on contrastive self-supervised learning. Technologies 9(1), 2 (2020)
Li, X., Desrosiers, C., Liu, X.: Symmetric contrastive loss for out-of-distribution skin lesion detection. In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pp. 1–5. IEEE (2022)
Lu, M.Y., Williamson, D.F., et al.: Data-efficient and weakly supervised computational pathology on whole-slide images. Nat. Biomed. Eng. 5(6), 555–570 (2021)
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)
Suganyadevi, S., Seethalakshmi, V., Balasamy, K.: A review on deep learning in medical image analysis. Int. J. Multimed. Inf. Retrieval 11(1), 19–38 (2022)
Sung, H., et al.: Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 71(3), 209–249 (2021)
Verdelho, M.R., Barata, C.: On the impact of self-supervised learning in skin cancer diagnosis. In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), pp. 1–5. IEEE (2022)
Vij, R., Arora, S.: Computer vision with deep learning techniques for neurodegenerative diseases analysis using neuroimaging: a survey. In: Khanna, A., Gupta, D., Bhattacharyya, S., Hassanien, A.E., Anand, S., Jaiswal, A. (eds.) International Conference on Innovative Computing and Communications. AISC, vol. 1388, pp. 179–189. Springer, Singapore (2022). https://doi.org/10.1007/978-981-16-2597-8_15
Wang, X., et al.: Weakly supervised deep learning for whole slide lung cancer image analysis. IEEE Trans. Cybern. 50(9), 3950–3962 (2019)
Zhang, Z., et al.: Pathologist-level interpretable whole-slide cancer diagnosis with deep learning. Nat. Mach. Intell. 1(5), 236–245 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Perez, C.H., Escudero, M.C., Puig, S., Malvehy, J., Besler, V.V. (2022). Contrastive and Attention-Based Multiple Instance Learning for the Prediction of Sentinel Lymph Node Status from Histopathologies of Primary Melanoma Tumours. In: Ali, S., van der Sommen, F., Papież, B.W., van Eijnatten, M., Jin, Y., Kolenbrander, I. (eds) Cancer Prevention Through Early Detection. CaPTion 2022. Lecture Notes in Computer Science, vol 13581. Springer, Cham. https://doi.org/10.1007/978-3-031-17979-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-17979-2_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-17978-5
Online ISBN: 978-3-031-17979-2
eBook Packages: Computer ScienceComputer Science (R0)
