Asymmetric Contour Uncertainty Estimation for Medical Image Segmentation
Authors: 
Thierry Judge, Olivier Bernard, Woo-Jin Cho Kim, Alberto Gomez, Agisilaos Chartsias, Pierre-Marc JodoinAuthors Info & Claims
Thierry Judge, Olivier Bernard, Woo-Jin Cho Kim, Alberto Gomez, Agisilaos Chartsias, Pierre-Marc JodoinAuthors Info & ClaimsPages 210 - 220
Abstract
Aleatoric uncertainty estimation is a critical step in medical image segmentation. Most techniques for estimating aleatoric uncertainty for segmentation purposes assume a Gaussian distribution over the neural network’s logit value modeling the uncertainty in the predicted class. However, in many cases, such as image segmentation, there is no uncertainty about the presence of a specific structure, but rather about the precise outline of that structure. For this reason, we explicitly model the location uncertainty by redefining the conventional per-pixel segmentation task as a contour regression problem. This allows for modeling the uncertainty of contour points using a more appropriate multivariate distribution. Additionally, as contour uncertainty may be asymmetric, we use a multivariate skewed Gaussian distribution. In addition to being directly interpretable, our uncertainty estimation method outperforms previous methods on three datasets using two different image modalities. Code is available at: https://github.com/ThierryJudge/contouring-uncertainty.
References
[1]
Ayhan, M.S., Berens, P.: Test-time data augmentation for estimation of heteroscedastic aleatoric uncertainty in deep neural networks. In: International Conference on Medical Imaging with Deep Learning (2018)
[2]
Azzalini A Institute of Mathematical Statistics Monographs: The Skew-Normal and Related Families Series Number 3 2013 Cambridge Cambridge University Press
[3]
Baumgartner CF, et al., et al. Shen D, et al., et al. PHiSeg: capturing uncertainty in medical image segmentation Medical Image Computing and Computer Assisted Intervention – MICCAI 2019 2019 Cham Springer 119-127
[4]
Bernard O et al. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans. Med. Imaging 2018 37 11 2514-2525
[5]
Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: Bach, F., Blei, D. (eds.) Proceedings of the 32nd International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 37, pp. 1613–1622. PMLR, Lille, France, 07–09 July 2015
[6]
Camarasa R, et al., et al. Sudre CH, et al., et al. Quantitative comparison of Monte-Carlo dropout uncertainty measures for multi-class segmentation Uncertainty for Safe Utilization of Machine Learning in Medical Imaging, and Graphs in Biomedical Image Analysis 2020 Cham Springer 32-41
[7]
Chen, L., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation. CoRR abs/1706.05587 (2017)
[8]
Corbière, C., Thome, N., Bar-Hen, A., Cord, M., Pérez, P.: Addressing failure prediction by learning model confidence. In: Advances in Neural Information Processing Systems, vol. 32, pp. 2902–2913. Curran Associates, Inc. (2019)
[9]
DeVries, T., Taylor, G.W.: Leveraging uncertainty estimates for predicting segmentation quality. CoRR abs/1807.00502 (2018)
[10]
Gaggion, N., Mansilla, L., Mosquera, C., Milone, D.H., Ferrante, E.: Improving anatomical plausibility in medical image segmentation via hybrid graph neural networks: applications to chest x-ray analysis. IEEE Trans. Med. Imaging (2022)
[11]
Gal, Y., Ghahramani, Z.: Bayesian convolutional neural networks with Bernoulli approximate variational inference. arXiv abs/1506.02158 (2015)
[12]
Gal, Y., Ghahramani, Z.: Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning. ICML’16, vol. 48, pp. 1050–1059. JMLR.org (2016)
[13]
Gomez A et al. Aylward S, Noble JA, Hu Y, Lee SL, Baum Z, Min Z, et al. Left ventricle contouring of apical three-chamber views on 2d echocardiography Simplifying Medical Ultrasound 2022 Cham Springer 96-105
[14]
Isensee F, Jaeger PF, Kohl SA, Petersen J, and Maier-Hein KH NNU-net: a self-configuring method for deep learning-based biomedical image segmentation Nat. Methods 2021 18 2 203-211
[15]
Judge T, Bernard O, Porumb M, Chartsias A, Beqiri A, and Jodoin PM Wang L, Dou Q, Fletcher PT, Speidel S, and Li S Crisp - reliable uncertainty estimation for medical image segmentation Medical Image Computing and Computer Assisted Intervention - MICCAI 2022 2022 Cham Springer 492-502
[16]
Kendall, A., Gal, Y.: What uncertainties do we need in Bayesian deep learning for computer vision? In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30, pp. 5574–5584. Curran Associates, Inc. (2017)
[17]
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015)
[18]
Kohl, S., et al.: A probabilistic u-net for segmentation of ambiguous images. In: Advances in Neural Information Processing Systems, vol. 31. Curran Associates, Inc. (2018)
[19]
Lakshminarayanan, B., Pritzel, A., Blundell, C.: Simple and scalable predictive uncertainty estimation using deep ensembles. In: Guyon, I., et al. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates, Inc. (2017)
[20]
Leclerc S et al. Deep learning for segmentation using an open large-scale dataset in 2D echocardiography IEEE Trans. Med. Imaging 2019 38 9 2198-2210
[21]
Nibali, A., He, Z., Morgan, S., Prendergast, L.: Numerical coordinate regression with convolutional neural networks. arXiv preprint arXiv:1801.07372 (2018)
[22]
Niculescu-Mizil, A., Caruana, R.: Predicting good probabilities with supervised learning. In: Proceedings of the 22nd International Conference on Machine Learning. ICML ’05, pp. 625–632. Association for Computing Machinery, New York, NY, USA (2005)
[23]
Pakdaman Naeini, M., Cooper, G., Hauskrecht, M.: Obtaining well calibrated probabilities using Bayesian binning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 29, no. 1, February 2015
[24]
Paszke, A., Chaurasia, A., Kim, S., Culurciello, E.: Enet: a deep neural network architecture for real-time semantic segmentation. CoRR abs/1606.02147 (2016)
[25]
Schobs LA, Swift AJ, and Lu H Uncertainty estimation for heatmap-based landmark localization IEEE Trans. Med. Imaging 2023 42 4 1021-1034
[26]
Shiraishi J et al. Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules Am. J. Roentgenol. 2000 174 71-74
[27]
Thaler F, Payer C, Urschler M, and Štern D Modeling annotation uncertainty with Gaussian heatmaps in landmark localization Mach. Learn. Biomed. Imaging 2021 1 1-27
[28]
Tornetta GN Entropy methods for the confidence assessment of probabilistic classification models Statistica (Bologna) 2021 81 4 383-398
[29]
Wang G, Li W, Aertsen M, Deprest J, Ourselin S, and Vercauteren T Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks Neurocomputing 2019 338 34-45
Recommendations
Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks
Highlights- Different types of uncertainties for deep-learning based medical image segmentation were analysed.
AbstractDespite the state-of-the-art performance for medical image segmentation, deep convolutional neural networks (CNNs) have rarely provided uncertainty estimations regarding their segmentation outputs, e.g., model (epistemic) and image-...
Special Section on Uncertainty and Parameter Space Analysis in Visualization: Uncertainty estimation and visualization in probabilistic segmentation
Probabilistic segmentation is concerned with handling imperfections of image segmentation algorithms. They assign to each voxel and each segment a probability that the voxel belongs to the segment. This is often the starting point for estimating and ...
On the Effect of Inter-observer Variability for a Reliable Estimation of Uncertainty of Medical Image Segmentation
Medical Image Computing and Computer Assisted Intervention – MICCAI 2018AbstractUncertainty estimation methods are expected to improve the understanding and quality of computer-assisted methods used in medical applications (e.g., neurosurgical interventions, radiotherapy planning), where automated medical image segmentation ...
Comments
Information & Contributors
Information
Published In
Oct 2023
807 pages
ISBN:978-3-031-43897-4
DOI:10.1007/978-3-031-43898-1
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 08 October 2023
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in