Abstract
X-Ray imaging is quick, cheap and useful for front-line care assessment and intra-operative real-time imaging (e.g., C-Arm Fluoroscopy). However, it suffers from projective information loss and lacks vital volumetric information on which many essential diagnostic biomarkers are based on. In this paper we explore probabilistic methods to reconstruct 3D volumetric images from 2D imaging modalities and measure the models’ performance and confidence. We show our models’ performance on large connected structures and we test for limitations regarding fine structures and image domain sensitivity. We utilize fast end-to-end training of a 2D-3D convolutional networks, evaluate our method on 117 CT scans segmenting 3D structures from digitally reconstructed radiographs (DRRs) with a Dice score of \(0.91 \pm 0.0013\). Source code will be made available by the time of the conference.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Albarqouni, S., Fotouhi, J., Navab, N.: X-ray in-depth decomposition: revealing the latent structures. In: MICCAI (2017)
Aubert, B., Vergari, C., Ilharreborde, B., Courvoisier, A., Skalli, W.: 3D reconstruction of rib cage geometry from biplanar radiographs using a statistical parametric model approach. Comput. Methods Biomech. Biomed. Eng. Imag. Visual. 4(5), 281–295 (2016). https://doi.org/10.1080/21681163.2014.913990
Baumgartner, C.F.,et al.: PHiSeg: capturing uncertainty in medical image segmentation. In: MICCAI, pp. 1–14 (2019)
Budd, S., et al.: Confident head circumference measurement from ultrasound with real-time feedback for sonographers. In: MICCAI (2019)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3d u-net: learning dense volumetric segmentation from sparse annotation. In: Ourselin, S., et al. (eds.) MICCAI (2016)
Dumoulin, V., Visin, F.: A guide to convolution arithmetic for deep learning. arXiv preprint arXiv:1603.07285 (2016)
Gal, Y., Ghahramani, Z.: Dropout as a bayesian approximation: representing model uncertainty in deep learning. In: ICML (2016)
Henzler, P., Rasche, V., Ropinski, T., Ritschel, T.: Single-image tomography: 3d volumes from 2d cranial x-rays. Comput. Graph. Forum 37(2), 377–388 (2018). https://doi.org/10.1111/cgf.13369
Jian, W.: ITK-based implementation of two-projection 2D/3D registration method with an application in patient setup for external beam radiotherapy. In: Insight Journal (2010)
Kainz, B., Voglreiter, P., Sereinigg, M., et al.: High-Resolution Contrast Enhanced Multi-Phase Hepatic Computed Tomography Data from a Porcine Radio-Frequency Ablation Study (2014)
Koehler, C., Wischgoll, T.: Knowledge-assisted reconstruction of the human RIB cage and lungs. IEEE Comput. Graph. Appl. 30(1), 17–29 (2009)
Kroes, T., Post, F.H., Botha, C.P.: Exposure render: An interactive photo-realistic volume rendering framework. PLoS ONE 7(7), 75 (2012)
Lin, C.H., Kong, C., Lucey, S.: Learning efficient point cloud generation for dense 3d object reconstruction. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)
Rubin, G.D.: Computed tomography: revolutionizing the practice of medicine for 40 years. Radiology 273(2S), S45–S74 (2014). https://doi.org/10.1148/radiol.14141356, pMID: 25340438
Sun, X., et al.: Pix3d: dataset and methods for single-image 3d shape modeling. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2974–2983 (2018)
Sun, Y., Tzeng, E., Darrell, T., Efros, A.A.: Unsupervised domain adaptation through self-supervision (2019)
Van Dyck, P., Vanhoenacker, F.M., Van den Brande, P., De Schepper, A.M.: Imaging of pulmonary tuberculosis. In: European Radiology (2003)
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M.: ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases (2017)
Yan, X., Yang, J., Yumer, E., Guo, Y., Lee, H.: Perspective transformer nets: learning single-view 3D object reconstruction without 3d supervision. In: NeurIPS (2016)
Ying, X., Guo, H., Ma, K., Wu, J., Weng, Z., Zheng, Y.: X2ct-GAN: Reconstructing CT from biplanar x-rays with generative adversarial networks. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019
Acknowledgments
Funding for this work was received by DoC of Imperial College London and the MAVEHA (EP/S013687/1) grant (A.V., D.R., B.K.). S.B. is supported by EP/S022104/1 and B.H. by the London Medical Imaging and AI Centre for Value Based Healthcare (19923). The authors would also like to thank NVIDIA corp for the donation of GPU resources.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Vlontzos, A., Budd, S., Hou, B., Rueckert, D., Kainz, B. (2020). 3D Probabilistic Segmentation and Volumetry from 2D Projection Images. In: Petersen, J., et al. Thoracic Image Analysis. TIA 2020. Lecture Notes in Computer Science(), vol 12502. Springer, Cham. https://doi.org/10.1007/978-3-030-62469-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-62469-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62468-2
Online ISBN: 978-3-030-62469-9
eBook Packages: Computer ScienceComputer Science (R0)
