Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1007/978-3-031-16902-1_9guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Efficient Pix2Vox++ for 3D Cardiac Reconstruction from 2D Echo Views

Published: 18 September 2022 Publication History

Abstract

Accurate geometric quantification of the human heart is a key step in the diagnosis of numerous cardiac diseases, and in the management of cardiac patients. Ultrasound imaging is the primary modality for cardiac imaging, however acquisition requires high operator skill, and its interpretation and analysis is difficult due to artifacts. Reconstructing cardiac anatomy in 3D can enable discovery of new biomarkers and make imaging less dependent on operator expertise, however most ultrasound systems only have 2D imaging capabilities. We propose both a simple alteration to the Pix2Vox++ networks for a sizeable reduction in memory usage and computational complexity, and a pipeline to perform reconstruction of 3D anatomy from 2D standard cardiac views, effectively enabling 3D anatomical reconstruction from limited 2D data. We evaluate our pipeline using synthetically generated data achieving accurate 3D whole-heart reconstructions (peak intersection over union score >0.88) from just two standard anatomical 2D views of the heart. We also show preliminary results using real echo images.

References

[1]
Cerrolaza JJ et al.Frangi AF, Schnabel JA, Davatzikos C, Alberola-López C, Fichtinger G, et al.3D fetal skull reconstruction from 2DUS via deep conditional generative networksMedical Image Computing and Computer Assisted Intervention – MICCAI 2018201810.1007/978-3-030-00928-1Springer383-391
[2]
Braga JR, Leong-Poi H, Rac VE, Austin PC, Ross HJ, and Lee DS Trends in the use of cardiac imaging for patients with heart failure in Canada JAMA Netw. Open 2019 2 8 1-13
[3]
Castro, D.d.l.I., et al.: daavoo/pyntcloud: v0.1.6 (2022)., ‘zenodo.org/record/5841822’
[4]
Chang, A.X. et al.: ShapeNet: An Information-Rich 3D Model Repository (2015). arXiv:1512.03012
[5]
Gilbert A, Marciniak M, Rodero C, Lamata P, Samset E, and McLeod K Generating synthetic labeled data from existing anatomical models: an Example with echocardiography segmentation IEEE Trans. Med. Imaging 2021 40 10 2783-2794
[6]
Kingma, D.P., Ba, J.L.: Adam: A method for stochastic optimization. In: 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, pp. 1–15 (2015)
[7]
Leclerc S et al. Deep learning for segmentation using an open large-scale dataset in 2D echocardiography IEEE Trans. Med. Imaging 2019 38 9 2198-2210
[8]
Lowekamp, B.C., Chen, D.T., Ibáñez, L., Blezek, D.: The design of simpleITK. Frontiers in Neuroinformatics 7(DEC), 1–14 (2013).
[9]
Nelson TR, Pretorius DH, Hull A, Riccabona M, Sklansky MS, and James G Sources and impact of artifacts on clinical three-dimensional ultrasound imaging Ultrasound Obstet. Gynecol. 2000 16 4 374-383
[10]
Ouyang D et al. Video-based AI for beat-to-beat assessment of cardiac function Nature 2020 580 7802 252-256
[11]
Paszke, A., et al.: PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32(NeurIPS) (2019)
[12]
Prevost R et al. 3D freehand ultrasound without external tracking using deep learning Med. Image Anal. 2018 48 187-202
[13]
Robinson S A practical guideline for performing a comprehensive transthoracic echocardiogram in adults: the british society of echocardiography minimum dataset Echo Res. Pract. 2020 7 4 G59-G93
[14]
Rodero C et al. Linking statistical shape models and simulated function in the healthy adult human heart PLoS Comput. Biol. 2021 17 4 1-28
[15]
Upton, R., et al.: Automated Echocardiographic Detection of Severe Coronary Artery Disease Using Artificial Intelligence. JACC Cardiovascular Imaging pp. 1–13 (2022).
[16]
Xie, H., Yao, H., Sun, X., Zhou, S., Zhang, S.: Pix2Vox: Context-aware 3D reconstruction from single and multi-view images. In: Proceedings of the IEEE International Conference on Computer Vision 2019-Octob, 2690–2698 (2019).
[17]
Zhu, J.Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks (2017). arXiv:1703.10593

Cited By

View all
  • (2023)Graph Convolutional Neural Networks for Automated Echocardiography View Recognition: A Holistic ApproachSimplifying Medical Ultrasound10.1007/978-3-031-44521-7_5(44-54)Online publication date: 8-Oct-2023
  • (2023)Echo from Noise: Synthetic Ultrasound Image Generation Using Diffusion Models for Real Image SegmentationSimplifying Medical Ultrasound10.1007/978-3-031-44521-7_4(34-43)Online publication date: 8-Oct-2023

Index Terms

  1. Efficient Pix2Vox++ for 3D Cardiac Reconstruction from 2D Echo Views
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Guide Proceedings
        Simplifying Medical Ultrasound: Third International Workshop, ASMUS 2022, Held in Conjunction with MICCAI 2022, Singapore, September 18, 2022, Proceedings
        Sep 2022
        201 pages
        ISBN:978-3-031-16901-4
        DOI:10.1007/978-3-031-16902-1
        Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

        Publisher

        Springer-Verlag

        Berlin, Heidelberg

        Publication History

        Published: 18 September 2022

        Author Tags

        1. Convolutional neural networks
        2. 2D to 3D reconstruction
        3. Deep learning
        4. Ultrasound

        Qualifiers

        • Article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 10 Nov 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2023)Graph Convolutional Neural Networks for Automated Echocardiography View Recognition: A Holistic ApproachSimplifying Medical Ultrasound10.1007/978-3-031-44521-7_5(44-54)Online publication date: 8-Oct-2023
        • (2023)Echo from Noise: Synthetic Ultrasound Image Generation Using Diffusion Models for Real Image SegmentationSimplifying Medical Ultrasound10.1007/978-3-031-44521-7_4(34-43)Online publication date: 8-Oct-2023

        View Options

        View options

        Get Access

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media