Abstract
Standard plane (SP) localization is essential in routine clinical ultrasound (US) diagnosis. Compared to 2D US, 3D US can acquire multiple view planes in one scan and provide complete anatomy with the addition of coronal plane. However, manually navigating SPs in 3D US is laborious and biased due to the orientation variability and huge search space. In this study, we introduce a novel reinforcement learning (RL) framework for automatic SP localization in 3D US. Our contribution is three-fold. First, we formulate SP localization in 3D US as a tangent-point-based problem in RL to restructure the action space and significantly reduce the search space. Second, we design an auxiliary task learning strategy to enhance the model’s ability to recognize subtle differences crossing Non-SPs and SPs in plane search. Finally, we propose a spatial-anatomical reward to effectively guide learning trajectories by exploiting spatial and anatomical information simultaneously. We explore the efficacy of our approach on localizing four SPs on uterus and fetal brain datasets. The experiments indicate that our approach achieves a high localization accuracy as well as robust performance.
Y. Zou and H. Dou—Contribute equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alansary, A., et al.: Automatic view planning with multi-scale deep reinforcement learning agents. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11070, pp. 277–285. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00928-1_32
Beyer, T., et al.: What scans we will read: imaging instrumentation trends in clinical oncology. Cancer Imaging 20(1), 1–38 (2020)
Chykeyuk, K., Yaqub, M., Noble, J.A.: Class-specific regression random forest for accurate extraction of standard planes from 3D echocardiography. In: International MICCAI Workshop on Medical Computer Vision, pp. 53–62. Springer (2013). https://doi.org/10.1007/978-3-319-05530-5_6
Dou, H., et al.: Agent with warm start and active termination for plane localization in 3D ultrasound. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 290–298. Springer (2019). https://doi.org/10.1007/978-3-030-32254-0_33
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Hester, T., et al.: Deep q-learning from demonstrations. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Jaderberg, M., et al.: Reinforcement learning with unsupervised auxiliary tasks. arXiv preprint arXiv:1611.05397 (2016)
Li, K., et al.: Autonomous navigation of an ultrasound probe towards standard scan planes with deep reinforcement learning. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 8302–8308. IEEE (2021)
Li, K., Xu, Y., Wang, J., Ni, D., Liu, L., Meng, M.Q.H.: Image-guided navigation of a robotic ultrasound probe for autonomous spinal sonography using a shadow-aware dual-agent framework. IEEE Trans. Med. Robot. Bionics 4, 130–144 (2021)
Li, Y., Khanal, B., Hou, B., Alansary, A., et al.: Standard plane detection in 3D fetal ultrasound using an iterative transformation network. In: International MICCAI Workshop on Medical Computer Vision, pp. 392–400. Springer (2018). https://doi.org/10.1007/978-3-030-00928-1_45
Liang, J., et al.: Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis. Med. Image Anal. 79, 102461 (2022)
Lorenz, C., et al.: Automated abdominal plane and circumference estimation in 3D us for fetal screening. In: Medical Imaging 2018: Image Processing, vol. 10574, p. 105740I. International Society for Optics and Photonics (2018)
Mirowski, P., et al.: Learning to navigate in complex environments. arXiv preprint arXiv:1611.03673 (2016)
Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)
Turkgeldi, E., Urman, B., Ata, B.: Role of three-dimensional ultrasound in gynecology. J. Obstetr. Gynecol. India 65(3), 146–154 (2015)
Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., Freitas, N.: Dueling network architectures for deep reinforcement learning. In: International Conference on Machine Learning, pp. 1995–2003. PMLR (2016)
Yang, X., et al.: Agent with warm start and adaptive dynamic termination for plane localization in 3D ultrasound. IEEE Trans. Med. Imaging 40, 1950–1961 (2021)
Yang, X., et al.: Searching collaborative agents for multi-plane localization in 3D ultrasound. Med. Image Anal. 72, 102119 (2021)
Yeung, P.H., Aliasi, M., Papageorghiou, A.T., Haak, M., Xie, W., Namburete, A.I.: Learning to map 2D ultrasound images into 3D space with minimal human annotation. Med. Image Anal. 70, 101998 (2021)
Yoo, J.C., Han, T.H.: Fast normalized cross-correlation. Circ. Syst. Sig. Process. 28(6), 819–843 (2009)
Acknowledgement
This work was supported by the grant from National Natural Science Foundation of China (Nos. 62171290, 62101343), Shenzhen-Hong Kong Joint Research Program (No. SGDX20201103095613036), Shenzhen Science and Technology Innovations Committee (No. 20200812143441001), the Royal Academy of Engineering (INSILEX CiET1819/19), the Royal Society Exchange Programme CROSSLINK IES\(\backslash \)NSFC\(\backslash \)201380, and Engineering and Physical Sciences Research Council (EPSRC) programs TUSCA EP/V04799X/1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zou, Y. et al. (2022). Agent with Tangent-Based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13434. Springer, Cham. https://doi.org/10.1007/978-3-031-16440-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-031-16440-8_29
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16439-2
Online ISBN: 978-3-031-16440-8
eBook Packages: Computer ScienceComputer Science (R0)
