Abstract
Background
This study presents a registration system that integrates preoperative cardiac Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) volume data with 2D Ultrasound (US) images of the aortic valve. The registration process aims to combine three different imaging modalities (US-CT-MRI) to improve the accuracy of diagnosing aortic valve disorders and provide surgical guidance during the implantation and replacement of the transcatheter aortic valve.
Methods
The registration framework involves two key components: temporal synchronization and spatial registration. Temporal synchronization allows the identification of frames in the CT and MRI volume that correspond to the same cardiac phase as the US time-series data. For spatial registration, an intensity-based normalized mutual information method combined with a pattern search optimization algorithm is used to produce interpolated cardiac CT and MRI images that align with the US image.
Results
The accuracy of the trimodality registration method is evaluated using the Dice similarity coefficient. The obtained coefficients are 0.92 ± 0.05 and 0.92 ± 0.04 for comparisons between US-CT and US-MRI, respectively, in short-axis "Mercedes Benz" sign views. The Hausdorff distance, which measures the dissimilarity between two sets of points, was found to be 1.49 ± 0.20 and 1.49 ± 0.19 for both US-CT and US-MRI pairings, respectively. Notably, these values are comparable to the precision achieved when an expert manually registers each image.
Conclusions
The proposed registration technique demonstrates excellent accuracy in enhancing image-guided systems for aortic valve surgical guidance. It shows promise in the context of Transcatheter Aortic Valve Implantation (TAVI) and Transcatheter Aortic Valve Replacement (TAVR) procedures. The successful integration of US-CT-MRI imaging modalities enables better diagnosis and surgical planning for aortic valve disorders, potentially leading to improved patient outcomes in these procedures.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Liu Z, Yin H, Chai Y, Yang SX. A novel approach for multimodal medical image fusion. Expert Syst Appl. 2014;41(16):7425–35. https://doi.org/10.1016/j.eswa.2014.05.043.
Wang W, Yang TX, Oleshko V, Yang SY, Tang ZH. Determination of submaximal exercise tolerance in athletes using a method to predict cardiac patient conditions during rehabilitation. Appl Nurs Res. 2020;54: 151281. https://doi.org/10.1016/j.apnr.2020.151281.
Betti I. The aortic valve. In Echocardiography for Intensivists, Routledge; 2012. p. 165–170.
Tuna M, Brtko M. Echocardiography of the aortic valve. In Aortic Regurgitation, Routledge; 2018. p. 91–104.
Nishimura RA. Aortic valve disease. Circulation. 2002;106(7):770–2. https://doi.org/10.1161/01.CIR.0000027621.26167.5E.
Sequeira Gross TM, et al. Comparison of microstructural alterations in the proximal aorta between aortic stenosis and regurgitation. J Thorac Cardiovasc Surg. 2021;162(6):1684–1695. https://doi.org/10.1016/j.jtcvs.2020.03.002.
Coffey S, et al. Global epidemiology of valvular heart disease. Nat Rev Cardiol 2021;18(12). Nature Publishing Group, pp. 853–864. https://doi.org/10.1038/s41569-021-00570-z.
Nguyen TC, et al. Clinical trends in surgical, minimally invasive and transcatheter aortic valve replacement. Eur J Cardio-thoracic Surg. 2017;51(6):1086–92. https://doi.org/10.1093/ejcts/ezx008.
Li FP, Rajchl M, Moore J, Peters TM. A mitral annulus tracking approach for navigation of off-pump beating heart mitral valve repair. Med Phys. 2015;42(1):456–68. https://doi.org/10.1118/1.4904022.
Khalil A, Ng SC, Liew YM, Lai KW. An Overview on Image Registration Techniques for Cardiac Diagnosis and Treatment. Cardiol Res Pract 2018. 2018. https://doi.org/10.1155/2018/1437125.
Nizar MHA, Khalil A, Chan CK, Utama NP, Lai KW. Pilot Study on Machine Learning for Aortic Valve Detection in Echocardiography Images. J Med Imaging Heal Informatics. 2019;9(1):9–14. https://doi.org/10.1166/jmihi.2019.2563.
Maes F, Collignon A, Vandermeulen D, Marchal G, Suetens P. Multimodality image registration by maximization of mutual information. IEEE Trans Med Imaging. 1997;16(2):187–98. https://doi.org/10.1109/42.563664.
Zhu YM, Cochoff SM. Influence of implementation parameters on registration of MR and SPECT brain images by maximization of mutual information. J Nucl Med. 2002;43(2):160–6.
Xie H, Pierce LE, Ulaby FT. Mutual Information Based Registration of SAR Images. International Geoscience and Remote Sensing Symposium (IGARSS). 2003;6:4028–31. https://doi.org/10.1109/igarss.2003.1295351.
Khalil A, Faisal A, Ng S-C, Liew YM, Lai KW. Multimodality registration of two-dimensional echocardiography and cardiac CT for mitral valve diagnosis and surgical planning. J Med Imaging. 2017;4(03):1. https://doi.org/10.1117/1.jmi.4.3.037001.
Shannon CE. A Mathematical Theory of Communication. Bell Syst Tech J. 1948;27(3):379–423. https://doi.org/10.1002/j.1538-7305.1948.tb01338.x.
Latha S, Muthu P, Lai KW, Khalil A, Dhanalakshmi S. Performance Analysis of Machine Learning and Deep Learning Architectures on Early Stroke Detection Using Carotid Artery Ultrasound Images. Front Aging Neurosci. 2022;13: 828214. https://doi.org/10.3389/fnagi.2021.828214.
Nizar MHA, Chan CK, Khalil A, Yusof AKM, Lai KW. Real-time Detection of Aortic Valve in Echocardiography using Convolutional Neural Networks. Curr Med Imaging Former Curr Med Imaging Rev. 2019;16(5):584–591. https://doi.org/10.2174/1573405615666190114151255.
Galton S, Zonbon E. FINGERPRINTS. 1982. Accessed: Jan. 15, 2021. [Online]. Available: http://www.biometricbits.htm.
Zou KH, et al. Statistical Validation of Image Segmentation Quality Based on a Spatial Overlap Index. Acad Radiol. 2004;11(2):178–89. https://doi.org/10.1016/S1076-6332(03)00671-8.
Khalil A, Liew YM, Ng SC, Lai KW, Hum YC. Echocardiography to cardiac CT image registration: Spatial and temporal registration of the 2D planar echocardiography images with cardiac CT volume. In 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services, Healthcom 2016. 2016. p. 1–5. https://doi.org/10.1109/HealthCom.2016.7749520.
Khalil A, Rahimi A, Luthfi A, Azizan MM, Satapathy SC, Hasikin K, Lai KW. Brain tumour temporal monitoring of interval change using digital image subtraction technique. Front Public Health. 2021;9: 752509. https://doi.org/10.3389/fpubh.2021.752509.
Karimi D, Salcudean SE. Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networks. IEEE Trans Med Imaging. 2020;39(2):499–513. https://doi.org/10.1109/TMI.2019.2930068.
Huang X, et al. Dynamic 2D ultrasound and 3D CT image registration of the beating heart. IEEE Trans Med Imaging. 2009;28(8):1179–89. https://doi.org/10.1109/TMI.2008.2011557.
Lang P., Rajchl M, Li F, Peters TM. Towards model-enhanced real-time ultrasound guided cardiac interventions. In Proceedings - 2011 International Conference on Intelligent Computation and Bio-Medical Instrumentation, ICBMI 2011. 2011. p. 89–92. https://doi.org/10.1109/ICBMI.2011.24.
Khalil A, Faisal A, Lai KW, Ng SC, Liew YM. 2D to 3D fusion of echocardiography and cardiac CT for TAVR and TAVI image guidance. Med Biol Eng Comput. 2017;55(8):1317–26. https://doi.org/10.1007/s11517-016-1594-6.
Huang X, Hill NA, Ren J, Guiraudon G, Boughner D, Peters TM. Dynamic 3D ultrasound and MR image registration of the beating heart. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2005;3750(LNCS):171–178. https://doi.org/10.1007/11566489_22.
Liang S, et al. Trimodality imaging system and intravascular endoscopic probe: combined optical coherence tomography, fluorescence imaging and ultrasound imaging. Opt Lett. 2014;39(23):6652. https://doi.org/10.1364/ol.39.006652.
Sun Z. Cardiac Imaging Modalities in the Diagnosis of Coronary Artery Disease. J Clin Exp Cardiolog. 2013;S6:1–4. https://doi.org/10.4172/2155-9880.s6-e001.
Prat-Gonzalez S, Sanz J, Garcia MJ. Cardiac CT: Indications and limitations. J Nuclear Med Technol. Soc Nuclear Med. 2008;36(1):18–24. https://doi.org/10.2967/jnmt.107.042424.
Otto CM. Practice of Clinical Echocardiography, Third Edition. 2007.
Ewertsen C, Saftoiu A, Gruionu LG, Karstrup S, Nielsen MB. Real-time image fusion involving diagnostic ultrasound. American Journal of Roentgenology, American Roentgen Ray Soc. 2013;200(3):W249–W255. https://doi.org/10.2214/AJR.12.8904.
Funding
Universiti Sains Islam Malaysia, PPPI/FST/0119/051000/17519, Azira Khalil.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rahimi, A., Khalil, A., Ismail, S. et al. Trimodality image registration of ultrasound, cardiac computed tomography, and magnetic resonance imaging for transcatheter aortic valve implantation and replacement image guidance. Health Technol. 13, 925–936 (2023). https://doi.org/10.1007/s12553-023-00785-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12553-023-00785-9