Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Spatiotemporal registration and fusion of transthoracic echocardiography and volumetric coronary artery tree

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Purpose

Cardiac multimodal image fusion can offer an image with various types of information in a single image. Many coronary stenosis, which are anatomically clear, are not functionally significant. The treatment of such kind of stenosis can cause irreversible effects on the patient. Thus, choosing the best treatment planning depend on anatomical and functional information is very beneficial.

Methods

An algorithm for the fusion of coronary computed tomography angiography (CCTA) as an anatomical and transthoracic echocardiography (TTE) as a functional modality is presented. CCTA and TTE are temporally registered using manifold learning. A pattern search optimization algorithm, using normalized mutual information, is used to find the best match slice to TTE frame from CCTA volume. By employing a free-form deformation, the heart's non-rigid deformations are modeled. The spatiotemporal registered TTE frame is embedded to achieve the fusion result.

Results

The accuracy is evaluated on CCTA and TTE data obtained from 10 patients. In temporal registration, mean absolute error of 1.97 \(\, \pm \, \) 1.23 is resulted from comparing the output frame numbers from the algorithm and from manual assignment by an expert. In spatial registration, the accuracy of the similarity between the best match slice from CCTA volume and TTE frame is resulted in 1.82 \(\, \pm \, \) 0.024 mm, 6.74 \(\, \pm \, \) 0.013 mm, and 0.901 \(\, \pm \, \) 0.0548 due to mean absolute distance, Hausdorff distance, and Dice similarity coefficient, respectively.

Conclusion

Without the use of ECG and Optical tracking systems, a semiautomatic framework of spatiotemporal registration and fusion of CCTA volume and TTE frame is presented. The experimental results showed the effectiveness of our proposed method to create complementary information from TTE and CCTA, which may help in the early diagnosis and effective treatment of cardiovascular diseases (CVDs).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Miller SW, Boxt LM, Abbara S (2009) Cardiac imaging: the requisites. Elsevier Health Sciences

  2. Babić A, Odland HH, Lyseggen E, Holm T, Ross S, Hopp E, Haugaa KH, Kongsgård E, Edvardsen T, Gérard O, Samset E (2019) An image fusion tool for echo-guided left ventricular lead placement in cardiac resynchronization therapy: performance and workflow integration analysis. Echocardiography 36:1834–1845

    Article  Google Scholar 

  3. Sieniewicz BJ, Gould J, Porter B, Sidhu BS, Behar JM, Claridge S, Niederer S, Rinaldi CA (2018) Optimal site selection and image fusion guidance technology to facilitate cardiac resynchronization therapy. Expert Rev Med Devices 15:555–570

    Article  CAS  Google Scholar 

  4. G Kiss, S Ford, P Claus, JD Hooge, and H Torp, (2013) Fusion of 3D echo and cardiac magnetic resonance volumes during live scanning. In: 2013 IEEE International Ultrasonics Symposium (IUS), pp. 832–835

  5. Jalali M, Behnam H, Davoodi F, Shojaeifard M (2020) Temporal super-resolution of 2D/3D echocardiography using cubic B-spline interpolation. Biomed Signal Process Control 58:101868

    Article  Google Scholar 

  6. N Courtial, A Simon, E Donal, M Lederlin, and M Garreau (2019) Cardiac cine-MRI/CT registration for interventions planning. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI) p. 776–779

  7. Tada T, Osuda K, Nakata T, Muranaka I, Himeno M, Muratsubaki S, Murase H, Sato K, Hirose M, Fukuma T (2019) A novel approach to the selection of an appropriate pacing position for optimal cardiac resynchronization therapy using CT coronary venography and myocardial perfusion imaging: FIVE STaR method (fusion image using CT coronary venography and perfusion SPECT applied for cardiac resynchronization therapy). J Nucl Cardiol. https://doi.org/10.1007/s12350-019-01856-z

    Article  PubMed  Google Scholar 

  8. von Spiczak J, Manka R, Gotschy A, Oebel S, Kozerke S, Hamada S, Alkadhi H (2018) Fusion of CT coronary angiography and whole-heart dynamic 3D cardiac MR perfusion: building a framework for comprehensive cardiac imaging. Int J Cardiovasc Imaging 34:649–660

    Article  Google Scholar 

  9. Zandieh S, Bernt R, Mirzaei S, Haller J, Hergan K (2018) Image fusion between 18F-FDG PET and MRI in cardiac sarcoidosis: a case series. J Nucl Cardiol 25:1128–1134

    Article  Google Scholar 

  10. Betancur J, Simon A, Halbert E, Tavard F, Carré F, Hernández A, Donal E, Schnell F, Garreau M (2016) Registration of dynamic multiview 2D ultrasound and late gadolinium enhanced images of the heart: application to hypertrophic cardiomyopathy characterization. Med Image Anal 28:13–21

    Article  Google Scholar 

  11. Khalil A, Faisal A, Lai KW, Ng SC, Liew YM (2017) 2D to 3D fusion of echocardiography and cardiac CT for TAVR and TAVI image guidance. Med Biol Eng Comput 55:1317–1326

    Article  Google Scholar 

  12. Markelj P, Tomaževič D, Likar B, Pernuš F (2012) A review of 3D/2D registration methods for image-guided interventions. Med Image Anal 16:642–661

    Article  CAS  Google Scholar 

  13. Tavard F, Simon A, Leclercq C, Donal E, Hernández AI, Garreau M (2014) Multimodal registration and data fusion for cardiac resynchronization therapy optimization. IEEE Trans Med Imaging 33:1363–1372

    Article  Google Scholar 

  14. G Kiss, A Thorstensen, B Amundsen, P Claus, JD hooge, and H Torp, (2012) Fusion of 3D echocardiographic and cardiac magnetic resonance volumes. In: 2012 IEEE International Ultrasonics Symposium, pp. 126–129

  15. Maffessanti F, Addetia K, Murtagh G, Weinert L, Patel AR, Lang RM, Mor-Avi V (2014) Fusion imaging of computed tomography and 3D echocardiography: combined assessment of coronary anatomy and myocardial function. Comput Cardiol 2014:701–704

    Google Scholar 

  16. Nobre C, Oliveira-Santos M, Paiva L, Costa M, Gonçalves L (2020) Fusion imaging in interventional cardiology. Revista Portuguesa de Cardiologia 39:463–473

    Article  Google Scholar 

  17. Nordenfur T, Babic A, Bulatovic I, Giesecke A, Günyeli E, Ripsweden J, Samset E, Winter R, Larsson M (2018) Method comparison for cardiac image registration of coronary computed tomography angiography and 3-D echocardiography. J Med Imaging (Bellingham, Wash.) 5:014001–01400

    Google Scholar 

  18. Peters A, Motiwala A, O’Neill B, Patil P (2020) Novel use of fused cardiac computed tomography and transesophageal echocardiography for left atrial appendage closure. Catheter Cardiovasc Interv. https://doi.org/10.1002/ccd.28840

    Article  PubMed  Google Scholar 

  19. Takaya Y, Ito H (2020) New horizon of fusion imaging using echocardiography: its progress in the diagnosis and treatment of cardiovascular disease. J Echocardiogr 18:9–15

    Article  Google Scholar 

  20. Betancur J, Simon A, Langella B, Leclercq C, Hernandez A, Garreau M (2016) Synchronization and registration of cine magnetic resonance and dynamic computed tomography images of the heart. IEEE J Biomed Health Inform 20:1369–1376

    Article  Google Scholar 

  21. Shalbaf A, Behnam H, Alizade-Sani Z, Shojaifard M (2012) Left ventricle wall motion quantification from echocardiographic images by non-rigid image registration. Int J Comput Assist Radiol Surg 7:769–783

    Article  Google Scholar 

  22. Maffessanti F, Patel AR, Patel MB, Walter JJ, Mediratta A, Medvedofsky D, Kachenoura N, Lang RM, Mor-Avi V (2017) Non-invasive assessment of the haemodynamic significance of coronary stenosis using fusion of cardiac computed tomography and 3D echocardiography. Eur Heart J Cardiovasc Imaging 18:670–680

    PubMed  Google Scholar 

  23. Peoples JJ, Bisleri G, Ellis RE (2019) Deformable multimodal registration for navigation in beating-heart cardiac surgery. Int J Comput Assist Radiol Surg 14:955–966

    PubMed  Google Scholar 

  24. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323

    Article  CAS  Google Scholar 

  25. S Liu, J Wei, B Feng, W Lu, B Denby, Q Fang, and J Dang, (2012) An anisotropic diffusion filter for reducing speckle noise of ultrasound images based on separability. In: Proceedings of the 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, pp. 1–4

  26. H Choi and J Jeong, (2018) Speckle noise reduction in ultrasound images using SRAD and guided filter. In: 2018 International Workshop on Advanced Image Technology (IWAIT), pp. 1-4

  27. Yongjian Y, Acton ST (2002) Speckle reducing anisotropic diffusion. IEEE Trans Image Process 11:1260–1270

    Article  Google Scholar 

  28. R Sigit and E Rochmawati, (2016) Segmentation echocardiography video using B-spline and optical flow. In: 2016 International Conference on Knowledge Creation and Intelligent Computing (KCIC), pp. 226-231

  29. Hooke R, Jeeves TA (1961) “Direct Search” solution of numerical and statistical problems. J ACM 8:212–229

    Article  Google Scholar 

  30. Al-Sumait JS, Al-Othman AK, Sykulski JK (2007) Application of pattern search method to power system valve-point economic load dispatch. Int J Electr Power Energy Syst 29:720–730

    Article  Google Scholar 

  31. A Khalil, YM Liew, SC Ng, KW Lai, and YC Hum, (2016) Echocardiography to cardiac CT image registration: spatial and temporal registration of the 2D planar echocardiography images with cardiac CT volume. In: 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom), pp. 1–5

  32. Rueckert D, Sonoda LI, Hayes C, Hill DLG, Leach MO, Hawkes DJ (1999) Nonrigid registration using free-form deformations: application to breast MR images. IEEE Trans Med Imaging 18:712–721

    Article  CAS  Google Scholar 

  33. Frangi AF, Niessen WJ, Vincken KL, Viergever MA (1998) Multiscale vessel enhancement filtering. Springer, Berlin, Heidelberg, pp 130–137

    Google Scholar 

  34. Gifani P, Behnam H, Sani ZA (2011) A new method for pseudo-increasing frame rates of echocardiography images using manifold learning. J Med Signals Sens 1:107–112

    Article  Google Scholar 

  35. Klabunde RE (2012) Cardiovascular physiology concepts. Lippincott Williams & Wilkins, United States

    Google Scholar 

  36. Chalana V, Linker DT, Haynor DR, Yongmin K (1996) A multiple active contour model for cardiac boundary detection on echocardiographic sequences. IEEE Trans Med Imaging 15:290–298

    Article  CAS  Google Scholar 

  37. Huttenlocher DP, Klanderman GA, Rucklidge WJ (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15:850–863

    Article  Google Scholar 

  38. Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302

    Article  Google Scholar 

  39. Atehortúa A, Garreau M, Simon A, Donal E, Lederlin M, Romero E (2020) Fusion of 3D real-time echocardiography and cine MRI using a saliency analysis. Int J Comput Assist Radiol Surg 15:277–285

    Article  Google Scholar 

  40. Arafati A, Morisawa D, Avendi MR, Amini MR, Assadi RA, Jafarkhani H, Kheradvar A (2020) Generalizable fully automated multi-label segmentation of four-chamber view echocardiograms based on deep convolutional adversarial networks. J R Soc Interface 17:20200267

    Article  Google Scholar 

Download references

Funding

No funds, grants, or other support was received.

Author information

Authors and Affiliations

  1. Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Talayeh Ghodsizad

  2. Department of Biomedical Engineering, Iran University of Science and Technology, Tehran, Iran

    Hamid Behnam

  3. Department of Electrical Engineering, Sharif University of Technology, Tehran, Iran

    Emad Fatemizadeh

  4. Department of Radiology, Modarres Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran

    Taraneh Faghihi Langroudi

  5. Cardiovascular Research Center, Modarres Hospital, Shahid Beheshti University of Medical Sciences, Tehran, Iran

    Fariba Bayat

Authors
  1. Talayeh Ghodsizad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamid Behnam
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emad Fatemizadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Taraneh Faghihi Langroudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fariba Bayat
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamid Behnam.

Ethics declarations

Conflict of interest

Talayeh Ghodsizad declares that she has no conflicts of interest. Hamid Behnam declares that he has no conflicts of interest. Emad Fatemizadeh declares that he has no conflicts of interest. Taraneh Faghihi Lagroudi declares that she has no conflicts of interest. Fariba Bayat declares that she has no conflicts of interest.

Ethical approval

Patients data were collected according to the Helsinki Declaration and with the approval of the study by the Regional Committee for Medical Research Ethics.

Consent for publication

Written informed consent was obtained from patients for being included in the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ghodsizad, T., Behnam, H., Fatemizadeh, E. et al. Spatiotemporal registration and fusion of transthoracic echocardiography and volumetric coronary artery tree. Int J CARS 16, 1493–1505 (2021). https://doi.org/10.1007/s11548-021-02421-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-021-02421-1

Keywords

Search

Navigation