Abstract
In the context of minimally-invasive procedures involving both endoscopic video and ultrasound, we present a vision-based method to track the ultrasound probe using a standard monocular video laparoscopic instrument. This approach requires only cosmetic modification to the ultrasound probe and obviates the need for magnetic tracking of either instrument. We describe an Extended Kalman Filter framework that solves for both the feature correspondence and pose estimation, and is able to track a 3D pattern on the surface of the ultrasound probe in near real-time. The tracking capability is demonstrated by performing an ultrasound calibration of a visually-tracked ultrasound probe, using a standard endoscopic video camera. Ultrasound calibration resulted in a mean TRE of 2.3mm, and comparison with an external optical tracker demonstrated a mean FRE of 4.4mm between the two tracking systems.
Chapter PDF
Similar content being viewed by others
Keywords
- Tracking Error
- Gaussian Mixture Model
- Transanal Endoscopic Microsurgery
- Target Registration Error
- Optical Tracking System
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bennett, S., Lasenby, J.: ChESS - Quick and Robust Detection of Chess-board Features. Computing Research Repository (CoRR) abs/1301.5491 (2013)
Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools (2000)
Cheng, A., Kang, J.U., Taylor, R.H., Boctor, E.M.: Direct 3D Ultrasound to Video Registration Using Photoacoustic Effect. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part II. LNCS, vol. 7511, pp. 552–559. Springer, Heidelberg (2012)
Cheung, C.L., Wedlake, C., Moore, J., Pautler, S.E., Peters, T.M.: Fused Video and Ultrasound Images for Minimally Invasive Partial Nephrectomy: A Phantom Study. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part III. LNCS, vol. 6363, pp. 408–415. Springer, Heidelberg (2010)
Figueiredo, M., Jain, A.: Unsupervised learning of finite mixture models. IEEE Trans. on PAMI 24(3), 381–396 (2002)
Gobbi, D.G., Comeau, R.M., Lee, B.K., Peters, T.M.: Correlation of pre-operative MRI and intra-operative 3D ultrasound to measure brain tissue shift. In: Medical Imaging. Proc. SPIE 3982, pp. 77–84 (2000)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Proc. of Fourth Alvey Vision Conference, pp. 147–151 (1988)
Langø, T., Vijayan, S., Rethy, A., Våpenstad, C., Solberg, O., Mårvik, R., Johnsen, G., Hernes, T.N.: Navigated Laparoscopic ultrasound in abdominal soft tissue surgery: technological overview and perspectives. International Journal of Computer Assisted Radiology and Surgery 7(4), 585–599 (2012)
Leven, J., et al.: DaVinci Canvas: A Telerobotic Surgical System with Integrated, Robot-Assisted, Laparoscopic Ultrasound Capability. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 811–818. Springer, Heidelberg (2005)
Lu, C.P., Hager, G.D., Mjolsness, E.: Fast and globally convergent pose estimation from video images. IEEE Trans. on PAMI 22(6), 610–622 (2000)
Moreno-Noguer, F., Lepetit, V., Fua, P.: Pose Priors for Simultaneously Solving Alignment and Correspondence. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 405–418. Springer, Heidelberg (2008)
Pratt, P., Di Marco, A., Payne, C., Darzi, A., Yang, G.-Z.: Intraoperative Ultrasound Guidance for Transanal Endoscopic Microsurgery. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part I. LNCS, vol. 7510, pp. 463–470. Springer, Heidelberg (2012)
Wu, Y., Hu, Z.: PnP Problem Revisited. Journal of Mathematical Imaging and Vision 24(1), 131–141 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jayarathne, U.L., McLeod, A.J., Peters, T.M., Chen, E.C.S. (2013). Robust Intraoperative US Probe Tracking Using a Monocular Endoscopic Camera. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2013. MICCAI 2013. Lecture Notes in Computer Science, vol 8151. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40760-4_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-40760-4_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40759-8
Online ISBN: 978-3-642-40760-4
eBook Packages: Computer ScienceComputer Science (R0)