Abstract
The recovery of 3D tissue structure and morphology during robotic assisted surgery is an important step towards accurate deployment of surgical guidance and control techniques in minimally invasive therapies. In this article, we present a novel stereo reconstruction algorithm that propagates disparity information around a set of candidate feature matches. This has the advantage of avoiding problems with specular highlights, occlusions from instruments and view dependent illumination bias. Furthermore, the algorithm can be used with any feature matching strategy allowing the propagation of depth in very disparate views. Validation is provided for a phantom model with known geometry and this data is available online in order to establish a structured validation scheme in the field. The practical value of the proposed method is further demonstrated by reconstructions on various in vivo images of robotic assisted procedures, which are also available to the community.
Additional material can be found at http://ubimon.doc.ic.ac.uk/dvs/m857.html .
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Stoyanov, D., Lerotic, M., Mylonas, G., Chun, A.J., Yang, G.-Z.: Intra-operative Visualizations: Perceptual Fidelity and Human Factors. J. Display Technol. 4, 491–501 (2008)
Taylor, R.H., Stoianovici, D.: Medical Robotics in Computer-Integrated Surgery. IEEE Trans. Robot. Autom. 19, 765–781 (2003)
Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. Int. J. Comput. Vision 47, 7–42 (2002)
Brown, M.Z., Burschka, D., Hager, G.D.: Advances in Computational Stereo. IEEE Trans. Pattern Anal. Mach. Intell. 25, 993–1008 (2003)
Devernay, F., Mourgues, F., Coste-Maniere, E.: Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery. In: Medical Imaging and Augmented Reality (2001)
Mourgues, F., Devernay, F., Malandain, G., Coste-Manière, È.: 3D reconstruction of the operating field for image overlay in 3D-endoscopic surgery. In: International Symposium on Augmented Reality (2001)
Lau, W.W., Ramey, N.A., Corso, J., Thakor, N.V., Hager, G.D.: Stereo-Based Endoscopic Tracking of Cardiac Surface Deformation. In: International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 494–501 (2004)
Richa, R., Poignet, P., Liu, C.: Efficient 3D Tracking for Motion Compensation in Beating Heart Surgery. In: International Conference on Medical Image Computing and Computer Assisted Intervention, vol. II, pp. 684–691 (2008)
Hager, G., Vagvolgyi, B., Yuh, D.: Stereoscopic Video Overlay with Deformable Registration. In: Medicine Meets Virtual Reality (2007)
Stoyanov, D., Darzi, A., Yang, G.-Z.: A Practical Approach Towards Accurate Dense 3D Depth Recovery for Robotic Laparoscopic Surgery. Comput. Aided Surg. 10, 199–208 (2005)
Shi, J., Tomasi, C.: Good features to track. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
Stoyanov, D., Mylonas, G.P., Deligianni, F., Darzi, A., Yang, G.-Z.: Soft-tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures. In: International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 139–146 (2005)
Sinha, S.N., Frahm, J.-M., Pollefeys, M., Genc, Y.: Feature Tracking and Matching in Video Using Programmable Graphics Hardware. Mach. Vision and Appl. (2007)
Mountney, P., Lo, B.P.L., Thiemjarus, S., Stoyanov, D., Yang, G.-Z.: A Probabilistic Framework for Tracking Deformable Soft Tissue in Minimally Invasive Surgery. In: International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 34–41 (2007)
Lhuillier, M., Quan, L.: Robust dense matching using local and global geometric constraints. In: International Conference on Pattern Recognition, vol. 1, pp. 968–972 (2000)
Yoon, K.-J., Kweon, I.S.: Adaptive Support-Weight Approach for Correspondence Search. IEEE Trans. Pattern Anal. Mach. Intell. 28, 650–656 (2006)
Yang, Q., Wang, L., Yang, R., Stewenius, H., Nister, D.: Stereo Matching with Color-weighted Correlation, Hierarchical Belief Propagation and Occlusion Handling. IEEE Trans. Pattern Anal. Mach. Intell. 31, 492–504 (2009)
Veksler, O.: Fast Variable Window for Stereo Correspondence using Integral Images. In: International Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 556–564 (2003)
Horn, B.K.P.: Closed-form solution of absolute orientation using unit quaternions. J. Optic. Soc. America 4, 629–642 (1987)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Belief Propagation for Early Vision. Int. J. Comput. Vision 70 (2006)
Fung, J., Mann, S., Aimone, C.: OpenVIDIA: Parallel GPU Computer Vision. In: ACM Multimedia, pp. 849–852 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Stoyanov, D., Scarzanella, M.V., Pratt, P., Yang, GZ. (2010). Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery . In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2010. MICCAI 2010. Lecture Notes in Computer Science, vol 6361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15705-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-15705-9_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15704-2
Online ISBN: 978-3-642-15705-9
eBook Packages: Computer ScienceComputer Science (R0)