Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

High-Precision 5DoF Tracking and Visualization of Catheter Placement in EVD of the Brain Using AR

Published: 11 March 2020 Publication History

Abstract

External ventricular drainage (EVD) is a high-risk medical procedure that involves inserting a catheter inside a patient’s skull, through the brain and into a ventricle, to drain cerebrospinal fluid and thus relieve elevated intracranial pressure. Once the catheter has entered the skull, its tip cannot be seen. The neurosurgeon has to imagine its location inside the cranium and direct it toward the ventricle using only anatomic landmarks. The EVD catheter is thin and thus hard to track using infra-red depth sensors. Traditional optical tracking using fiducial or other markers inevitably changes the shape or weight of the medical instrument. We present an augmented reality system that depicts the catheter for EVD and a new technique to precisely track the catheter inside the skull. Our technique uses a new linear marker detection method that requires minimal changes to the catheter and is well suited for tracking other thin medical devices that require high-precision tracking.

References

[1]
Yuichiro Abe, Shigenobu Sato, Koji Kato, Takahiko Hyakumachi, Yasushi Yanagibashi, Manabu Ito, and Kuniyoshi Abumi. 2013. A novel 3D guidance system using augmented reality for percutaneous vertebroplasty. Journal of Neurosurgery: Spine 19, 4 (2013), 492--501.
[2]
Kamyar Abhari, John S. H. Baxter, Elvis C. S. Chen, Ali R. Khan, Terry M. Peters, Sandrine de Ribaupierre, and Roy Eagleson. 2014. Training for planning tumour resection: Augmented reality and human factors. IEEE Transactions on Biomedical Engineering 62, 6 (2014), 1466--1477.
[3]
Marc-André Ameller, Bill Triggs, and Long Quan. 2000. Camera pose revisited: New linear algorithms. https://hal.inria.fr/inria-00548306.
[4]
Ehsan Azimi, Camilo Molina, Alexander Chang, Judy Huang, Chien-Ming Huang, and Peter Kazanzides. 2018. Interactive training and operation ecosystem for surgical tasks in mixed reality. In OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis. Springer, 20--29.
[5]
P. Pat Banerjee, Cristian J. Luciano, G. Michael Lemole Jr., Fady T. Charbel, and Michael Y. Oh. 2007. Accuracy of ventriculostomy catheter placement using a head-and hand-tracked high-resolution virtual reality simulator with haptic feedback. Journal of Neurosurgery 107, 3 (2007), 515--521.
[6]
Ehsan Basafa, Pezhman Foroughi, Martin Hossbach, Jasmine Bhanushali, and Philipp Stolka. 2017. Visual tracking for multi-modality computer-assisted image guidance. In Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10135. International Society for Optics and Photonics, Bellingham, WA, 101352S.
[7]
Olivier Cros, Morten Volden, Jens Jørgen Flaaris, Lars Chebørløv Brix, Christian Fischer Pedersen, Kim Vang Hansen, Ole Vilhelm Larsen, Lasse Riis Østergaard, and Jens Haase. 2002. Simulating the puncture of the human ventricle. In Proceedings of the 10th Annual Medicine Meets Virtual Reality Conference.
[8]
Andrew Benjamin Cutler, Shervin Rahimpour, Yameng Liu, Nandan Lad, Regis Kopper, and Patrick Codd. 2017. Development of augmented reality-based neuro-navigation system for use in external ventricular drain placement. Journal of Neurosurgery . 126 (2017), A1438. https://youtu.be/qqykWW9f41Q.
[9]
Ruofei Du, Ming Chuang, Wayne Chang, Hugues Hoppe, and Amitabh Varshney. 2019. Montage4D: Real-time seamless fusion and stylization of multiview video textures. Journal of Computer Graphics Techniques 8, 1 (Jan. 2019), 1--34.
[10]
Philip J. Edwards, Derek L. G. Hill, David J. Hawkes, R. Spink, Alan C. F. Colchester, A. Strong, and M. Gleeson. 1995. Neurosurgical guidance using the stereo microscope. In Computer Vision, Virtual Reality and Robotics in Medicine. Springer, 555--564.
[11]
Philip J. Edwards, Laura G. Johnson, David J. Hawkes, Michael R. Fenlon, Anthony J. Strong, and Michael J. Gleeson. 2004. Clinical experience and perception in stereo augmented reality surgical navigation. In Proceedings of the International Workshop on Medical Imaging and Virtual Reality. Springer, 369--376.
[12]
P. J. Edwards, A. P. King, C. R. Maurer, D. A. De Cunha, D. J. Hawkes, D. L. G. Hill, R. P. Gaston, et al. 2000. Design and evaluation of a system for microscope-assisted guided interventions (MAGI). IEEE Transactions on Medical Imaging 19, 11 (2000), 1082--1093.
[13]
Zhencheng Fan, Guowen Chen, Junchen Wang, and Hongen Liao. 2017. Spatial position measurement system for surgical navigation using 3-D image marker-based tracking tools with compact volume. IEEE Transactions on Biomedical Engineering 65, 2 (2017), 378--389.
[14]
Taylor Frantz, Bart Jansen, Johnny Duerinck, and Jef Vandemeulebroucke. 2018. Augmenting Microsoft’s HoloLens with vuforia tracking for neuronavigation. Healthcare Technology Letters 5, 5 (2018), 221--225.
[15]
Herbert I. Fried, Barnett R. Nathan, A. Shaun Rowe, Joseph M. Zabramski, Norberto Andaluz, Adarsh Bhimraj, Mary McKenna Guanci, David B. Seder, and Jeffrey M. Singh. 2016. The insertion and management of external ventricular drains: An evidence-based consensus statement. Neurocritical Care 24, 1 (2016), 61--81.
[16]
Xiao-Shan Gao, Xiao-Rong Hou, Jianliang Tang, and Hang-Fei Cheng. 2003. Complete solution classification for the perspective-three-point problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 25, 8 (2003), 930--943.
[17]
Daipayan Guha, Naif M. Alotaibi, Nhu Nguyen, Shaurya Gupta, Christopher McFaul, and Victor X. D. Yang. 2017. Augmented reality in neurosurgery: A review of current concepts and emerging applications. Canadian Journal of Neurological Sciences 44, 3 (2017), 235--245.
[18]
David R. Huyette, Benjamin J. Turnbow, Christian Kaufman, Dale F. Vaslow, Benjamin B. Whiting, and Michael Y. Oh. 2008. Accuracy of the freehand pass technique for ventriculostomy catheter placement: Retrospective assessment using computed tomography scans. Journal of Neurosurgery 108, 1 (2008), 88--91.
[19]
D. Inoue, B. Cho, M. Mori, Y. Kikkawa, T. Amano, A. Nakamizo, K. Yoshimoto, et al. 2013. Preliminary study on the clinical application of augmented reality neuronavigation. Journal of Neurological Surgery Part A: Central European Neurosurgery 74, 02 (2013), 071--076.
[20]
Udaya K. Kakarla, Louis J. Kim, Steven W. Chang, Nicholas Theodore, and Robert F. Spetzler. 2008. Safety and accuracy of bedside external ventricular drain placement. Operative Neurosurgery 63, suppl._1 (2008), ONS162--ONS167.
[21]
Marta Kersten-Oertel, Pierre Jannin, and D. Louis Collins. 2013. The state of the art of visualization in mixed reality image guided surgery. Computerized Medical Imaging and Graphics 37, 2 (2013), 98--112.
[22]
Ralf A. Kockro, Yeo Tseng Tsai, Ivan Ng, Peter Hwang, Chuangui Zhu, Kusuma Agusanto, Liang Xiao Hong, and Luis Serra. 2009. DEX-Ray: Augmented reality neurosurgical navigation with a handheld video probe. Neurosurgery 65, 4 (2009), 795--808.
[23]
G. Krombach, A. Ganser, Ch Fricke, V. Rohde, M. Reinges, J. Gilsbach, and U. Spetzger. 2000. Virtual placement of frontal ventricular catheters using frameless neuronavigation: An “unbloody training” for young neurosurgeons. Minimally Invasive Neurosurgery 43, 04 (2000), 171--175.
[24]
Timur Kuzhagaliyev, Neil T. Clancy, Mirek Janatka, Kevin Tchaka, Francisco Vasconcelos, Matthew J. Clarkson, Kurinchi Gurusamy, David J. Hawkes, Brian Davidson, and Danail Stoyanov. 2018. Augmented reality needle ablation guidance tool for irreversible electroporation in the pancreas. In Medical Imaging 2018: Image-Guided Procedures, Robotic Interventions, and Modeling, Vol. 10576. International Society for Optics and Photonics, Bellingham, WA, 1057613.
[25]
G. Michael Lemole Jr., P. Pat Banerjee, Cristian Luciano, Sergey Neckrysh, and Fady T. Charbel. 2007. Virtual reality in neurosurgical education: Part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 61, 1 (2007), 142--149.
[26]
Ye Li, Xiaolei Chen, Ning Wang, Wenyao Zhang, Dawei Li, Lei Zhang, Xin Qu, et al. 2018. A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside. Journal of Neurosurgery 1, AOP (2018), 1--8.
[27]
M. A. Lin, A. F. Siu, J. H. Bae, M. R. Cutkosky, and B. L. Daniel. 2018. HoloNeedle: Augmented reality guidance system for needle placement investigating the advantages of three-dimensional needle shape reconstruction. IEEE Robotics and Automation Letters 3, 4 (Oct. 2018), 4156--4162.
[28]
Eduardo E. Lovo, Juan C. Quintana, Manuel C. Puebla, Gonzalo Torrealba, José L. Santos, Isidro H. Lira, and Patricio Tagle. 2007. A novel, inexpensive method of image coregistration for applications in image-guided surgery using augmented reality. Operative Neurosurgery 60, suppl._4 (2007), ONS--366.
[29]
David Low, Cheng Kiang Lee, Lee Lian Tay Dip, Wai Hoe Ng, Beng Ti Ang, and Ivan Ng. 2010. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. British Journal of Neurosurgery 24, 1 (2010), 69--74.
[30]
Cristian Luciano, Pat Banerjee, G. Michael Lemole, and Fady Charbel. 2005. Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. Studies in Health Technology and Informatics 119 (2005), 343.
[31]
Eric Marchand, Hideaki Uchiyama, and Fabien Spindler. 2016. Pose estimation for augmented reality: A hands-on survey. IEEE Transactions on Visualization and Computer Graphics 22, 12 (2016), 2633--2651.
[32]
Yoshitaka Masutani, Takeyoshi Dohi, Fumitaka Yamane, Hiroshi Iseki, and Kintomo Takakura. 1998. Augmented reality visualization system for intravascular neurosurgery. Computer Aided Surgery 3, 5 (1998), 239--247.
[33]
Calvin R. Maurer Jr., Frank Sauer, Bo Hu, Benedicte Bascle, Bernhard Geiger, Fabian Wenzel, Filippo Recchi, et al. 2001. Augmented reality visualization of brain structures with stereo and kinetic depth cues: System description and initial evaluation with head phantom. Medical Imaging 2001 (2001), 445--456.
[34]
Xiaoxu Meng, Ruofei Du, Matthias Zwicker, and Amitabh Varshney. 2018. Kernel foveated rendering. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1, (May 2018), Article 5, 20 pages.
[35]
Antonio Meola, Fabrizio Cutolo, Marina Carbone, Federico Cagnazzo, Mauro Ferrari, and Vincenzo Ferrari. 2016. Augmented reality in neurosurgery: A systematic review. Neurosurgical Review 40, 4 (2016), 537--548.
[36]
Mohammad Najafi, Purang Abolmaesumi, and Robert Rohling. 2015. Single-camera closed-form real-time needle tracking for ultrasound-guided needle insertion. Ultrasound in Medicine 8 Biology 41, 10 (2015), 2663--2676.
[37]
Mohammad Najafi and Robert Rohling. 2011. Single camera closed-form real-time needle trajectory tracking for ultrasound. In Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, Vol. 7964. International Society for Optics and Photonics, Bellingham, WA, 79641F.
[38]
Diederick C. Niehorster, Li Li, and Markus Lappe. 2017. The accuracy and precision of position and orientation tracking in the HTC Vive virtual reality system for scientific research. i-Perception 8, 3 (2017), 177--205.
[39]
Shaun T. O’Leary, Max K. Kole, Devon A. Hoover, Steven E. Hysell, Ajith Thomas, and Christopher I. Shaffrey. 2000. Efficacy of the Ghajar Guide revisited: A prospective study. Journal of Neurosurgery 92, 5 (2000), 801--803.
[40]
Nicholas I. Phillips and Nigel W. John. 2000. Web-based surgical simulation for ventricular catheterization. Neurosurgery 46, 4 (2000), 933--937.
[41]
Long Quan and Zhongdan Lan. 1999. Linear n-point camera pose determination. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8 (1999), 774--780.
[42]
Faith C. Robertson, Muhammad M. Abd-El-Barr, Srinivasan Mukundan, and William B. Gormley. 2017. Ventriculostomy-associated hemorrhage: A risk assessment by radiographic simulation. Journal of Neurosurgery 127, 3 (2017), 532--536.
[43]
Frank Sauer, Ali Khamene, Benedicte Bascle, and Gregory J. Rubino. 2001. A head-mounted display system for augmented reality image guidance: Towards clinical evaluation for iMRI-guided neurosurgery. In Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention. 707--716.
[44]
Clemens M. Schirmer, J. Bradley Elder, Ben Roitberg, and Darlene A. Lobel. 2013. Virtual reality--based simulation training for ventriculostomy: An evidence-based approach. Neurosurgery 73, suppl. 1 (2013), S66--S73.
[45]
M. Scholz, W. Konen, S. Tombrock, B. Fricke, L. Adams, M. Von Duering, A. Hentsch, L. Heuser, and A. G. Harders. 1998. Development of an endoscopic navigation system based on digital image processing. Computer Aided Surgery 3, 3 (1998), 134--143.
[46]
Ramin Shahidi, Bai Wang, Marc Epitaux, Robert Grzeszczuk, and John Adler. 1998. Volumetric image guidance via a stereotactic endoscope. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. 241--252.
[47]
Visish M. Srinivasan, Brent R. O’Neill, Diana Jho, Donald M. Whiting, and Michael Y. Oh. 2014. The history of external ventricular drainage: Historical vignette. Journal of Neurosurgery 120, 1 (2014), 228--236.
[48]
Philipp J. Stolka, Pezhman Foroughi, Matthew Rendina, Clifford R. Weiss, Gregory D. Hager, and Emad M. Boctor. 2014. Needle guidance using handheld stereo vision and projection for ultrasound-based interventions. In Medical Image Computing and Computer-Assisted Intervention—MICCAI 2014. Lecture Notes in Computer Science, Vol. 8647. Springer, 684--691.
[49]
Xuetong Sun and Amitabh Varshney. 2018. Investigating perception time in the far peripheral vision for virtual and augmented reality. In Proceedings of the 15th ACM Symposium on Applied Perception (SAP’18). ACM, New York, NY, Article 13, 8 pages.
[50]
Bruce L. Tai, Deborah Rooney, Francesca Stephenson, Peng-Siang Liao, Oren Sagher, Albert J. Shih, and Luis E. Savastano. 2015. Development of a 3D-printed external ventricular drain placement simulator. Journal of Neurosurgery 123, 4 (2015), 1070--1076.
[51]
Peter Y. M. Woo, Ben C. F. Ng, Jacob X. Xiao, Daniel Wong, Andrew Seto, Sandy Lam, Carmen Yim, et al. 2019. The importance of aspirin, catheterization accuracy, and catheter design in external ventricular drainage-related hemorrhage: A multicenter study of 1002 procedures. Acta Neurochirurgica 161, 8 (Aug. 2019), 1623--1632.
[52]
Rachel Yudkowsky, Cristian Luciano, Pat Banerjee, Alan Schwartz, Ali Alaraj, G. Michael Lemole Jr., Fady Charbel, et al. 2013. Practice on an augmented reality/haptic simulator and library of virtual brains improves residents’ ability to perform a ventriculostomy. Simulation in Healthcare 8, 1 (2013), 25--31.

Cited By

View all
  • (2024)MR Microsurgical Suture Training System with Level-Appropriate SupportProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642324(1-19)Online publication date: 11-May-2024
  • (2024): Visualization of AI-Assisted Task Guidance in ARIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332739630:1(1313-1323)Online publication date: 1-Jan-2024
  • (2023)Overview and Tendencies of Augmented Reality Applications in MedicineProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625013(26-37)Online publication date: 6-Nov-2023
  • Show More Cited By

Index Terms

  1. High-Precision 5DoF Tracking and Visualization of Catheter Placement in EVD of the Brain Using AR

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Computing for Healthcare
      ACM Transactions on Computing for Healthcare  Volume 1, Issue 2
      April 2020
      90 pages
      EISSN:2637-8051
      DOI:10.1145/3387924
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 March 2020
      Accepted: 01 October 2019
      Revised: 01 July 2019
      Received: 01 November 2018
      Published in HEALTH Volume 1, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. 5DoF tracking
      2. Augmented reality
      3. assisted surgery
      4. catheter placement
      5. external ventricular drain

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)216
      • Downloads (Last 6 weeks)31
      Reflects downloads up to 30 Aug 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)MR Microsurgical Suture Training System with Level-Appropriate SupportProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642324(1-19)Online publication date: 11-May-2024
      • (2024): Visualization of AI-Assisted Task Guidance in ARIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332739630:1(1313-1323)Online publication date: 1-Jan-2024
      • (2023)Overview and Tendencies of Augmented Reality Applications in MedicineProceedings of the 25th Symposium on Virtual and Augmented Reality10.1145/3625008.3625013(26-37)Online publication date: 6-Nov-2023
      • (2023)Evaluation of AR visualization approaches for catheter insertion into the ventricle cavityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324704229:5(2434-2445)Online publication date: 1-May-2023
      • (2023)Objective Image Quality Optimization in Augmented Reality Using Spatial Frequency Domain ModelsIEEE Transactions on Medical Imaging10.1109/TMI.2023.327308742:10(3036-3047)Online publication date: Oct-2023
      • (2023)Visualization, registration and tracking techniques for augmented reality guided surgery: a reviewPhysics in Medicine & Biology10.1088/1361-6560/acaf2368:4(04TR02)Online publication date: 17-Feb-2023
      • (2022)NeuroLens: Augmented Reality-based Contextual Guidance through Surgical Tool Tracking in Neurosurgery2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00051(355-364)Online publication date: Oct-2022
      • (2022)Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic reviewMedical Image Analysis10.1016/j.media.2022.10236177(102361)Online publication date: Apr-2022
      • (2022)Evaluation Challenges for the Application of Extended Reality Devices in MedicineJournal of Digital Imaging10.1007/s10278-022-00622-x35:5(1409-1418)Online publication date: 25-Apr-2022
      • (2022)18‐2: Assessment of Image Quality in Augmented Reality Displays Using a Computational Model of Target DetectabilitySID Symposium Digest of Technical Papers10.1002/sdtp.1545153:1(194-197)Online publication date: 28-Jun-2022
      • Show More Cited By

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Get Access

      Login options

      Full Access

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media