Efficient Position-Based Deformable Colon Modeling for Endoscopic Procedures Simulation
Authors: 
Marcelo Martins, Lucas Morais, Rafael Torchelsen, 
Luciana Nedel, 
Anderson MacielAuthors Info & Claims
Marcelo Martins, Lucas Morais, Rafael Torchelsen, Luciana Nedel, Anderson MacielAuthors Info & ClaimsArticle No.: 91, Pages 1 - 10
Abstract
Current endoscopy simulators oversimplify navigation and interaction within tubular anatomical structures to maintain interactive frame rates, neglecting the intricate dynamics of permanent contact between the organ and the medical tool. Traditional algorithms fail to represent the complexities of long, slender, deformable tools like endoscopes and hollow organs, such as the human colon, and their interaction.
In this paper, we address longstanding challenges hindering the realism of surgery simulators, explicitly focusing on these structures. One of the main components we introduce is a new model for the overall shape of the organ, which is challenging to retain due to the complex surroundings inside the abdomen. Our approach uses eXtended Position-Based Dynamics (XPBD) with a Cosserat rod constraint combined with a mesh of tetrahedrons to retain the colon’s shape. We also introduce a novel contact detection algorithm for tubular structures, allowing for real-time performance. This comprehensive representation captures global deformations and local features, significantly enhancing simulation fidelity compared to previous works.
Results showcase that navigating the endoscope through our simulated colon seemingly mirrors real-world operations. Additionally, we use real-patient data to generate the colon model, resulting in a highly realistic virtual colonoscopy simulation. Integrating efficient simulation techniques with practical medical applications arguably advances surgery simulation realism.
Supplemental Material
MP4 File - presentation
presentation
- Download
- 466.27 MB
MP4 File
"Demonstration video", "Supplemental document with parameters and other details for reproducibility"
- Download
- 454.92 MB
MP4 File
Supplementary technical video, Supplementary document
- Download
- 454.92 MB
PDF File
"Demonstration video", "Supplemental document with parameters and other details for reproducibility"
- Download
- 1.95 MB
PDF File
Supplementary technical video, Supplementary document
- Download
- 1.94 MB
References
[1]
David Baraff. 1996. Linear-time dynamics using Lagrange multipliers. In Proc. of the 23rd annual conference on Computer graphics and interactive techniques. 137–146.
[2]
Jernej Barbic. 2012. SIGGRAPH 2012 Course Notes FEM Simulation of 3D Deformable Solids: A practitioner’s guide to theory, discretization and model reduction. Part 2: Model Reduction (version: August 4, 2012). (2012).
[3]
Jan Bender, Kenny Erleben, and Jeff Trinkle. 2014. Interactive simulation of rigid body dynamics in computer graphics. In Computer Graphics Forum, Vol. 33. 246–270.
[4]
Gino van den Bergen. 1997. Efficient collision detection of complex deformable models using AABB trees. Journal of graphics tools 2, 4 (1997), 1–13.
[5]
Iago Berndt, Rafael Torchelsen, and Anderson Maciel. 2017. Efficient Surgical Cutting with Position-Based Dynamics. IEEE Computer Graphics and Applications 37 (5 2017), 24–31. Issue 3. https://doi.org/10.1109/MCG.2017.45
[6]
K. Byrnes, D. Walsh, P. Dockery, K. McDermott, and J. Coffey. 2019. Anatomy of the mesentery: Current understanding and mechanisms of attachment.Seminars in cell and developmental biology (2019). https://doi.org/10.1016/j.semcdb.2018.10.004
[7]
Steve Capell, Seth Green, Brian Curless, Tom Duchamp, and Zoran Popović. 2002. Interactive skeleton-driven dynamic deformations. ACM Trans. Graph. 21, 3 (jul 2002), 586–593. https://doi.org/10.1145/566654.566622
[8]
Edwin Catmull and Raphael Rom. 1974. A class of local interpolating splines. In Computer aided geometric design. Elsevier, 317–326.
[9]
O. Cetinaslan. 2021. ESPEFs: Exponential Spring Potential Energy Functions for Simulating Deformable Objects. Proceedings of the 14th ACM SIGGRAPH Conference on Motion, Interaction and Games (2021). https://doi.org/10.1145/3487983.3488303
[10]
O. Cetinaslan and Rafael O. Chaves. 2019. Energy Embedded Gauss-Seidel Iteration for Soft Body Simulations. 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) (2019), 147–154. https://doi.org/10.1109/SIBGRAPI.2019.00028
[11]
Jian Chang, Xiaosong Yang, Jun J. Pan, Wenxi Li, and Jian J. Zhang. 2011. A fast hybrid computation model for rectum deformation. The Visual Computer 27 (2 2011), 97–107. Issue 2. https://doi.org/10.1007/s00371-010-0533-z
[12]
Nuttapong Chentanez, Ron Alterovitz, Daniel Ritchie, Lita Cho, Kris K. Hauser, Ken Goldberg, Jonathan R. Shewchuk, and James F. O’Brien. 2009. Interactive simulation of surgical needle insertion and steering. ACM Trans. Graph. 28, 3, Article 88 (jul 2009), 10 pages. https://doi.org/10.1145/1531326.1531394
[13]
A Ram Choi, Sung Min Kim, and Mee Young Sung. 2017. Controlling the contact levels of details for fast and precise haptic collision detection. Frontiers of Information Technology & Electronic Engineering 18, 8 (2017), 1117–1130.
[14]
Michael B Cline and Dinesh K Pai. 2003. Post-stabilization for rigid body simulation with contact and constraints. In 2003 IEEE International Conference on Robotics and Automation (Cat. No. 03CH37422), Vol. 3. IEEE, 3744–3751.
[15]
Crispin Deul, Tassilo Kugelstadt, Marcel Weiler, and Jan Bender. 2018. Direct Position-Based Solver for Stiff Rods. Computer Graphics Forum 37 (9 2018), 313–324. Issue 6. https://doi.org/10.1111/cgf.13326
[16]
Vincent K Dik, Leon MG Moons, and Peter D Siersema. 2014. Endoscopic innovations to increase the adenoma detection rate during colonoscopy. World journal of gastroenterology: WJG 20, 9 (2014), 2200.
[17]
Chyke A Doubeni, D. Corley, V. Quinn, Christopher D. Jensen, A. Zauber, M. Goodman, Jill R Johnson, S. Mehta, T. A. Becerra, Wei K. Zhao, J. Schottinger, V. P. Doria-Rose, T. Levin, N. Weiss, and R. Fletcher. 2016. Effectiveness of screening colonoscopy in reducing the risk of death from right and left colon cancer: a large community-based study. Gut 67 (2016), 291–298. https://doi.org/10.1136/gutjnl-2016-312712
[18]
Yuping Duan, Weimin Huang, Huibin Chang, Wenyu Chen, Jiayin Zhou, Soo Kng Teo, Yi Su, Chee Kong Chui, and Stephen Chang. 2016. Volume Preserved Mass–Spring Model with Novel Constraints for Soft Tissue Deformation. IEEE Journal of Biomedical and Health Informatics 20 (2016), 268–280. Issue 1. https://doi.org/10.1109/JBHI.2014.2370059
[19]
Junheng Fang, Lihua You, Ehtzaz Chaudhry, and Jian Zhang. 2023. State‐of‐the‐art improvements and applications of position based dynamics. Computer Animation and Virtual Worlds (2 2023). https://doi.org/10.1002/cav.2143
[20]
Laure France, Julien Lenoir, Alexis Angelidis, Philippe Meseure, M-P Cani, François Faure, and Christophe Chaillou. 2005. A layered model of a virtual human intestine for surgery simulation. Medical image analysis 9, 2 (2005), 123–132.
[21]
Qiu Guan, Xiaochen Du, Yan Shao, Lili Lin, and Shengyong Chen. 2014. Three-dimensional simulation of scalp soft tissue expansion using finite element method. Computational and mathematical methods in medicine 2014 (2014).
[22]
DongHo Hong, Wallapak Tavanapong, Johnny Wong, JungHwan Oh, and Piet C De Groen. 2014. 3D reconstruction of virtual colon structures from colonoscopy images. Computerized Medical Imaging and Graphics 38, 1 (2014), 22–33.
[23]
Philip M Hubbard. 1993. Interactive collision detection. In Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium. IEEE, 24–31.
[24]
Stephen Kavic and Marc Basson. 2001. Complication of endoscopy. American journal of surgery 181 (05 2001), 319–32. https://doi.org/10.1016/S0002-9610(01)00589-X
[25]
Do keyong Lee, Tae won Kim, Yoo-Joo Choi, and Min Hong. 2022. Volumetric Object Modeling Using Internal Shape Preserving Constraint in Unity 3D. Intelligent Automation and Soft Computing (2022). https://doi.org/10.32604/iasc.2022.020674
[26]
Junggon Kim and Nancy S. Pollard. 2011. Fast simulation of skeleton-driven deformable body characters. ACM Trans. Graph. 30, 5, Article 121 (oct 2011), 19 pages. https://doi.org/10.1145/2019627.2019640
[27]
Minsang Kim, Nak-Jun Sung, Sang-Joon Kim, Yoo-Joo Choi, and Min Hong. 2019. Parallel cloth simulation with effective collision detection for interactive AR application. Multimedia Tools and Applications 78, 4 (2019), 4851–4868.
[28]
Arjun D Koch, Jelle Haringsma, Erik J Schoon, Rob A De Man, and Ernst J Kuipers. 2012. Competence measurement during colonoscopy training: the use of self-assessment of performance measures. Official journal of the American College of Gastroenterology (ACG) 107, 7 (2012), 971–975.
[29]
Przemyslaw Korzeniowski, Alastair Barrow, Mikael H Sodergren, Niels Hald, and Fernando Bello. 2016. NOViSE: a virtual natural orifice transluminal endoscopic surgery simulator. International Journal of Computer Assisted Radiology and Surgery 11 (12 2016), 2303–2315. Issue 12. https://doi.org/10.1007/s11548-016-1401-8
[30]
Tassilo Kugelstadt, Dan Koschier, and Jan Bender. 2018. Fast corotated FEM using operator splitting. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 149–160.
[31]
Tang Liang, Wei-guo SONG, Tian-cheng HOU, Lei-lei LIU, Wei-xing CAO, and ZHU Yan. 2018. Collision detection of virtual plant based on bounding volume hierarchy: A case study on virtual wheat. Journal of integrative agriculture 17, 2 (2018), 306–314.
[32]
Sun Gyo Lim, Kwang Jae Lee, Kwang Suh, Seung Yeop Oh, Soon Kim, Junhwan Yoo, and Jeong Wi. 2013. Preoperative Colonoscopy for Detection of Synchronous Neoplasms after Insertion of Self-Expandable Metal Stents in Occlusive Colorectal Cancer: Comparison of Covered and Uncovered Stents. Gut and liver 7 (05 2013), 311–316. https://doi.org/10.5009/gnl.2013.7.3.311
[33]
Fuchang Liu and Young J Kim. 2013. Exact and adaptive signed distance fieldscomputation for rigid and deformablemodels on gpus. IEEE transactions on visualization and computer graphics 20, 5 (2013), 714–725.
[34]
Anderson Maciel, Ronan Boulic, and Daniel Thalmann. 2007. Efficient collision detection within deforming spherical sliding contact. IEEE Transactions on Visualization and Computer Graphics 13, 3 (2007), 518–529.
[35]
Anderson Maciel and Suvranu De. 2008. An efficient dynamic point algorithm for line-based collision detection in real time virtual environments involving haptics. Computer animation and virtual worlds 19, 2 (2008), 151–163.
[36]
Miles Macklin, Matthias Müller, and Nuttapong Chentanez. 2016. XPBD: position-based simulation of compliant constrained dynamics. In Proceedings of the 9th International Conference on Motion in Games. 49–54.
[37]
Marilena Maule, Anderson Maciel, and Luciana Nedel. 2010. Efficient collision detection and physics-based deformation for haptic simulation with local spherical hash. In 2010 23rd Conference on Graphics, Patterns and Images. IEEE, 9–16.
[38]
Nathan Mitchell, Court Cutting, and Eftychios Sifakis. 2015. GRIDiron: an interactive authoring and cognitive training foundation for reconstructive plastic surgery procedures. ACM Trans. Graph. 34, 4, Article 43 (jul 2015), 12 pages.
[39]
Wouter Mollemans, Filip Schutyser, Johan Van Cleynenbreugel, and Paul Suetens. 2003. Tetrahedral mass spring model for fast soft tissue deformation. In International Symposium on Surgery Simulation and Soft Tissue Modeling. Springer, 145–154.
[40]
Lucas Zanusso Morais, Victor Kunde Bergmann, Eduarda Abreu Carvalho, Raquel Zimmer, Marcelo Gomes Martins, Luciana Porcher Nedel, Anderson Maciel, and Rafael Piccin Torchelsen. 2023. An enhanced interactive endoscope model based on position-based dynamics and Cosserat rods for colonoscopy simulation. Computers & Graphics 116 (2023), 345–353.
[41]
Matthias Müller, Miles Macklin, Nuttapong Chentanez, Stefan Jeschke, and Tae-Yong Kim. 2020. Detailed rigid body simulation with extended position based dynamics. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 101–112.
[42]
Matthias Müller, Bruno Heidelberger, Marcus Hennix, and John Ratcliff. 2007. Position based dynamics. Journal of Visual Communication and Image Representation 18 (4 2007), 109–118. Issue 2. https://doi.org/10.1016/j.jvcir.2007.01.005
[43]
Jean-Christophe Nebel. 2001. Soft tissue modelling from 3D scanned data. In Deformable avatars. Springer, 85–97.
[44]
Mohd N Omar, Nasrul H Johari, Mohd H A Hassan, and Mohd A Azizan. 2022. Modeling of Soft Tissue Deformation Using Mass Spring Method with Nonlinear Volume Force. In Human-Centered Technology for a Better Tomorrow. Springer, Singapore, 75–90.
[45]
Jun J. Pan, Jian Chang, Xiaosong Yang, Hui Liang, Jian J. Zhang, Tahseen Qureshi, Robert Howell, and Tamas Hickish. 2015. Virtual reality training and assessment in laparoscopic rectum surgery. The International Journal of Medical Robotics and Computer Assisted Surgery 11 (2015), 194–209. Issue 2.
[46]
Paolo Patete, Maria Ida Iacono, Maria Francesca Spadea, Giovanna Trecate, Daniele Vergnaghi, Luca Tommaso Mainardi, and Guido Baroni. 2013. A multi-tissue mass-spring model for computer assisted breast surgery. Medical engineering & physics 35, 1 (2013), 47–53.
[47]
Soraia Figueiredo Paulo, Nuno Figueiredo, Joaquim Armando Jorge, and Daniel Simões Lopes. 2018. 3D Reconstruction of CT Colonography Models for VR/AR Applications using Free Software Tools. (2018).
[48]
Mark B. Pochapin. 2011. Colonoscopy Video Tour: Journey Through a Healthy Colon. AmCollege Gastro. https://youtu.be/yXCYHjbKenA?t=160
[49]
Hiroaki Saito, Tetsuya Tanimoto, Tsuyoshi Ozawa, Soichiro Ishihara, Mitsuhiro Fujishiro, Satoki Shichijo, Dai Hirasawa, Tomoki Matsuda, Yuma Endo, and Tomohiro Tada. 2020. Automatic anatomical classification of colonoscopic images using deep convolutional neural networks. Gastroenterology Report 9, 3 (12 2020), 226–233.
[50]
Johannes Schauer and Andreas Nüchter. 2015. Collision detection between point clouds using an efficient kd tree implementation. Advanced Engineering Informatics 29, 3 (2015), 440–458.
[51]
Ygor Rebouças Serpa and Maria Andréia Formico Rodrigues. 2019. Flexible Use of Temporal and Spatial Reasoning for Fast and Scalable CPU Broad‐Phase Collision Detection Using KD‐Trees. Computer Graphics Forum (2019).
[52]
S. G. Shah, J. Brooker, C. Thapar, C. Williams, and B. Saunders. 2002. Patient pain during colonoscopy: an analysis using real-time magnetic endoscope imaging.Endoscopy 34 6 (2002), 435–40. https://doi.org/10.1055/S-2002-31995
[53]
Rebecca L. Siegel, Kimberly D. Miller, Ann Goding Sauer, Stacey A. Fedewa, Lynn F. Butterly, Joseph C. Anderson, Andrea Cercek, Robert A. Smith, and Ahmedin Jemal. 2020. Colorectal cancer statistics, 2020. CA: A Cancer Journal for Clinicians 70 (5 2020), 145–164. Issue 3. https://doi.org/10.3322/caac.21601
[54]
J. Spillmann and M. Teschner. 2007. CoRdE: Cosserat Rod Elements for the Dynamic Simulation of One-Dimensional Elastic Objects. In Proceedings of the 2007 ACM SIGGRAPH/Eurographics Symposium on Computer Animation (San Diego, California) (SCA ’07). Eurographics Association, Goslar, DEU, 63–72.
[55]
A. Erman Tekkaya and Celal Soyarslan. 2018. Finite Element Method. Springer Berlin Heidelberg, Berlin, Heidelberg, 1–8.
[56]
Matthias Teschner, Stefan Kimmerle, Bruno Heidelberger, Gabriel Zachmann, Laks Raghupathi, Arnulph Fuhrmann, M-P Cani, François Faure, Nadia Magnenat-Thalmann, Wolfgang Strasser, 2005. Collision detection for deformable objects. In Computer graphics forum, Vol. 24. Wiley Online Library, 61–81.
[57]
Yuichi Torii. 2003. U.S. Patent No. 6641528B2. U.S. Patent and Trademark Office, Washington, DC. https://patents.google.com/patent/US6641528B2.
[58]
SE Van der Wiel, R Küttner Magalhães, Carla Rolanda Rocha Gonçalves, Ma Dinis-Ribeiro, MJ Bruno, and AD Koch. 2016. Simulator training in gastrointestinal endoscopy–From basic training to advanced endoscopic procedures. Best Practice & Research Clinical Gastroenterology 30, 3 (2016), 375–387.
[59]
Hans De Visser, Josh Passenger, David Conlan, Christoph Russ, David Hellier, Mario Cheng, Oscar Acosta, Sébastien Ourselin, and Olivier Salvado. 2010. DEVELOPING A NEXT GENERATION COLONOSCOPY SIMULATOR. International Journal of Image and Graphics 10 (4 2010), 203–217. Issue 2.
[60]
Monan Wang and Jiaqi Cao. 2021. A review of collision detection for deformable objects. Computer Animation and Virtual Worlds 32, 5 (2021), e1987.
[61]
Zhuang Yan and J Canny. 1999. Real-time Simulation of Physically Realistic Global Deformation. IEEE Vis’ 99. San Francisco, California (1999), 24–29.
[62]
Zhennan Yan, Lixu Gu, Pengfei Huang, Sizhe Lv, Xiao Yu, and Xianming Kong. 2007. Soft tissue deformation simulation in virtual surgery using nonlinear finite element method. In 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 3642–3645.
[63]
Xiufen Ye, Xinkui Mei, and Shuguo Xiao. 2018. Filling model based soft tissue deformation model. In 2018 IEEE International Conference on Mechatronics and Automation (ICMA). IEEE, 1655–1659.
[64]
Xiufen Ye, Jianguo Zhang, Peng Li, Tian Wang, and Shuxiang Guo. 2016. A fast and stable vascular deformation scheme for interventional surgery training system. Biomedical engineering online 15 (2016), 1–14.
[65]
SY Yi, HS Woo, WJ Ahn, JY Kwon, and DY Lee. 2006. New colonoscopy simulator with improved haptic fidelity. Advanced Robotics 20, 3 (2006), 349–365.
[66]
Jinao Zhang, Yongmin Zhong, and Chengfan Gu. 2017. Deformable models for surgical simulation: a survey. IEEE reviews in biomedical engineering 11 (2017), 143–164.
[67]
Shaoting Zhang, Andrew Nealen, and Dimitris Metaxas. 2010. Skeleton Based As-Rigid-As-Possible Volume Modeling. In Eurographics 2010 - Short Papers, H. P. A. Lensch and S. Seipel (Eds.). The EG Association.
[68]
Wenlan Zhang, Xin Liu, and Bin Zheng. 2021. Virtual reality simulation in training endoscopic skills: A systematic review. Laparoscopic, Endoscopic and Robotic Surgery 4 (2021), 97–104. Issue 4. https://doi.org/10.1016/j.lers.2021.09.002
Index Terms
- Efficient Position-Based Deformable Colon Modeling for Endoscopic Procedures Simulation
Recommendations
Novel hybrid rigid-deformable fetal modeling for simulating the vaginal delivery within the second stage of labor
Highlights- A novel hybrid rigid-deformable fetal modeling.
- Vaginal delivery kinematics extracted from in vivo MRI.
- Hyperelastic mass-spring model (HyperMSM) for fetal soft tissue deformation.
- Vaginal delivery simulation for both fetal ...
Abstract Background and objectiveThe fetal representation as a 3D articulated body plays an essential role to describe a realistic vaginal delivery simulation. However, the current computational solutions have been oversimplified. The objective of the ...
Graphical abstractDisplay Omitted
An electromechanical based deformable model for soft tissue simulation
Objective: Soft tissue deformation is of great importance to surgery simulation. Although a significant amount of research efforts have been dedicated to simulating the behaviours of soft tissues, modelling of soft tissue deformation is still a ...
Modeling and Simulation of Soft Tissue Deformation
Proceedings of the 5th International Workshop on Abdominal Imaging. Computation and Clinical Applications - Volume 8198A stable and accurate deformable model to simulate the deformation of soft tissues is a challenging area of research. This paper describes a soft tissue simulation method that can deform multiple organs synchronously and interact with virtual surgical ...
Comments
Information & Contributors
Information
Published In
July 2024
1106 pages
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 July 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Fundação para a Ciência e a Tecnologia
- Fundação Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- Fundação de Amparo à Pesquisa do Estado do Rio Grande do Sul
Conference
SIGGRAPH '24
Sponsor:
SIGGRAPH '24: Special Interest Group on Computer Graphics and Interactive Techniques Conference
July 27 - August 1, 2024
CO, Denver, USA
Acceptance Rates
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 596Total Downloads
- Downloads (Last 12 months)596
- Downloads (Last 6 weeks)93
Reflects downloads up to 25 Jan 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in