-
Offline identification of surgical deviations in laparoscopic rectopexy
Authors:
Arnaud Huaulmé,
Pierre Jannin,
Fabian Reche,
Jean-Luc Faucheron,
Alexandre Moreau-Gaudry,
Sandrine Voros
Abstract:
Objective: A median of 14.4% of patient undergone at least one adverse event during surgery and a third of them are preventable. The occurrence of adverse events forces surgeons to implement corrective strategies and, thus, deviate from the standard surgical process. Therefore, it is clear that the automatic identification of adverse events is a major challenge for patient safety. In this paper, w…
▽ More
Objective: A median of 14.4% of patient undergone at least one adverse event during surgery and a third of them are preventable. The occurrence of adverse events forces surgeons to implement corrective strategies and, thus, deviate from the standard surgical process. Therefore, it is clear that the automatic identification of adverse events is a major challenge for patient safety. In this paper, we have proposed a method enabling us to identify such deviations. We have focused on identifying surgeons' deviations from standard surgical processes due to surgical events rather than anatomic specificities. This is particularly challenging, given the high variability in typical surgical procedure workflows. Methods: We have introduced a new approach designed to automatically detect and distinguish surgical process deviations based on multi-dimensional non-linear temporal scaling with a hidden semi-Markov model using manual annotation of surgical processes. The approach was then evaluated using cross-validation. Results: The best results have over 90% accuracy. Recall and precision were superior at 70%. We have provided a detailed analysis of the incorrectly-detected observations. Conclusion: Multi-dimensional non-linear temporal scaling with a hidden semi-Markov model provides promising results for detecting deviations. Our error analysis of the incorrectly-detected observations offers different leads in order to further improve our method. Significance: Our method demonstrated the feasibility of automatically detecting surgical deviations that could be implemented for both skill analysis and developing situation awareness-based computer-assisted surgical systems.
△ Less
Submitted 18 March, 2020; v1 submitted 24 September, 2019;
originally announced September 2019.
-
Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgery
Authors:
Sebastian Bodenstedt,
Max Allan,
Anthony Agustinos,
Xiaofei Du,
Luis Garcia-Peraza-Herrera,
Hannes Kenngott,
Thomas Kurmann,
Beat Müller-Stich,
Sebastien Ourselin,
Daniil Pakhomov,
Raphael Sznitman,
Marvin Teichmann,
Martin Thoma,
Tom Vercauteren,
Sandrine Voros,
Martin Wagner,
Pamela Wochner,
Lena Maier-Hein,
Danail Stoyanov,
Stefanie Speidel
Abstract:
Intraoperative segmentation and tracking of minimally invasive instruments is a prerequisite for computer- and robotic-assisted surgery. Since additional hardware like tracking systems or the robot encoders are cumbersome and lack accuracy, surgical vision is evolving as promising techniques to segment and track the instruments using only the endoscopic images. However, what is missing so far are…
▽ More
Intraoperative segmentation and tracking of minimally invasive instruments is a prerequisite for computer- and robotic-assisted surgery. Since additional hardware like tracking systems or the robot encoders are cumbersome and lack accuracy, surgical vision is evolving as promising techniques to segment and track the instruments using only the endoscopic images. However, what is missing so far are common image data sets for consistent evaluation and benchmarking of algorithms against each other. The paper presents a comparative validation study of different vision-based methods for instrument segmentation and tracking in the context of robotic as well as conventional laparoscopic surgery. The contribution of the paper is twofold: we introduce a comprehensive validation data set that was provided to the study participants and present the results of the comparative validation study. Based on the results of the validation study, we arrive at the conclusion that modern deep learning approaches outperform other methods in instrument segmentation tasks, but the results are still not perfect. Furthermore, we show that merging results from different methods actually significantly increases accuracy in comparison to the best stand-alone method. On the other hand, the results of the instrument tracking task show that this is still an open challenge, especially during challenging scenarios in conventional laparoscopic surgery.
△ Less
Submitted 7 May, 2018;
originally announced May 2018.
-
Using CamiTK for rapid prototyping of interactive Computer Assisted Medical Intervention applications
Authors:
Emmanuel Promayon,
Celine Fouard,
Mathieu Bailet,
Aurelien Deram,
Gaelle Fiard,
Nikolai Hungr,
Vincent Luboz,
Yohan Payan,
Johan Sarrazin,
Nicolas Saubat,
Sonia Yuki Selmi,
Sandrine Voros,
Philippe Cinquin,
Jocelyne Troccaz
Abstract:
Computer Assisted Medical Intervention (CAMI hereafter) is a complex multi-disciplinary field. CAMI research requires the collaboration of experts in several fields as diverse as medicine, computer science, mathematics, instrumentation, signal processing, mechanics, modeling, automatics, optics, etc.
Computer Assisted Medical Intervention (CAMI hereafter) is a complex multi-disciplinary field. CAMI research requires the collaboration of experts in several fields as diverse as medicine, computer science, mathematics, instrumentation, signal processing, mechanics, modeling, automatics, optics, etc.
△ Less
Submitted 21 October, 2013;
originally announced October 2013.
-
Morphological Analusis Of The Left Ventricular Eendocardial Surface Using A Bag-Of-Features Descriptor
Authors:
Anirban Mukhopadhyay,
Zhen Qian,
Suchendra M. Bhandarkar,
Tianming Liu,
Sarah Rinehart,
Szilard Voros
Abstract:
The limitations of conventional imaging techniques have hitherto precluded a thorough and formal investigation of the complex morphology of the left ventricular (LV) endocardial surface and its relation to the severity of Coronary Artery Disease (CAD). Recent developments in high-resolution Multirow-Detector Computed Tomography (MDCT) scanner technology have enabled the imaging of LV endocardial s…
▽ More
The limitations of conventional imaging techniques have hitherto precluded a thorough and formal investigation of the complex morphology of the left ventricular (LV) endocardial surface and its relation to the severity of Coronary Artery Disease (CAD). Recent developments in high-resolution Multirow-Detector Computed Tomography (MDCT) scanner technology have enabled the imaging of LV endocardial surface morphology in a single heart beat. Analysis of high-resolution Computed Tomography (CT) images from a 320-MDCT scanner allows the study of the relationship between percent Diameter Stenosis (DS) of the major coronary arteries and localization of the cardiac segments affected by coronary arterial stenosis. In this paper a novel approach for the analysis using a combination of rigid transformation-invariant shape descriptors and a more generalized isometry-invariant Bag-of-Features (BoF) descriptor, is proposed and implemented. The proposed approach is shown to be successful in identifying, localizing and quantifying the incidence and extent of CAD and thus, is seen to have a potentially significant clinical impact. Specifically, the association between the incidence and extent of CAD, determined via the percent DS measurements of the major coronary arteries, and the alterations in the endocardial surface morphology is formally quantified. A multivariate regression test performed on a strict leave-one-out basis are shown to exhibit a distinct pattern in terms of the correlation coefficient within the cardiac segments where the incidence of coronary arterial stenosis is localized.
△ Less
Submitted 13 February, 2013;
originally announced February 2013.
-
First Clinical Experience in Urologic Surgery with a Novel Robotic Lightweight Laparoscope Holder
Authors:
Jean-Alexandre Long,
Jacques Tostain,
Cecilia Lanchon,
Sandrine Voros,
Maud Medici,
Jean-Luc Descotes,
Jocelyne Troccaz,
Philippe Cinquin,
Jean-Jacques Rambeaud,
Alexandre Moreau-Gaudry
Abstract:
Purpose: To report the feasibility and the safety of a surgeon-controlled robotic endoscope holder in laparoscopic surgery. Materials and methods: From March 2010 to September 2010, 20 patients were enrolled prospectively to undergo a laparoscopic surgery using an innovative robotic endoscope holder. Two surgeons performed 6 adrenalectomies, 4 sacrocolpopexies, 5 pyeloplasties, 4 radical prostatec…
▽ More
Purpose: To report the feasibility and the safety of a surgeon-controlled robotic endoscope holder in laparoscopic surgery. Materials and methods: From March 2010 to September 2010, 20 patients were enrolled prospectively to undergo a laparoscopic surgery using an innovative robotic endoscope holder. Two surgeons performed 6 adrenalectomies, 4 sacrocolpopexies, 5 pyeloplasties, 4 radical prostatectomies and 1 radical nephrectomy. Demographic data, overall set-up time, operative time, number of assistants needed were reviewed. Surgeon's satisfaction regarding the ergonomics was assessed using a ten point scale. Postoperative clinical outcomes were reviewed at day 1 and 1 month postoperatively. Results: The per-protocol analysis was performed on 17 patients for whom the robot was effectively used for surgery. Median age was 63 years, 10 patients were female (59%). Median BMI was 26.8. Surgical procedures were completed with the robot in 12 cases (71 %). Median number of surgical assistant was 0. Overall set-up time with the robot was 19 min, operative time was 130 min) during which the robot was used 71% of the time. Mean hospital stay was 6.94 days $\pm$ 2.3. Median score regarding the easiness of use was 7. Median pain level was 1.5/10 at day 1 and 0 at 1 month postoperatively. Open conversion was needed in 1 case (6 %) and 4 minor complications occurred in 2 patients (12%). Conclusion: This use of this novel robotic laparoscope holder is safe, feasible and it provides a good comfort to the surgeon.
△ Less
Submitted 31 August, 2012;
originally announced August 2012.
-
Medical image computing and computer-aided medical interventions applied to soft tissues. Work in progress in urology
Authors:
Jocelyne Troccaz,
Michael Baumann,
Peter Berkelman,
Philippe Cinquin,
Vincent Daanen,
Antoine Leroy,
Maud Marchal,
Yohan Payan,
Emmanuel Promayon,
Sandrine Voros,
Stéphane Bart,
Michel Bolla,
Emmanuel Chartier-Kastler,
Jean-Luc Descotes,
Andrée Dusserre,
Jean-Yves Giraud,
Jean-Alexandre Long,
Ronan Moalic,
Pierre Mozer
Abstract:
Until recently, Computer-Aided Medical Interventions (CAMI) and Medical Robotics have focused on rigid and non deformable anatomical structures. Nowadays, special attention is paid to soft tissues, raising complex issues due to their mobility and deformation. Mini-invasive digestive surgery was probably one of the first fields where soft tissues were handled through the development of simulators…
▽ More
Until recently, Computer-Aided Medical Interventions (CAMI) and Medical Robotics have focused on rigid and non deformable anatomical structures. Nowadays, special attention is paid to soft tissues, raising complex issues due to their mobility and deformation. Mini-invasive digestive surgery was probably one of the first fields where soft tissues were handled through the development of simulators, tracking of anatomical structures and specific assistance robots. However, other clinical domains, for instance urology, are concerned. Indeed, laparoscopic surgery, new tumour destruction techniques (e.g. HIFU, radiofrequency, or cryoablation), increasingly early detection of cancer, and use of interventional and diagnostic imaging modalities, recently opened new challenges to the urologist and scientists involved in CAMI. This resulted in the last five years in a very significant increase of research and developments of computer-aided urology systems. In this paper, we propose a description of the main problems related to computer-aided diagnostic and therapy of soft tissues and give a survey of the different types of assistance offered to the urologist: robotization, image fusion, surgical navigation. Both research projects and operational industrial systems are discussed.
△ Less
Submitted 13 December, 2007;
originally announced December 2007.
-
Development of miniaturized light endoscope-holder robot for laparoscopic surgery
Authors:
Jean-Alexandre Long,
Philippe Cinquin,
Jocelyne Troccaz,
Sandrine Voros,
Jean-Luc Descotes,
Peter Berkelman,
Christian Letoublon,
Jean-Jacques Rambeaud
Abstract:
PURPOSE: We have conducted experiments with an innovatively designed robot endoscope holder for laparoscopic surgery that is small and low cost. MATERIALS AND METHODS: A compact light endoscope robot (LER) that is placed on the patient's skin and can be used with the patient in the lateral or dorsal supine position was tested on cadavers and laboratory pigs in order to allow successive modificat…
▽ More
PURPOSE: We have conducted experiments with an innovatively designed robot endoscope holder for laparoscopic surgery that is small and low cost. MATERIALS AND METHODS: A compact light endoscope robot (LER) that is placed on the patient's skin and can be used with the patient in the lateral or dorsal supine position was tested on cadavers and laboratory pigs in order to allow successive modifications. The current control system is based on voice recognition. The range of vision is 360 degrees with an angle of 160 degrees . Twenty-three procedures were performed. RESULTS: The tests made it possible to advance the prototype on a variety of aspects, including reliability, steadiness, ergonomics, and dimensions. The ease of installation of the robot, which takes only 5 minutes, and the easy handling made it possible for 21 of the 23 procedures to be performed without an assistant. CONCLUSION: The LER is a camera holder guided by the surgeon's voice that can eliminate the need for an assistant during laparoscopic surgery. The ease of installation and manufacture should make it an effective and inexpensive system for use on patients in the lateral and dorsal supine positions. Randomized clinical trials will soon validate a new version of this robot prior to marketing.
△ Less
Submitted 30 November, 2007;
originally announced November 2007.
