-
Newvision: application for helping blind people using deep learning
Authors:
Kumar Srinivas Bobba,
Kartheeban K,
Vamsi Krishna Sai Boddu,
Vijaya Mani Surendra Bolla,
Dinesh Bugga
Abstract:
As able-bodied people, we often take our vision for granted. For people who are visually impaired, however, their disability can have a significant impact on their daily lives. We are developing proprietary headgear that will help visually impaired people navigate their surroundings, identify objects and people, read text, and avoid obstacles. The headgear will use a combination of computer vision…
▽ More
As able-bodied people, we often take our vision for granted. For people who are visually impaired, however, their disability can have a significant impact on their daily lives. We are developing proprietary headgear that will help visually impaired people navigate their surroundings, identify objects and people, read text, and avoid obstacles. The headgear will use a combination of computer vision, distance estimation with ultrasonic sensors, voice recognition, and voice assistants to provide users with real-time information about their environment. Users will be able to interact with the headgear through voice commands, such as ''What is that?'' to identify an object or ''Navigate to the front door'' to find their way around. The headgear will then provide the user with a verbal description of the object or spoken navigation instructions. We believe that this headgear has the potential to make a significant difference in the lives of visually impaired people, allowing them to live more independently and participate more fully in society.
△ Less
Submitted 5 November, 2023;
originally announced November 2023.
-
Development of a Novel Robot for Transperineal Needle Based Interventions: Focal Therapy, Brachytherapy and Prostate Biopsies
Authors:
Jean-Alexandre Long,
Nikolai Hungr,
Michael Baumann,
Jean-Luc Descotes,
Michel Bolla,
Jean-Yves Giraud,
Jean-Jacques Rambeaud,
Jocelyne Troccaz
Abstract:
Purpose: We report what is to our knowledge the initial experience with a new 3-dimensional ultrasound robotic system for prostate brachytherapy assistance, focal therapy and prostate biopsies. Its ability to track prostate motion intraoperatively allows it to manage motions and guide needles to predefined targets. Materials and Methods: A robotic system was created for transrectal ultrasound guid…
▽ More
Purpose: We report what is to our knowledge the initial experience with a new 3-dimensional ultrasound robotic system for prostate brachytherapy assistance, focal therapy and prostate biopsies. Its ability to track prostate motion intraoperatively allows it to manage motions and guide needles to predefined targets. Materials and Methods: A robotic system was created for transrectal ultrasound guided needle implantation combined with intraoperative prostate tracking. Experiments were done on 90 targets embedded in a total of 9 mobile, deformable, synthetic prostate phantoms. Experiments involved trying to insert glass beads as close as possible to targets in multimodal anthropomorphic imaging phantoms. Results were measured by segmenting the inserted beads in computerized tomography volumes of the phantoms. Results: The robot reached the chosen targets in phantoms with a median accuracy of 2.73 mm and a median prostate motion of 5.46 mm. Accuracy was better at the apex than at the base (2.28 vs 3.83 mm, p <0.001), and similar for horizontal and angled needle inclinations (2.7 vs 2.82 mm, p = 0.18). Conclusions: To our knowledge this robot for prostate focal therapy, brachytherapy and targeted prostate biopsies is the first system to use intraoperative prostate motion tracking to guide needles into the prostate. Preliminary experiments show its ability to reach targets despite prostate motion.
△ Less
Submitted 31 August, 2012;
originally announced August 2012.
-
Prosper: image and robot-guided prostate brachytherapy
Authors:
Michael Baumann,
Michel Bolla,
Vincent Daanen,
Jean-Luc Descotes,
Jean-Yves Giraud,
Nikolai Hungr,
Antoine Leroy,
Jean-Alexandre Long,
Sébastien Martin,
Jocelyne Troccaz
Abstract:
Brachytherapy for localized prostate cancer consists in destroying cancer by introducing iodine radioactive seeds into the gland through hollow needles. The planning of the position of the seeds and their introduction into the prostate is based on intra-operative ultrasound (US) imaging. We propose to optimize the global quality of the procedure by: i) using 3D US; ii) enhancing US data with MRI r…
▽ More
Brachytherapy for localized prostate cancer consists in destroying cancer by introducing iodine radioactive seeds into the gland through hollow needles. The planning of the position of the seeds and their introduction into the prostate is based on intra-operative ultrasound (US) imaging. We propose to optimize the global quality of the procedure by: i) using 3D US; ii) enhancing US data with MRI registration; iii) using a specially designed needle-insertion robot, connected to the imaging data. The imaging methods have been successfully tested on patient data while the robot accuracy has been evaluated on a realistic deformable phantom.
△ Less
Submitted 8 April, 2011;
originally announced April 2011.
-
MRI/TRUS data fusion for prostate brachytherapy. Preliminary results
Authors:
Christophe Reynier,
Jocelyne Troccaz,
Philippe Fourneret,
André Dusserre,
Cécile Gay-Jeune,
Jean-Luc Descotes,
Michel Bolla,
Jean-Yves Giraud
Abstract:
Prostate brachytherapy involves implanting radioactive seeds (I125 for instance) permanently in the gland for the treatment of localized prostate cancers, e.g., cT1c-T2a N0 M0 with good prognostic factors. Treatment planning and seed implanting are most often based on the intensive use of transrectal ultrasound (TRUS) imaging. This is not easy because prostate visualization is difficult in this…
▽ More
Prostate brachytherapy involves implanting radioactive seeds (I125 for instance) permanently in the gland for the treatment of localized prostate cancers, e.g., cT1c-T2a N0 M0 with good prognostic factors. Treatment planning and seed implanting are most often based on the intensive use of transrectal ultrasound (TRUS) imaging. This is not easy because prostate visualization is difficult in this imaging modality particularly as regards the apex of the gland and from an intra- and interobserver variability standpoint. Radioactive seeds are implanted inside open interventional MR machines in some centers. Since MRI was shown to be sensitive and specific for prostate imaging whilst open MR is prohibitive for most centers and makes surgical procedures very complex, this work suggests bringing the MR virtually in the operating room with MRI/TRUS data fusion. This involves providing the physician with bi-modality images (TRUS plus MRI) intended to improve treatment planning from the data registration stage. The paper describes the method developed and implemented in the PROCUR system. Results are reported for a phantom and first series of patients. Phantom experiments helped characterize the accuracy of the process. Patient experiments have shown that using MRI data linked with TRUS data improves TRUS image segmentation especially regarding the apex and base of the prostate. This may significantly modify prostate volume definition and have an impact on treatment planning.
△ Less
Submitted 17 January, 2008;
originally announced January 2008.
-
Medical image computing and computer-aided medical interventions applied to soft tissues. Work in progress in urology
Authors:
Jocelyne Troccaz,
Michael Baumann,
Peter Berkelman,
Philippe Cinquin,
Vincent Daanen,
Antoine Leroy,
Maud Marchal,
Yohan Payan,
Emmanuel Promayon,
Sandrine Voros,
Stéphane Bart,
Michel Bolla,
Emmanuel Chartier-Kastler,
Jean-Luc Descotes,
Andrée Dusserre,
Jean-Yves Giraud,
Jean-Alexandre Long,
Ronan Moalic,
Pierre Mozer
Abstract:
Until recently, Computer-Aided Medical Interventions (CAMI) and Medical Robotics have focused on rigid and non deformable anatomical structures. Nowadays, special attention is paid to soft tissues, raising complex issues due to their mobility and deformation. Mini-invasive digestive surgery was probably one of the first fields where soft tissues were handled through the development of simulators…
▽ More
Until recently, Computer-Aided Medical Interventions (CAMI) and Medical Robotics have focused on rigid and non deformable anatomical structures. Nowadays, special attention is paid to soft tissues, raising complex issues due to their mobility and deformation. Mini-invasive digestive surgery was probably one of the first fields where soft tissues were handled through the development of simulators, tracking of anatomical structures and specific assistance robots. However, other clinical domains, for instance urology, are concerned. Indeed, laparoscopic surgery, new tumour destruction techniques (e.g. HIFU, radiofrequency, or cryoablation), increasingly early detection of cancer, and use of interventional and diagnostic imaging modalities, recently opened new challenges to the urologist and scientists involved in CAMI. This resulted in the last five years in a very significant increase of research and developments of computer-aided urology systems. In this paper, we propose a description of the main problems related to computer-aided diagnostic and therapy of soft tissues and give a survey of the different types of assistance offered to the urologist: robotization, image fusion, surgical navigation. Both research projects and operational industrial systems are discussed.
△ Less
Submitted 13 December, 2007;
originally announced December 2007.
-
MRI/TRUS data fusion for brachytherapy
Authors:
V. Daanen,
J. Gastaldo,
J. Y. Giraud,
P. Fourneret,
J. L. Descotes,
M. Bolla,
D. Collomb,
Jocelyne Troccaz
Abstract:
BACKGROUND: Prostate brachytherapy consists in placing radioactive seeds for tumour destruction under transrectal ultrasound imaging (TRUS) control. It requires prostate delineation from the images for dose planning. Because ultrasound imaging is patient- and operator-dependent, we have proposed to fuse MRI data to TRUS data to make image processing more reliable. The technical accuracy of this…
▽ More
BACKGROUND: Prostate brachytherapy consists in placing radioactive seeds for tumour destruction under transrectal ultrasound imaging (TRUS) control. It requires prostate delineation from the images for dose planning. Because ultrasound imaging is patient- and operator-dependent, we have proposed to fuse MRI data to TRUS data to make image processing more reliable. The technical accuracy of this approach has already been evaluated. METHODS: We present work in progress concerning the evaluation of the approach from the dosimetry viewpoint. The objective is to determine what impact this system may have on the treatment of the patient. Dose planning is performed from initial TRUS prostate contours and evaluated on contours modified by data fusion. RESULTS: For the eight patients included, we demonstrate that TRUS prostate volume is most often underestimated and that dose is overestimated in a correlated way. However, dose constraints are still verified for those eight patients. CONCLUSIONS: This confirms our initial hypothesis.
△ Less
Submitted 13 December, 2007;
originally announced December 2007.
