-
CT-based brain ventricle segmentation via diffusion Schrödinger Bridge without target domain ground truths
Authors:
Reihaneh Teimouri,
Marta Kersten-Oertel,
Yiming Xiao
Abstract:
Efficient and accurate brain ventricle segmentation from clinical CT scans is critical for emergency surgeries like ventriculostomy. With the challenges in poor soft tissue contrast and a scarcity of well-annotated databases for clinical brain CTs, we introduce a novel uncertainty-aware ventricle segmentation technique without the need of CT segmentation ground truths by leveraging diffusion-model…
▽ More
Efficient and accurate brain ventricle segmentation from clinical CT scans is critical for emergency surgeries like ventriculostomy. With the challenges in poor soft tissue contrast and a scarcity of well-annotated databases for clinical brain CTs, we introduce a novel uncertainty-aware ventricle segmentation technique without the need of CT segmentation ground truths by leveraging diffusion-model-based domain adaptation. Specifically, our method employs the diffusion Schrödinger Bridge and an attention recurrent residual U-Net to capitalize on unpaired CT and MRI scans to derive automatic CT segmentation from those of the MRIs, which are more accessible. Importantly, we propose an end-to-end, joint training framework of image translation and segmentation tasks, and demonstrate its benefit over training individual tasks separately. By comparing the proposed method against similar setups using two different GAN models for domain adaptation (CycleGAN and CUT), we also reveal the advantage of diffusion models towards improved segmentation and image translation quality. With a Dice score of 0.78$\pm$0.27, our proposed method outperformed the compared methods, including SynSeg-Net, while providing intuitive uncertainty measures to further facilitate quality control of the automatic segmentation outcomes.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Architecture Analysis and Benchmarking of 3D U-shaped Deep Learning Models for Thoracic Anatomical Segmentation
Authors:
Arash Harirpoush,
Amirhossein Rasoulian,
Marta Kersten-Oertel,
Yiming Xiao
Abstract:
Recent rising interests in patient-specific thoracic surgical planning and simulation require efficient and robust creation of digital anatomical models from automatic medical image segmentation algorithms. Deep learning (DL) is now state-of-the-art in various radiological tasks, and U-shaped DL models have particularly excelled in medical image segmentation since the inception of the 2D UNet. To…
▽ More
Recent rising interests in patient-specific thoracic surgical planning and simulation require efficient and robust creation of digital anatomical models from automatic medical image segmentation algorithms. Deep learning (DL) is now state-of-the-art in various radiological tasks, and U-shaped DL models have particularly excelled in medical image segmentation since the inception of the 2D UNet. To date, many variants of U-shaped models have been proposed by the integration of different attention mechanisms and network configurations. Systematic benchmark studies which analyze the architecture of these models by leveraging the recent development of the multi-label databases, can provide valuable insights for clinical deployment and future model designs, but such studies are still rare. We conduct the first systematic benchmark study for variants of 3D U-shaped models (3DUNet, STUNet, AttentionUNet, SwinUNETR, FocalSegNet, and a novel 3D SwinUnet with four variants) with a focus on CT-based anatomical segmentation for thoracic surgery. Our study systematically examines the impact of different attention mechanisms, the number of resolution stages, and network configurations on segmentation accuracy and computational complexity. To allow cross-reference with other recent benchmarking studies, we also included a performance assessment of the BTCV abdominal structural segmentation. With the STUNet ranking at the top, our study demonstrated the value of CNN-based U-shaped models for the investigated tasks and the benefit of residual blocks in network configuration designs to boost segmentation performance.
△ Less
Submitted 14 March, 2024; v1 submitted 5 February, 2024;
originally announced February 2024.
-
ESPiM: Eye-Strain Probation Model, An Eye-Tracking Analysis Measure for Digital Displays
Authors:
Mohsen Parisay,
Negar Haghbin,
Charalambos Poullis,
Marta Kersten-Oertel
Abstract:
Eye-strain is a common issue among computer users due to the prolonged periods they spend working in front of digital displays. This can lead to vision problems, such as irritation and tiredness of the eyes and headaches. We propose the Eye-Strain Probation Model (ESPiM), a computational model based on eye-tracking data that measures eye-strain on digital displays based on the spatial properties o…
▽ More
Eye-strain is a common issue among computer users due to the prolonged periods they spend working in front of digital displays. This can lead to vision problems, such as irritation and tiredness of the eyes and headaches. We propose the Eye-Strain Probation Model (ESPiM), a computational model based on eye-tracking data that measures eye-strain on digital displays based on the spatial properties of the user interface and display area for a required period of time. As well as measuring eye-strain, ESPiM can be applied to compare (a) different user interface designs, (b) different display devices, and (c) different interaction techniques. Two user studies were conducted to evaluate the effectiveness of ESPiM. The first was conducted in the form of an in-person study with an infrared eye-tracking sensor with 32 participants. The second was conducted in the form of an online study with a video-based eye-tracking technique via webcams on users' computers with 13 participants. Our analysis showed significantly different eye-strain patterns based on the video gameplay frequency of participants. Further, we found distinctive patterns among users on a regular 9-to-5 routine versus those with more flexible work hours in terms of (a) error rates and (b) reported eye-strain symptoms.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Breamy: An augmented reality mHealth prototype for surgical decision-making in breast cancer
Authors:
Niki Najafi,
Miranda Addie,
Sarkis Meterissian,
Marta Kersten-Oertel
Abstract:
In 2020, according to WHO, breast cancer affected 2.3 million women worldwide, resulting in 685,000 fatalities. By the end of the year, approximately 7.8 million women worldwide had survived their breast cancer making it the most widespread form of cancer globally. Surgical treatment decisions, including choosing between oncoplastic options, often require quick decision-making within an 8-week tim…
▽ More
In 2020, according to WHO, breast cancer affected 2.3 million women worldwide, resulting in 685,000 fatalities. By the end of the year, approximately 7.8 million women worldwide had survived their breast cancer making it the most widespread form of cancer globally. Surgical treatment decisions, including choosing between oncoplastic options, often require quick decision-making within an 8-week time frame. However, many women lack the necessary knowledge and preparation for making such complex informed decisions. Anxiety and unsatisfactory outcomes can result from inadequate decision-making processes, leading to complications and the need for revision surgeries. Shared decision-making and personalized decision aids have shown positive effects on patient satisfaction and treatment outcomes. This paper introduces Breamy, a prototype mobile health (mHealth) application that utilizes augmented reality (AR) technology to assist breast cancer patients in making informed decisions. The app provides 3D visualizations of different oncoplastic procedures, aiming to improve confidence in surgical decision-making, reduce decisional regret, and enhance patient well-being after surgery. To determine the perception of the usefulness of Breamy, we collected data from 166 participants through an online survey. The results suggest that Breamy has the potential to reduce patient's anxiety levels and assist them during the decision-making process.
△ Less
Submitted 27 September, 2023;
originally announced September 2023.
-
VesselShot: Few-shot learning for cerebral blood vessel segmentation
Authors:
Mumu Aktar,
Hassan Rivaz,
Marta Kersten-Oertel,
Yiming Xiao
Abstract:
Angiography is widely used to detect, diagnose, and treat cerebrovascular diseases. While numerous techniques have been proposed to segment the vascular network from different imaging modalities, deep learning (DL) has emerged as a promising approach. However, existing DL methods often depend on proprietary datasets and extensive manual annotation. Moreover, the availability of pre-trained network…
▽ More
Angiography is widely used to detect, diagnose, and treat cerebrovascular diseases. While numerous techniques have been proposed to segment the vascular network from different imaging modalities, deep learning (DL) has emerged as a promising approach. However, existing DL methods often depend on proprietary datasets and extensive manual annotation. Moreover, the availability of pre-trained networks specifically for medical domains and 3D volumes is limited. To overcome these challenges, we propose a few-shot learning approach called VesselShot for cerebrovascular segmentation. VesselShot leverages knowledge from a few annotated support images and mitigates the scarcity of labeled data and the need for extensive annotation in cerebral blood vessel segmentation. We evaluated the performance of VesselShot using the publicly available TubeTK dataset for the segmentation task, achieving a mean Dice coefficient (DC) of 0.62(0.03).
△ Less
Submitted 28 August, 2023;
originally announced August 2023.
-
Assessment of user-interaction strategies for neurosurgical data navigation and annotation in virtual reality
Authors:
Owen Hellum,
Marta Kersten-Oertel,
Yiming Xiao
Abstract:
While virtual-reality (VR) has shown great promise in radiological tasks, effective user-interaction strategies that can improve efficiency and ergonomics are still under-explored and systematic evaluations of VR interaction techniques in the context of complex anatomical models are rare. Therefore, our study aims to identify the most effective interaction techniques for two common neurosurgical p…
▽ More
While virtual-reality (VR) has shown great promise in radiological tasks, effective user-interaction strategies that can improve efficiency and ergonomics are still under-explored and systematic evaluations of VR interaction techniques in the context of complex anatomical models are rare. Therefore, our study aims to identify the most effective interaction techniques for two common neurosurgical planning tasks in VR (point annotation and note-taking) from the state-of-the-arts, and propose a novel technique for efficient sub-volume selection necessary in neuroanatomical navigation. We assessed seven user-interaction methods with multiple input modalities (gaze, head motion, controller, and voice) for point placement and note-taking in the context of annotating brain aneurysms for cerebrovascular surgery. Furthermore, we proposed and evaluated a novel technique, called magnified selection diorama (Maserama) for easy navigation and selection of complex 3D anatomies in VR. Both quantitative and semi-quantitative (i.e., NASA Task Load Index) metrics were employed through user studies to reveal the performance of each interaction scheme in terms of accuracy, efficiency, and usability. Our evaluations demonstrated that controller-based interaction is preferred over eye-tracking-based methods for point placement while voice recording and virtual keyboard typing are better than freehand writing for note-taking. Furthermore, our new Maserama sub-volume selection technique was proven to be highly efficient and easy-to-use. Our study is the first to provide a systematic assessment of existing and new VR interaction schemes for neurosurgical data navigation and annotation. It offers valuable insights and tools to guide the design of future VR systems for radiological and surgical applications.
△ Less
Submitted 16 December, 2022;
originally announced December 2022.
-
Precision-Weighted Federated Learning
Authors:
Jonatan Reyes,
Lisa Di Jorio,
Cecile Low-Kam,
Marta Kersten-Oertel
Abstract:
Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy constraints. We hypothesize that Federated Averaging underestimates the full extent of heterogeneity of data when the aggregation is performed. We propose Precisi…
▽ More
Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy constraints. We hypothesize that Federated Averaging underestimates the full extent of heterogeneity of data when the aggregation is performed. We propose Precision-weighted Federated Learning a novel algorithm that takes into account the variance of the stochastic gradients when computing the weighted average of the parameters of models trained in a Federated Learning setting. With Precision-weighted Federated Learning, we provide an alternate averaging scheme that leverages the heterogeneity of the data when it has a large diversity of features in its composition. Our method was evaluated using standard image classification datasets with two different data partitioning strategies (IID/non-IID) to measure the performance and speed of our method in resource-constrained environments, such as mobile and IoT devices. We obtained a good balance between computational efficiency and convergence rates with Precision-weighted Federated Learning. Our performance evaluations show 9% better predictions with MNIST, 18% with Fashion-MNIST, and 5% with CIFAR-10 in the non-IID setting. Further reliability evaluations ratify the stability in our method by reaching a 99% reliability index with IID partitions and 96% with non-IID partitions. In addition, we obtained a 20x speedup on Fashion-MNIST with only 10 clients and up to 37x with 100 clients participating in the aggregation concurrently per communication round. The results indicate that Precision-weighted Federated Learning is an effective and faster alternative approach for aggregating private data, especially in domains where data is highly heterogeneous.
△ Less
Submitted 20 July, 2021;
originally announced July 2021.
-
Towards a Computed Collateral Circulation Score in Ischemic Stroke
Authors:
Marta Kersten-Oertel,
Ali Alamer,
Vladimir Fonov,
Benjamin W. Y. Lo,
Donatella Tampieri,
D. Louis Collins
Abstract:
Stroke is the second leading cause of disability worldwide. In order to minimize disability, the goal of stroke treatment is to preserve tissue in the area where blood supply is decreased but sufficient to stave off cell death. Thrombectomy has been shown to offer fast and efficient reperfusion with high recanalization rates. However, due to the inherent risks of thrombectomy, indications includin…
▽ More
Stroke is the second leading cause of disability worldwide. In order to minimize disability, the goal of stroke treatment is to preserve tissue in the area where blood supply is decreased but sufficient to stave off cell death. Thrombectomy has been shown to offer fast and efficient reperfusion with high recanalization rates. However, due to the inherent risks of thrombectomy, indications including evidence of good collateral circulation should be present. Currently, methods for evaluating collateral circulation are limited. In this work, we present an automated technique to compute a collateral circulation score based on differences seen in mean intensities between left and right cerebral hemispheres in 4D angiography images. In this preliminary study, we analyzed scans of 28 subjects: 4 with normal collateral circulation, 7 with good, 10 with intermediate, and 7 with poor collateral circulation, (based on radiologist score) and found a good correlation between the computed score and radiologist score (r2 = 0.71) and good separation between good and intermediate/poor groups. This work shows promise as the first step in building an automated collateral circulation score.
△ Less
Submitted 20 January, 2020;
originally announced January 2020.
-
A Conceptual Marketplace Model for IoT Generated Personal Data
Authors:
Victor Molina,
Marta Kersten-Oertel,
Tristan Glatard
Abstract:
We propose a decentralized conceptual marketplace model for IoT generated personal data. Our model is based on a thorough analysis of personal data in a marketplace context, with specific focus on the challenges presented by commercializing IoT generated personal data. Our model introduces a novel perspective on the commercialization of personal data for a marketplace context via risk evaluation a…
▽ More
We propose a decentralized conceptual marketplace model for IoT generated personal data. Our model is based on a thorough analysis of personal data in a marketplace context, with specific focus on the challenges presented by commercializing IoT generated personal data. Our model introduces a novel perspective on the commercialization of personal data for a marketplace context via risk evaluation and a data licensing framework. We have designed our model to be centered around protecting the privacy and data rights of data generators through model components that effectively assess and modify transaction risks, and formalize transaction agreements by establishing rights of data use and access between buyer and seller. Our model could serve as a blueprint to inform the implementation of a personal data marketplace that respects privacy and ownership.
△ Less
Submitted 5 July, 2019;
originally announced July 2019.