Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challenge
Authors:
Sharib Ali,
Noha Ghatwary,
Debesh Jha,
Ece Isik-Polat,
Gorkem Polat,
Chen Yang,
Wuyang Li,
Adrian Galdran,
Miguel-Ángel González Ballester,
Vajira Thambawita,
Steven Hicks,
Sahadev Poudel,
Sang-Woong Lee,
Ziyi Jin,
Tianyuan Gan,
ChengHui Yu,
JiangPeng Yan,
Doyeob Yeo,
Hyunseok Lee,
Nikhil Kumar Tomar,
Mahmood Haithmi,
Amr Ahmed,
Michael A. Riegler,
Christian Daul,
Pål Halvorsen
, et al. (7 additional authors not shown)
Abstract:
Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal of polyps (referred to as polypectomy ) are highly operator-dependent procedures. There exist a high missed detection rate and incomplete removal of colonic pol…
▽ More
Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal of polyps (referred to as polypectomy ) are highly operator-dependent procedures. There exist a high missed detection rate and incomplete removal of colonic polyps due to their variable nature, the difficulties to delineate the abnormality, the high recurrence rates, and the anatomical topography of the colon. There have been several developments in realising automated methods for both detection and segmentation of these polyps using machine learning. However, the major drawback in most of these methods is their ability to generalise to out-of-sample unseen datasets that come from different centres, modalities and acquisition systems. To test this hypothesis rigorously we curated a multi-centre and multi-population dataset acquired from multiple colonoscopy systems and challenged teams comprising machine learning experts to develop robust automated detection and segmentation methods as part of our crowd-sourcing Endoscopic computer vision challenge (EndoCV) 2021. In this paper, we analyse the detection results of the four top (among seven) teams and the segmentation results of the five top teams (among 16). Our analyses demonstrate that the top-ranking teams concentrated on accuracy (i.e., accuracy > 80% on overall Dice score on different validation sets) over real-time performance required for clinical applicability. We further dissect the methods and provide an experiment-based hypothesis that reveals the need for improved generalisability to tackle diversity present in multi-centre datasets.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
A Radiomics Approach to Computer-Aided Diagnosis with Cardiac Cine-MRI
Authors:
Irem Cetin,
Gerard Sanroma,
Steffen E. Petersen,
Sandy Napel,
Oscar Camara,
Miguel-Angel Gonzalez Ballester,
Karim Lekadir
Abstract:
Use expert visualization or conventional clinical indices can lack accuracy for borderline classications. Advanced statistical approaches based on eigen-decomposition have been mostly concerned with shape and motion indices. In this paper, we present a new approach to identify CVDs from cine-MRI by estimating large pools of radiomic features (statistical, shape and textural features) encoding rele…
▽ More
Use expert visualization or conventional clinical indices can lack accuracy for borderline classications. Advanced statistical approaches based on eigen-decomposition have been mostly concerned with shape and motion indices. In this paper, we present a new approach to identify CVDs from cine-MRI by estimating large pools of radiomic features (statistical, shape and textural features) encoding relevant changes in anatomical and image characteristics due to CVDs. The calculated cine-MRI radiomic features are assessed using sequential forward feature selection to identify the most relevant ones for given CVD classes (e.g. myocardial infarction, cardiomyopathy, abnormal right ventricle). Finally, advanced machine learning is applied to suitably integrate the selected radiomics for final multi-feature classification based on Support Vector Machines (SVMs). The proposed technique was trained and cross-validated using 100 cine-MRI cases corresponding to five different cardiac classes from the ACDC MICCAI 2017 challenge \footnote{https://www.creatis.insa-lyon.fr/Challenge/acdc/index.html}. All cases were correctly classified in this preliminary study, indicating potential of using large-scale radiomics for MRI-based diagnosis of CVDs.
△ Less
Submitted 25 September, 2019;
originally announced September 2019.
