O-MedAL: Online Active Deep Learning for Medical Image Analysis
Authors:
Asim Smailagic,
Pedro Costa,
Alex Gaudio,
Kartik Khandelwal,
Mostafa Mirshekari,
Jonathon Fagert,
Devesh Walawalkar,
Susu Xu,
Adrian Galdran,
Pei Zhang,
Aurélio Campilho,
Hae Young Noh
Abstract:
Active Learning methods create an optimized labeled training set from unlabeled data. We introduce a novel Online Active Deep Learning method for Medical Image Analysis. We extend our MedAL active learning framework to present new results in this paper. Our novel sampling method queries the unlabeled examples that maximize the average distance to all training set examples. Our online method enhanc…
▽ More
Active Learning methods create an optimized labeled training set from unlabeled data. We introduce a novel Online Active Deep Learning method for Medical Image Analysis. We extend our MedAL active learning framework to present new results in this paper. Our novel sampling method queries the unlabeled examples that maximize the average distance to all training set examples. Our online method enhances performance of its underlying baseline deep network. These novelties contribute significant performance improvements, including improving the model's underlying deep network accuracy by 6.30%, using only 25% of the labeled dataset to achieve baseline accuracy, reducing backpropagated images during training by as much as 67%, and demonstrating robustness to class imbalance in binary and multi-class tasks.
△ Less
Submitted 27 July, 2020; v1 submitted 27 August, 2019;
originally announced August 2019.
MedAL: Deep Active Learning Sampling Method for Medical Image Analysis
Authors:
Asim Smailagic,
Hae Young Noh,
Pedro Costa,
Devesh Walawalkar,
Kartik Khandelwal,
Mostafa Mirshekari,
Jonathon Fagert,
Adrián Galdrán,
Susu Xu
Abstract:
Deep learning models have been successfully used in medical image analysis problems but they require a large amount of labeled images to obtain good performance.Deep learning models have been successfully used in medical image analysis problems but they require a large amount of labeled images to obtain good performance. However, such large labeled datasets are costly to acquire. Active learning t…
▽ More
Deep learning models have been successfully used in medical image analysis problems but they require a large amount of labeled images to obtain good performance.Deep learning models have been successfully used in medical image analysis problems but they require a large amount of labeled images to obtain good performance. However, such large labeled datasets are costly to acquire. Active learning techniques can be used to minimize the number of required training labels while maximizing the model's performance.In this work, we propose a novel sampling method that queries the unlabeled examples that maximize the average distance to all training set examples in a learned feature space. We then extend our sampling method to define a better initial training set, without the need for a trained model, by using ORB feature descriptors. We validate MedAL on 3 medical image datasets and show that our method is robust to different dataset properties. MedAL is also efficient, achieving 80% accuracy on the task of Diabetic Retinopathy detection using only 425 labeled images, corresponding to a 32% reduction in the number of required labeled examples compared to the standard uncertainty sampling technique, and a 40% reduction compared to random sampling.
△ Less
Submitted 28 September, 2018; v1 submitted 24 September, 2018;
originally announced September 2018.