Abstract
Object detection is a basic part in remote sensing image processing. At present, it is more common to conduct the topic based on deep learning, however the volume of remote sensing images has become a limitation. In order to solve the problem of small sample of remote sensing image, transfer learning is combined with deep learning in the research. First, the detection problem is caused by insufficient data, such as over-fitting, which is solved by model-based transfer learning. The structure of models and parameters obtained based on natural images are transferred to the detection task in remote sensing target domain. In addition, it is usually assumed that the distribution of training data and the testing data are the same in detection, but this is not the case. Therefore, how to improve the robustness of training models and widen the scope of application should be taken into consideration. In the research, Domain Adaptation Faster R-CNN (DA Faster R-CNN) algorithm is proposed for detecting aircraft in remote sensing images. Two domain adaptation structures are designed and selected as the criterion of similarity measurement between domains. Adversarial training is applied to alleviate the domain shift. Finally, the effectiveness of the algorithm is certified in the low brightness experiment. DA Faster R-CNN detection algorithm improves the accuracy of the original algorithm for low quality images. It is worth noting that the DA Faster R-CNN algorithm is a kind of unsupervised transfer learning method for remote sensing object detection.
Similar content being viewed by others
References
Acharya A (2014) Template matching based object detection using HOG feature pyramid[J]. Computer Science:689–694
Bin P, Jianhao T, Qi Z et al (2017) Cascade convolutional neural network based on transfer-learning for aircraft detection on high-resolution remote sensing images[J]. Journal of Sensors:1–14
Chen J, Liu X, Liu C, et al (2018) A Modified Convolutional Neural Network with Transfer Learning for Road Extraction from Remote Sensing Imagery[C]. Chinese Automation Congress (CAC)
Dan Z, Sang N, He Y, Sun S (2014) An improved LBP transfer learning for remote sensing object recognition[J]. Optik - International Journal for Light and Electron Optics 125(1):482–485
Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by Backpropagation[C]. 32nd international conference on machine learning. ICML 2:1180–1189
Girshick R (2015) Fast R-CNN[J]. IEEE International Conference on Computer Vision (ICCV):2380–7504
Girshick R, Donahue J, Darrelland T (2014) Rich feature hierarchies for accurate object detection and semantic segmentation [C]. IEEE Conference on Computer Vision and Pattern Recognition:1–21
Guo Y, Jia X, Paull D (2017) A domain-transfer support vector machine for multi-temporal remote sensing imagery classification[C]. Geoscience & Remote Sensing Symposium, IEEE
Huang F, Zhang X, Xu J, et al. (2019) Multimodal learning of social image representation by exploiting social relations[J]. IEEE transactions on cybernetics
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks[C]. International Conference on Neural Information Processing Systems:1097–1105
Lang H, Wu S, Xu Y (2018) Ship classification in SAR images improved by AIS knowledge transfer[J]. IEEE Geosci Remote Sens Lett 15:439–443
Li Z, Yang C, Xing X (2015) Object detection based on template matching by using enhanced global-best ABC[C]. Control & Decision Conference
Li X, Zhang L, Du B et al (2017) Iterative reweighting heterogeneous transfer learning framework for supervised remote sensing image classification[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10(5):2022–2035
Li A, Lu Z, Wang L et al (2017) Zero-shot scene classification for high spatial resolution remote sensing images[J]. IEEE Trans Geosci Remote Sens:1–11
Liu W, Anguelov D, Erhan D (2016) SSD: single shot MultiBox detector[J]. European Conference on Computer Vision:21–37
Pan SJ, Yang Q (2010) A survey on transfer learning[J]. IEEE Trans Knowl Data Eng 22(10):1345–1359
Persello C, Bruzzone L (2012) Active learning for domain adaptation in the supervised classification of remote sensing images[J]. IEEE Trans Geosci Remote Sens 50(11):4468–4483
Redmon J, Divvala S, Girshick R (2016) You only look once: unified, real-time object detection[J]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition:779–788
Ren S, He K, Girshick R (2017) Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149
Wen J, Weng J, Tong C, Ren C, Zhou Z (2019) Sparse Signal Recovery with Minimization of 1-Norm Minus 2-Norm. IEEE Trans. Vehicular Technology 68(7):6847–6854
Wen J, Li L, Tang X (2019) Wai ho mow: an efficient optimal algorithm for the successive minima problem. IEEE trans. Communications 67(2):1424–1436
Xia J, Yokoya N, Iwasaki A (2017) Ensemble of transfer component analysis for domain adaptation in hyperspectral remote sensing image classification[C]. IGARSS 2017–2017 IEEE International Geoscience and Remote Sensing Symposium. IEEE:4762–4765.
Xia GS, Bai X, Ding J, et al. (2017) DOTA: A Large-scale Dataset for Object Detection in Aerial Images[C]. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 3974–3983
Xiao Q, Hu X, Song G, et al. (2010) Object detection based on contour learning and template matching[C]. Intelligent Control & Automation
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chen, J., Sun, J., Li, Y. et al. Object detection in remote sensing images based on deep transfer learning. Multimed Tools Appl 81, 12093–12109 (2022). https://doi.org/10.1007/s11042-021-10833-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-021-10833-z