Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Pseudo-label meta-learner in semi-supervised few-shot learning for remote sensing image scene classification

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Remote sensing image scene classification (RSISC) greatly benefits from the use of few-shot learning, as it enables the recognition of novel scenes with only a small amount of labeled data. Most previous works focused on learning representations of prior knowledge with scarce labeled data while ignoring the feasibility of using potential information with large amounts of unlabeled data. In this paper, we introduce a novel semi-supervised few-shot pseudo-label propagation method through the introduction of unlabeled knowledge. This approach utilizes the pseudo-loss property generated by the classifier to indirectly reflect the credibility of pseudo-labeled samples. Therefore, we propose a semi-supervised pseudo-loss confidence metric-based method called a pseudolabel meta-learner (PLML) for RSISC. Specifically, we adopt a pseudoloss estimation module to map the pseudo-labeled data obtained from different tasks to a unified pseudo-loss metric space. Then, the distributions of the pseudolosses with both correct and incorrect pseudolabels are fitted by a semi-supervised beta mixture model (ss-BMM). This model can iteratively select high-quality unlabeled data to enhance the self-training effect of the classifier. Finally, to address the problem of shifting pseudo-loss distributions in remote sensing images, a progressive self-training strategy is proposed to mitigate the cumulative error induced by the classifier. Experimental results demonstrate that our proposed PLML approach outperforms the existing alternatives on the NWPU-RESISC45, AID, and UC Merced datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availibility

Data openly available in a public repository.

References

  1. Zhao W, Du S (2016) Learning multiscale and deep representations for classifying remotely sensed imagery. ISPRS J Photogramm Remote Sens 113:155–165

    Article  Google Scholar 

  2. Chen S-W (2020) Sar image speckle filtering with context covariance matrix formulation and similarity test. IEEE Trans Image Process 29:6641–6654. https://doi.org/10.1109/TIP.2020.2992883

    Article  MathSciNet  Google Scholar 

  3. Chen S-W, Cui X-C, Wang X-S, Xiao S-P (2021) Speckle-free sar image ship detection. IEEE Trans Image Process 30:5969–5983. https://doi.org/10.1109/TIP.2021.3089936

    Article  Google Scholar 

  4. Chen L, Ding Y, Pirasteh S, Hu H, Zhu Q, Ge X, Zeng H, Yu H, Shang Q, Song Y (2022) Meta-learning an intermediate representation for few-shot prediction of landslide susceptibility in large areas. Int J Appl Earth Obs Geoinf 110:102807

    Google Scholar 

  5. Miao W, Geng J, Jiang W (2022) Semi-supervised remote-sensing image scene classification using representation consistency siamese network. IEEE Trans Geosci Remote Sens 60:1–14

    Google Scholar 

  6. Cheng G, Yang C, Yao X, Guo L, Han J (2018) When deep learning meets metric learning: Remote sensing image scene classification via learning discriminative cnns. IEEE Trans Geosci Remote Sens 56(5):2811–2821. https://doi.org/10.1109/TGRS.2017.2783902

    Article  Google Scholar 

  7. Qian X, Chen X, Yue W, Liu X, Guo J, Li Z, Li Y, Wang W (2020) Generating and sifting pseudolabeled samples for improving the performance of remote sensing image scene classification. IEEE J Sel Topics Appl Earth Obs Remote Sens 13:4925–4933

    Article  Google Scholar 

  8. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778

  9. Jiang W, Cao Y, Deng X (2020) A novel z-network model based on bayesian network and z-number. IEEE Trans Fuzzy Syst 28(8):1585–1599. https://doi.org/10.1109/TFUZZ.2019.2918999

    Article  Google Scholar 

  10. Liao X, Tu B, Li J, Plaza A (2023) Class-wise graph embedding-based active learning for hyperspectral image classification. IEEE Trans Geosci Remote Sens

  11. Su YC, Gao LR, Jiang MY, Plaza A, Sun X, Zhang B (2023) Nsckl: Normalized spectral clustering with kernel-based learning for semisupervised hyperspectral image classification. IEEE Trans Cybern 53(10):6649–6661

    Article  Google Scholar 

  12. Zhao C, Qin B, Feng S, Zhu W, Sun W, Li W, Jia X (2023) Hyperspectral image classification with multi-attention transformer and adaptive superpixel segmentation-based active learning. IEEE Trans Image Process

  13. Ma J, Zhang L, Sun Y (2020) Roi extraction based on multiview learning and attention mechanism for unbalanced remote sensing data set. IEEE Trans Geosci Remote Sens 58(9):6210–6223

    Article  Google Scholar 

  14. Tang X, Lin W, Ma J, Zhang X, Liu F, Jiao L (2022) Class-level prototype guided multiscale feature learning for remote sensing scene classification with limited labels. IEEE Trans Geosci Remote Sens 60:1–15. https://doi.org/10.1109/TGRS.2022.3169835

    Article  Google Scholar 

  15. Hong D, Yokoya N, Xia G-S, Chanussot J, Zhu XX (2020) X-modalnet: A semi-supervised deep cross-modal network for classification of remote sensing data. ISPRS J Photogramm Remote Sens 167:12–23

    Article  Google Scholar 

  16. Miao W, Geng J, Jiang W (2023) Multigranularity decoupling network with pseudolabel selection for remote sensing image scene classification. IEEE Trans Geosci Remote Sens 61:1–13

    Article  Google Scholar 

  17. Qian X, Zeng Y, Wang W, Zhang Q (2022) Co-saliency detection guided by group weakly supervised learning. IEEE Trans Multimed

  18. Zhang Y, Li W, Sun W, Tao R, Du Q (2023) Single-source domain expansion network for cross-scene hyperspectral image classification. IEEE Trans Image Process 32:1498–1512

    Article  Google Scholar 

  19. Gao L, Li J, Zheng K, Jia X (2023) Enhanced autoencoders with attention-embedded degradation learning for unsupervised hyperspectral image super-resolution. IEEE Trans Geosci Remote Sens

  20. Jia X, Su Y, Zhao H (2023) Few-shot learning via relation network based on coarse-grained granulation. Appl Intell 53(1):996–1008

    Article  Google Scholar 

  21. Zheng Z, Feng X, Yu H, Li X, Gao M (2023) Bdla: Bi-directional local alignment for few-shot learning. Appl Intell 53(1):769–785

    Article  Google Scholar 

  22. Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning. In: Proc. Adv. Neural Inf. Process. Syst., pp 3637–3645

  23. Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks. In: Proc. Int. Conf. Mach. Learn., pp 1126–1135

  24. Jiang W (2018) A correlation coefficient for belief functions. Int J Approximate Reasoning 103:94–106

    Article  MathSciNet  Google Scholar 

  25. Santoro A, Bartunov S, Botvinick M, Wierstra D, Lillicrap T (2016) Meta-learning with memory-augmented neural networks. In: International Conference on Machine Learning, pp 1842–1850. PMLR

  26. Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning. In: Proc. Adv. Neural Inf. Process. Syst., pp 4080–4090

  27. Sung F, Yang Y, Zhang L, Xiang T, Torr PHS, Hospedales TM (2018) Learning to compare: Relation network for few-shot learning. In: Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp 1199–1208. https://doi.org/10.1109/CVPR.2018.00131

  28. Jiang W, Huang K, Geng J, Deng X (2021) Multi-scale metric learning for few-shot learning. IEEE Trans Circuits Syst Video Technol 31(3):1091–1102. https://doi.org/10.1109/TCSVT.2020.2995754

    Article  Google Scholar 

  29. Li J, Gong M, Liu H, Zhang Y, Zhang M, Wu Y (2023) Multiform ensemble self-supervised learning for few-shot remote sensing scene classification. IEEE Trans Geosci Remote Sens

  30. Li L, Han J, Yao X, Cheng G, Guo L (2021) Dla-matchnet for few-shot remote sensing image scene classification. IEEE Trans Geosci Remote Sens 59(9):7844–7853. https://doi.org/10.1109/TGRS.2020.3033336

    Article  Google Scholar 

  31. Li H, Cui Z, Zhu Z, Chen L, Zhu J, Huang H, Tao C (2021) Rs-metanet: Deep metametric learning for few-shot remote sensing scene classification. IEEE Trans Geosci Remote Sens 59(8):6983–6994. https://doi.org/10.1109/TGRS.2020.3027387

    Article  Google Scholar 

  32. Cheng G, Cai L, Lang C, Yao X, Chen J, Guo L, Han J (2021) Spnet: Siamese-prototype network for few-shot remote sensing image scene classification. IEEE Trans Geosci Remote Sens 1–11. https://doi.org/10.1109/TGRS.2021.3099033

  33. Xiong Y, Xu K, Dou Y, Zhao Y, Gao Z (2021) Wrmatch: Improving fixmatch with weighted nuclear-norm regularization for few-shot remote sensing scene classification. IEEE Trans Geosci Remote Sens. https://doi.org/10.1109/TGRS.2021.3121765

    Article  Google Scholar 

  34. Zeng Q, Geng J (2022) Task-specific contrastive learning for few-shot remote sensing image scene classification. ISPRS J Photogramm Remote Sens 191:143–154

    Article  Google Scholar 

  35. Chen F, Tsou JY (2021) Drsnet: Novel architecture for small patch and low-resolution remote sensing image scene classification. Int J Appl Earth Obs Geoinf 104:102577

    Google Scholar 

  36. Lu X, Sun H, Zheng X (2019) A feature aggregation convolutional neural network for remote sensing scene classification. IEEE Trans Geosci Remote Sens 57(10):7894–7906. https://doi.org/10.1109/TGRS.2019.2917161

    Article  Google Scholar 

  37. Yuan Y, Fang J, Lu X, Feng Y (2019) Remote sensing image scene classification using rearranged local features. IEEE Trans Geosci Remote Sens 57(3):1779–1792. https://doi.org/10.1109/TGRS.2018.2869101

    Article  Google Scholar 

  38. Peng C, Li Y, Jiao L, Shang R (2021) Efficient convolutional neural architecture search for remote sensing image scene classification. IEEE Trans Geosci Remote Sens 59(7):6092–6105. https://doi.org/10.1109/TGRS.2020.3020424

    Article  Google Scholar 

  39. Zhang J, Liu J, Pan B, Shi Z (2020) Domain adaptation based on correlation subspace dynamic distribution alignment for remote sensing image scene classification. IEEE Trans Geosci Remote Sens 58(11):7920–7930. https://doi.org/10.1109/TGRS.2020.2985072

    Article  Google Scholar 

  40. Yang Y, Tang X, Cheung Y-M, Zhang X, Jiao L (2023) Sagn: Semantic-aware graph network for remote sensing scene classification. IEEE Trans Image Process 32:1011–1025

    Article  Google Scholar 

  41. Yan L, Li F, Zhang L, Zheng X (2023) Discriminant space metric network for few-shot image classification. Appl Intell 1–16

  42. Liu Y, Lee J, Park M, Kim S, Yang E, Hwang S, Yang Y (2019) Learning to propagate labels: Transductive propagation network for few-shot learning. In: International Conference on Learning Representations

  43. Mey A, Loog M (2023) Improved generalization in semi-supervised learning: A survey of theoretical results. IEEE Trans Pattern Anal Mach Intell

  44. Arazo E, Ortego D, Albert P, O’ Connor NE, McGuinness K (2020) Pseudo-labeling and confirmation bias in deep semi-supervised learning. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp 1–8. https://doi.org/10.1109/IJCNN48605.2020.9207304

  45. Qiao L, Shi Y, Li J, Wang Y, Huang T, Tian Y (2019) Transductive episodic-wise adaptive metric for few-shot learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)

  46. Boudiaf M, Masud ZI, Rony J, Dolz J, Piantanida P, Ayed IB (2020) Transductive information maximization for few-shot learning. arXiv preprint. arXiv:2008.11297

  47. Lazarou M, Stathaki T, Avrithis Y (2021) Iterative label cleaning for transductive and semi-supervised few-shot learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp 8751–8760

  48. Li J, Socher R, Hoi SCH (2020) Dividemix: Learning with noisy labels as semi-supervised learning. In: Proc. Int. Conf. Learn. Represent

  49. Permuter H, Francos J, Jermyn I (2006) A study of gaussian mixture models of color and texture features for image classification and segmentation. Pattern Recognit. 39(4):695–706

    Article  Google Scholar 

  50. Huang K, Geng J, Jiang W, Deng X, Xu Z (2021) Pseudo-loss confidence metric for semi-supervised few-shot learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 8671–8680

  51. Ma Z, Leijon A (2011) Bayesian estimation of beta mixture models with variational inference. IEEE Trans Pattern Anal Mach Intell 33(11):2160–2173. https://doi.org/10.1109/TPAMI.2011.63

    Article  Google Scholar 

  52. Yan H, Zhou J, Pang CK (2017) Gaussian mixture model using semisupervised learning for probabilistic fault diagnosis under new data categories. IEEE Trans Instrum Meas 66(4):723–733. https://doi.org/10.1109/TIM.2017.2654552

    Article  Google Scholar 

  53. Zeng Q, Geng J (2022) Task-specific contrastive learning for few-shot remote sensing image scene classification. ISPRS J Photogramm Remote Sens 191:143–154

    Article  Google Scholar 

  54. Li X, Shi D, Diao X, Xu H (2021) Scl-mlnet: Boosting few-shot remote sensing scene classification via self-supervised contrastive learning. IEEE Trans Geosci Remote Sens 1–12. https://doi.org/10.1109/TGRS.2021.3109268

  55. Zhai M, Liu H, Sun F (2019) Lifelong learning for scene recognition in remote sensing images. IEEE Geosci Remote Sens Lett 16(9):1472–1476. https://doi.org/10.1109/LGRS.2019.2897652

    Article  Google Scholar 

  56. Geng J, Xue B, Jiang W (2023) Foreground-background contrastive learning for few-shot remote sensing image scene classification. IEEE Trans Geosci Remote Sens 61:1–12

    Article  Google Scholar 

  57. Hou R, Chang H, Bingpeng M, Shan S, Chen X (2019) Cross attention network for few-shot classification. In: NeurIPS, pp 4003–4014

  58. Hu SX, Moreno PG, Xiao Y, Shen X, Obozinski G, Lawrence ND, Damianou A (2020) Empirical bayes transductive meta-learning with synthetic gradients. In: ICLR

  59. Yang W, Yin X, Xia G (2015) Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans. Geosci. Remote Sensing 53(8):4472–4482. https://doi.org/10.1109/TGRS.2015.2400449

  60. Han W, Feng R, Wang L, Cheng Y (2018) A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification. ISPRS-J. Photogramm. Remote Sens. 145:23–43

    Article  Google Scholar 

  61. Kang J, Fernandez-Beltran R, Ye Z, Tong X, Ghamisi P, Plaza A (2020) High-rankness regularized semi-supervised deep metric learning for remote sensing imagery. Remote Sens. 12(16):2603

    Article  Google Scholar 

  62. Li X, Sun Q, Liu Y, Zhou Q, Zheng S, Chua T-S, Schiele B (2019) Learning to self-train for semi-supervised few-shot classification. In: Proc. Adv. Neural Inf. Process. Syst., pp 10276–10286

  63. Wang Y, Xu C, Liu C, Zhang L, Fu Y (2020) Instance credibility inference for few-shot learning. In: Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., pp 12833–12842. https://doi.org/10.1109/CVPR42600.2020.01285

  64. Xue B, Ma W, Geng J (2023) Feature mutual reconstruction for semi-supervised few-shot remote sensing image scene classification. In: 2023 IEEE International Conference on Unmanned Systems (ICUS), pp 614–618. IEEE

Download references

Acknowledgements

This work was supported in part by the China Postdoctoral Science Foundation under Grant 2021TQ0271 and Grant 2021M700110, in part by the Shaanxi Key Research and Development Program under Grant 2022ZDLGY03-04, and in part by the Fundamental Research Funds for the Central Universities under Grant D5000230067.

Author information

Authors and Affiliations

  1. School of Electronics and Information, Northwestern Polytechnical University, Xi’an, 710072, China

    Wang Miao, Kai Huang, Zhe Xu, Jie Geng & Wen Jiang

  2. No. 91977 Unit of People’s Liberation Army of China, Beijing, 100036, China

    Jianting Zhang

Authors
  1. Wang Miao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kai Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhe Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jianting Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jie Geng
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wen Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wen Jiang.

Ethics declarations

Conflicts of interest

- The authors have no relevant financial or non-financial interests to disclose.- The authors have no competing interests to declare that are relevant to the content of this article.- All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.- The authors have no financial or proprietary interests in any material discussed in this article.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miao, W., Huang, K., Xu, Z. et al. Pseudo-label meta-learner in semi-supervised few-shot learning for remote sensing image scene classification. Appl Intell 54, 9864–9880 (2024). https://doi.org/10.1007/s10489-024-05670-0

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-024-05670-0

Keywords

Search

Navigation