Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Pseudo-Label-Assisted Subdomain Adaptation for Hyperspectral Image Classification

Published: 01 June 2024 Publication History

Abstract

Cross-domain classification of hyperspectral data is a critical challenge in remote sensing, especially when labels are unavailable in the target domain. Deep learning-based domain adaptation (DA) methods have been widely used in recent years. However, curren methods primarily focus on the global domain structure of the source and target domains when considering domain adaptation, neglecting the subdomain structure within each class. Additionally, current methods directly employ predicted outputs without further exploring the confidence level of the target domain samples. These limitations lead to confusion in domain adaptation and hinder effective feature selection in neural networks. In this paper, we propose the Pseudo-Label-Assisted Subdomain Adaptation (PASDA) method, which addresses these limitations by jointly considering the subdomain structure of the source and target domains and adopting a sample selection strategy. PASDA aligns the subdomains while learning domain-invariant features as a foundation. Furthermore, it selects high-quality pseudo-labeled samples from the target domain to enhance the learning of domain-invariant features. For generating pseudo-labels in the target domain, we employ the Reweighted Pruning Label Propagation (RPLPA) strategy to reweight the output of the predicted target domain. Finally, the high-confidence samples with pseudo-labels are selected to finetune the network. The entropy regularized dual classifier constraint is introduced to enhance the discriminative feature extraction ability for the target domain. Extensive experiments on three public HSI cross-domain datasets, Pavia, Houston, and HyRANK, using overall accuracy (OA), average accuracy (AA) and kappa coefficient (Kappa) as the evaluation indicators of classification performance, demonstrate the superiority of our method. Compared with the existing state-of-the-art (SOTA) unsupervised domain adaptation (UDA) methods, our method improves OA by 2% and AA by 4%.

References

[1]
A. F. H. Goetz, G. Vane, J. E. Solomon, and B. N. Rock, “Imaging spectrometry for Earth remote sensing,” Science, vol. 228, no. 4704, pp. 1147–1153, Jun. 1985.
[2]
W. Fenget al., “Canopy vegetation indices from in situ hyperspectral data to assess plant water status of winter wheat under powdery mildew stress,” Frontiers Plant Sci., vol. 8, p. 1219, Jul. 2017.
[3]
I. Dumkeet al., “First hyperspectral imaging survey of the deep seafloor: High-resolution mapping of manganese nodules,” Remote Sens. Environ., vol. 209, pp. 19–30, May 2018.
[4]
V. Lulla, Hyperspectral Applications in Urban Geography. Dordrecht, The Netherlands: Springer, 2009, pp. 79–86. 10.1007/978-1-4020-9642-6_6.
[5]
Y. Zhang, Y. Wang, X. Chen, X. Jiang, and Y. Zhou, “Spectral–spatial feature extraction with dual graph autoencoder for hyperspectral image clustering,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 12, pp. 8500–8511, Dec. 2022.
[6]
M. Li, Y. Liu, G. Xue, Y. Huang, and G. Yang, “Exploring the relationship between center and neighborhoods: Central vector oriented self-similarity network for hyperspectral image classification,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 4, pp. 1979–1993, Apr. 2023.
[7]
Z. Feng, X. Liu, S. Yang, K. Zhang, and L. Jiao, “Hierarchical feature fusion and selection for hyperspectral image classification,” IEEE Geosci. Remote Sens. Lett., vol. 20, pp. 1–5, 2023.
[8]
L. Song, Z. Feng, S. Yang, X. Zhang, and L. Jiao, “Self-supervised assisted semi-supervised residual network for hyperspectral image classification,” Remote Sens., vol. 14, no. 13, p. 2997, Jun. 2022.
[9]
T. Zhanget al., “Balance learning for ship detection from synthetic aperture radar remote sensing imagery,” ISPRS J. Photogramm. Remote Sens., vol. 182, pp. 190–207, Dec. 2021.
[10]
T. Zhanget al., “HOG-ShipCLSNet: A novel deep learning network with HOG feature fusion for SAR ship classification,” IEEE Trans. Geosci. Remote Sens., vol. 60, 2022, Art. no.
[11]
Z. Feng, L. Song, S. Yang, X. Zhang, and L. Jiao, “Cross-modal contrastive learning for remote sensing image classification,” IEEE Trans. Geosci. Remote Sens., vol. 61, 2023, Art. no.
[12]
T. Zhang and X. Zhang, “A polarization fusion network with geometric feature embedding for SAR ship classification,” Pattern Recognit., vol. 123, Mar. 2022, Art. no.
[13]
Y. Chen, H. Jiang, C. Li, X. Jia, and P. Ghamisi, “Deep feature extraction and classification of hyperspectral images based on convolutional neural networks,” IEEE Trans. Geosci. Remote Sens., vol. 54, no. 10, pp. 6232–6251, Oct. 2016.
[14]
B. Xiet al., “DGSSC: A deep generative spectral–spatial classifier for imbalanced hyperspectral imagery,” IEEE Trans. Circuits Syst. Video Technol., vol. 33, no. 4, pp. 1535–1548, Apr. 2023.
[15]
J. M. Bioucas-Dias and J. M. P. Nascimento, “Hyperspectral subspace identification,” IEEE Trans. Geosci. Remote Sens., vol. 46, no. 8, pp. 2435–2445, Aug. 2008.
[16]
M. Zhang, X. Zhao, W. Li, Y. Zhang, R. Tao, and Q. Du, “Cross-scene joint classification of multisource data with multilevel domain adaption network,” IEEE Trans. Neural Netw. Learn. Syst., early access, Apr. 6, 2023. 10.1109/TNNLS.2023.3262599.
[17]
J. Tian, J. Zhang, W. Li, and D. Xu, “VDM-DA: Virtual domain modeling for source data-free domain adaptation,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 6, pp. 3749–3760, Jun. 2022.
[18]
J. Peng, Y. Huang, W. Sun, N. Chen, Y. Ning, and Q. Du, “Domain adaptation in remote sensing image classification: A survey,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 15, pp. 9842–9859, 2022.
[19]
H. Shimodaira, “Improving predictive inference under covariate shift by weighting the log-likelihood function,” J. Stat. Planning Inference, vol. 90, no. 2, pp. 227–244, Oct. 2000.
[20]
C. Yaras, K. Kassaw, B. Huang, K. Bradbury, and J. M. Malof, “Randomized histogram matching: A simple augmentation for unsupervised domain adaptation in overhead imagery,” 2021, arXiv:2104.14032.
[21]
L. Bruzzone and D. F. Prieto, “Unsupervised retraining of a maximum likelihood classifier for the analysis of multitemporal remote sensing images,” IEEE Trans. Geosci. Remote Sens., vol. 39, no. 2, pp. 456–460, Feb. 2001.
[22]
L. Duan, D. Xu, and I. W. Tsang, “Domain adaptation from multiple sources: A domain-dependent regularization approach,” IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 504–518, Mar. 2012.
[23]
Y. Guo, X. Jia, and D. Paull, “Effective sequential classifier training for SVM-based multitemporal remote sensing image classification,” IEEE Trans. Image Process., vol. 27, no. 6, pp. 3036–3048, Jun. 2018.
[24]
Z. Sun, C. Wang, H. Wang, and J. Li, “Learn multiple-kernel SVMs for domain adaptation in hyperspectral data,” IEEE Geosci. Remote Sens. Lett., vol. 10, no. 5, pp. 1224–1228, Sep. 2013.
[25]
M. Long, Y. Cao, J. Wang, and M. Jordan, “Learning transferable features with deep adaptation networks,” in Proc. 32nd Int. Conf. Mach. Learn. (ICML), vol. 37, Jul. 2015, pp. 97–105.
[26]
Y. Zhuet al., “Deep subdomain adaptation network for image classification,” IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 4, pp. 1713–1722, Apr. 2021.
[27]
Z. Liu, L. Ma, and Q. Du, “Class-wise distribution adaptation for unsupervised classification of hyperspectral remote sensing images,” IEEE Trans. Geosci. Remote Sens., vol. 59, no. 1, pp. 508–521, Jan. 2021.
[28]
Q. Tian, Y. Zhu, H. Sun, S. Chen, and H. Yin, “Unsupervised domain adaptation through dynamically aligning both the feature and label spaces,” IEEE Trans. Circuits Syst. Video Technol., vol. 32, no. 12, pp. 8562–8573, Dec. 2022.
[29]
Z. Wang, B. Du, Q. Shi, and W. Tu, “Domain adaptation with discriminative distribution and manifold embedding for hyperspectral image classification,” IEEE Geosci. Remote Sens. Lett., vol. 16, no. 7, pp. 1155–1159, Jul. 2019.
[30]
Z. Fanget al., “Confident learning-based domain adaptation for hyperspectral image classification,” IEEE Trans. Geosci. Remote Sens., vol. 60, 2022, Art. no.
[31]
S. Zhong and Y. Zhang, “An iterative training sample updating approach for domain adaptation in hyperspectral image classification,” IEEE Geosci. Remote Sens. Lett., vol. 18, no. 10, pp. 1821–1825, Oct. 2021.
[32]
A. Farahani, S. Voghoei, K. Rasheed, and H. R. Arabnia, “A brief review of domain adaptation,” in Advances in Data Science and Information Engineering, R. Stahlbock, G. M. Weiss, M. Abou-Nasr, C.-Y. Yang, H. R. Arabnia, and L. Deligiannidis, Eds. Cham, Switzerland: Springer, 2021, pp. 877–894.
[33]
H. Li, J. Li, Y. Zhao, M. Gong, Y. Zhang, and T. Liu, “Cost-sensitive self-paced learning with adaptive regularization for classification of image time series,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 14, pp. 11713–11727, 2021.
[34]
J. Zhao, L. Li, F. Deng, H. He, and J. Chen, “Discriminant geometrical and statistical alignment with density peaks for domain adaptation,” IEEE Trans. Cybern., vol. 52, no. 2, pp. 1193–1206, Feb. 2022.
[35]
S. K. Meher and N. S. Kothari, “Interpretable rule-based fuzzy ELM and domain adaptation for remote sensing image classification,” IEEE Trans. Geosci. Remote Sens., vol. 59, no. 7, pp. 5907–5919, Jul. 2021.
[36]
J. Zhang, J. Liu, B. Pan, Z. Chen, X. Xu, and Z. Shi, “An open set domain adaptation algorithm via exploring transferability and discriminability for remote sensing image scene classification,” IEEE Trans. Geosci. Remote Sens., vol. 60, 2022, Art. no.
[37]
K. Saito, K. Watanabe, Y. Ushiku, and T. Harada, “Maximum classifier discrepancy for unsupervised domain adaptation,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2018, pp. 3723–3732.
[38]
O. Tasar, Y. Tarabalka, A. Giros, P. Alliez, and S. Clerc, “StandardGAN: Multi-source domain adaptation for semantic segmentation of very high resolution satellite images by data standardization,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2020, pp. 747–756.
[39]
C. Northcutt, L. Jiang, and I. Chuang, “Confident learning: Estimating uncertainty in dataset labels,” J. Artif. Intell. Res., vol. 70, pp. 1373–1411, Jan. 2021.
[40]
S. Li, F. Lv, B. Xie, C. H. Liu, J. Liang, and C. Qin, “Bi-classifier determinacy maximization for unsupervised domain adaptation,” in Proc. AAAI Conf. Artif. Intell., 2021, vol. 35, no. 10, pp. 8455–8464.
[41]
Z. Zhao, L. Zhou, L. Wang, Y. Shi, and Y. Gao, “LaSSL: Label-guided self-training for semi-supervised learning,” in Proc. AAAI Conf. Artif. Intell., 2022, vol. 36, no. 8, pp. 9208–9216.
[42]
C. Debeset al., “Hyperspectral and LiDAR data fusion: Outcome of the 2013 GRSS data fusion contest,” IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 7, no. 6, pp. 2405–2418, Jun. 2014.
[43]
B. Le Saux, N. Yokoya, R. Hansch, and S. Prasad, “2018 IEEE GRSS data fusion contest: Multimodal land use classification [technical committees],” IEEE Geosci. Remote Sens. Mag., vol. 6, no. 1, pp. 52–54, Mar. 2018.
[44]
K. Karantzalos, C. Karakizi, Z. Kandylakis, and G. Antoniou, “HyRANK hyperspectral satellite dataset I, version v001,” Zenodo, Apr. 2018. 10.5281/zenodo.1222202.
[45]
Y. Zhang, W. Li, M. Zhang, S. Wang, R. Tao, and Q. Du, “Graph information aggregation cross-domain few-shot learning for hyperspectral image classification,” IEEE Trans. Neural Netw. Learn. Syst., early access, Jun. 30, 2022. 10.1109/TNNLS.2022.3185795.
[46]
B. Sun and K. Saenko, “Deep coral: Correlation alignment for deep domain adaptation,” in Proc. Eur. Conf. Comput. Vis. (ECCV), 2016, pp. 443–450.
[47]
Y. Zhang, W. Li, M. Zhang, Y. Qu, R. Tao, and H. Qi, “Topological structure and semantic information transfer network for cross-scene hyperspectral image classification,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 6, pp. 2817–2830, May 2023.
[48]
Y. Zhang, W. Li, W. Sun, R. Tao, and Q. Du, “Single-source domain expansion network for cross-scene hyperspectral image classification,” IEEE Trans. Image Process., vol. 32, pp. 1498–1512, 2023.
[49]
Y. Zhang, M. Zhang, W. Li, S. Wang, and R. Tao, “Language-aware domain generalization network for cross-scene hyperspectral image classification,” IEEE Trans. Geosci. Remote Sens., vol. 61, 2023, Art. no.
[50]
Y. Ganin and V. Lempitsky, “Unsupervised domain adaptation by backpropagation,” in Proc. Int. Conf. Mach. Learn. (ICML), 2015, pp. 1180–1189.
[51]
S. Zagoruyko and N. Komodakis, “Wide residual networks,” 2016, arXiv:1605.07146.

Cited By

View all
  • (2024)Interactive Spectral-Spatial Transformer for Hyperspectral Image ClassificationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.338657834:9(8589-8601)Online publication date: 1-Sep-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Circuits and Systems for Video Technology
IEEE Transactions on Circuits and Systems for Video Technology  Volume 34, Issue 6
June 2024
1070 pages

Publisher

IEEE Press

Publication History

Published: 01 June 2024

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Interactive Spectral-Spatial Transformer for Hyperspectral Image ClassificationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.338657834:9(8589-8601)Online publication date: 1-Sep-2024

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media