Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Incomplete multi-view clustering based on weighted sparse and low rank representation

Published: 01 October 2022 Publication History

Abstract

Multi-view clustering utilizes the consistency and complementarity between views to group entities well. However, in real life, the lack of instances in some views often occurs, which not only reduces the available information, but also increases the difficulty of joint learning with non-aligned multi-view data. Many incomplete multi-view clustering algorithms are developed to tackle these concerns, but they usually have the following problems: 1) They mainly focus on how to construct the shared feature space for incomplete views while ignoring the essential relationship between data instances. 2) Most of them simply assume that two datapoints which are close belong to the same category, but that is not the case. 3) The hazards of overlapping, confusing features in incomplete multi-view clustering are not considered. To solve these issues, this paper proposes a new Incomplete Multi-view Graph Learning method based on Weighted Sparse and Low rank Representation (IMGLWSLR). It leverages subspace learning with double constraints to capture global and local data relationships, a weighting mechanism to reduce the negative impact of missing data and a kernel-based method to fuse incomplete multiple views. Different from previous approaches, we concentrate on inhibiting the confusion of redundant features in subspace learning, which may affect the clustering seriously with missing views. Experimental results demonstrate the superiority of IMGLWSLR over nine benchmark datasets, compared with seven state-of-the-art approaches.

References

[1]
Abavisani M and Patel VM Deep multimodal subspace clustering networks IEEE J Sel Top Signal Process 2018 12 6 1601-1614
[2]
Zhang S, Zhai J, Xie B, Zhan Y, Wang X (2019) Multimodal representation learning: Advances, trends and challenges. In: International Conference on Machine Learning and Cybernetics, pp 1–6
[3]
Tao H, Hou C, Yi D, and Zhu J Multiview classification with cohesion and diversity IEEE Trans Cybern 2020 50 5 2124-2137
[4]
Zheng W, Zhu X, Zhu Y, Zhang S (2018) Robust feature selection on incomplete data. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp 3191–3197
[5]
Li S, Jiang Y, Zhou Z (2014) Partial multi-view clustering. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp 1968–1974
[6]
Zhao H, Liu H, Fu Y (2016) Incomplete multi-modal visual data grouping. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp 2392–2398
[7]
Shao W, He L, Yu P S (2015) Multiple incomplete views clustering via weighted nonnegative matrix factorization with l 2, 1 regularization. In: Proceedings of the ECML-PKDD 2015, pp 318–334
[8]
Hu M, Chen S (2018) Doubly aligned incomplete multi-view clustering. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence, pp 2262–2268
[9]
Cai D, He X, Han J, and Huang TS Graph regularized non-negative matrix factorization for data representation IEEE Trans Pattern Anal Mach Intell 2011 33 8 1548-1560
[10]
Gao H, Peng Y, Jian S (2016) Incomplete multi-view clustering. In: Proceedings of the Intelligent Information Processing 2016, vol 486, pp 245–255
[11]
Guo J, Ye J (2019) Anchors bring ease: An embarrassingly simple approach to partial multi-view clustering. In: Proceedings of the 33th AAAI Conference on Artificial Intelligence, pp 118–125
[12]
Wen J, Xu Y, and Liu H Incomplete multiview spectral clustering with adaptive graph learning IEEE Trans Cybern 2020 50 4 1418-1429
[13]
Bansal M and Sharma D A novel multi-view clustering approach via proximity-based factorization targeting structural maintenance and sparsity challenges for text and image categorization Inf Process Manag 2021 58 4 102546
[14]
Zhang C, Hu Q, Fu H, Zhu P, Cao X (2017) Latent multi-view subspace clustering. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 4333– 4341
[15]
Luo S, Zhang C, Zhang W, Cao X (2018) Consistent and specific multi-view subspace clustering. In: Proceedings of the 32th AAAI Conference on Artificial Intelligence, pp 3730–3737
[16]
Li Y, Yang M, and Zhang Z A survey of multi-view representation learning IEEE Trans Knowl Data Eng 2019 31 10 1863-1883
[17]
Sun Y, Li L, Zheng L, Hu J, Li W, Jiang Y, and Yan C Image classification base on pca of multi-view deep representation J Vis Commun Image Represent 2019 62 253-258
[18]
Weizhong Y, Rong W, Feiping N, and Fei W Multi-view embedded clustering with unsupervised trace ratio lda Neurocomputing 2018 315 169-176
[19]
Gong X, Huang L, Wang F (2019) Feature sampling based unsupervised semantic clustering for real web multi-view content, pp 102–109
[20]
Elhamifar E and Vidal R Sparse subspace clustering: Algorithm, theory, and applications IEEE Trans Pattern Anal Mach Intell 2013 35 11 2765-2781
[21]
Wang Y, Wu L, Lin X, and Gao J Multiview spectral clustering via structured low-rank matrix factorization IEEE Trans Neural Netw 2018 29 10 4833-4843
[22]
Zhou T, Zhang C, Gong C, Bhaskar H, and Yang J Multiview latent space learning with feature redundancy minimization IEEE Trans Cybern 2020 50 4 1655-1668
[23]
Brbic M and Kopriva I Multi-view low-rank sparse subspace clustering Pattern Recogn 2018 73 247-258
[24]
Feng L, Meng X, and Wang H Multi-view locality low-rank embedding for dimension reduction Knowl Based Syst 2020 191 105-172
[25]
Nasihatkon B, Hartley R (2011) Graph connectivity in sparse subspace clustering. In: Proceedings of the 24th IEEE Conference on Computer Vision and Pattern Recognition, pp 2137–2144
[26]
Wang Q, Ding Z, Tao Z, Gao Q, Fu Y (2018) Partial multi-view clustering via consistent gan. In: 2018 IEEE International Conference on Data Mining (ICDM), pp 1290–1295
[27]
Xu C, Guan Z, Zhao W, Wu H, Ling B (2019) Adversarial incomplete multi-view clustering. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp 3933–3939
[28]
Wen J, Zhang Z, Zhang Z, Wu Z, Fei L, Xu Y, Zhang B (2020) Dimc-net: Deep incomplete multi-view clustering network. In: The 28th ACM International Conference on Multimedia. ACM, pp 3753–3761
[29]
Cai Y, Jiao Y, Zhuge W, Tao H, and Hou C Partial multi-view spectral clustering Neurocomputing 2018 311 316-324
[30]
Tao H, Hou C, Yi D, Zhu J, and Hu D Joint embedding learning and low-rank approximation: A framework for incomplete multiview learning IEEE Trans Cybern 2019 PP 99 1-14
[31]
Liu X, Zhu X, Li M, Wang L, Zhu E, Liu T, Kloft M, Shen D, Yin J, Gao W (2017) Multiple kernel k-means with incomplete kernels. IEEE Trans Pattern Anal Mach Intell:1–1
[32]
Zheng J, Yang P, Chen S, Shen G, and Wang W Iterative re-constrained group sparse face recognition with adaptive weights learning IEEE Trans Image Process 2017 26 5 2408-2423
[33]
Wen J, Zhang B, Xu Y, Yang J, and Han N Adaptive weighted nonnegative low-rank representation Pattern Recogn 2018 81 326-340
[34]
Zhang X (2012) Non-negative low rank and sparse graph for semi-supervised learning. In: Computer Vision & Pattern Recognition, pp 2328–2335
[35]
Gao H, Nie F, Li X, Huang H (2015) Multi-view subspace clustering. In: Proceedings of the 2015 IEEE International Conference on Computer Vision, pp 4238–4246
[36]
Boyd S, Parikh N, Chu E, Peleato B, and Eckstein J Distributed optimization and statistical learning via the alternating direction method of multipliers Found Trends Mach Learn 2010 3 1 1-122
[37]
Zhang Z, Xu Y, Shao L, and Yang J Discriminative block-diagonal representation learning for image recognition IEEE Trans Neural Netw 2018 29 7 3111-3125
[38]
Yang W, Shi Y, Gao Y, Wang L, and Yang M Incomplete-data oriented multiview dimension reduction via sparse low-rank representation IEEE Trans Neural Netw 2018 29 12 6276-6291
[39]
Zhang X, Zhao L, Zong L, Liu X, Yu H (2014) Multi-view clustering via multi-manifold regularized nonnegative matrix factorization. In: Proceedings of the 2014 IEEE International Conference on Data Mining, pp 1103–1108
[40]
Qiu X, Chen Z, Zhao L, and Hu C Unsupervised multi-view non-negative for law data feature learning with dual graph-regularization in smart internet of things Futur Gener Comput Syst 2019 100 523-530
[41]
Cai X, Nie F, Huang H (2013) Multi-view k-means clustering on big data. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp 2598–2604

Cited By

View all
  • (2024)A Survey and an Empirical Evaluation of Multi-View Clustering ApproachesACM Computing Surveys10.1145/364510856:7(1-38)Online publication date: 8-Feb-2024

Index Terms

  1. Incomplete multi-view clustering based on weighted sparse and low rank representation
      Index terms have been assigned to the content through auto-classification.

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Applied Intelligence
      Applied Intelligence  Volume 52, Issue 13
      Oct 2022
      1143 pages

      Publisher

      Kluwer Academic Publishers

      United States

      Publication History

      Published: 01 October 2022
      Accepted: 14 January 2022

      Author Tags

      1. Incomplete multi-view clustering
      2. Graph learning
      3. Sparse and low rank representation
      4. Weighting mechanism

      Qualifiers

      • Research-article

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)0
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 02 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A Survey and an Empirical Evaluation of Multi-View Clustering ApproachesACM Computing Surveys10.1145/364510856:7(1-38)Online publication date: 8-Feb-2024

      View Options

      View options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media