Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3696409.3700235acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Unified Multi-view Clustering based on Joint Multi-Structure Representation Learning

Published: 28 December 2024 Publication History

Abstract

Recently, tensor-based multi-view subspace clustering methods have shown promising results. Despite the impressive clustering performance, most clustering methods still face the following challenges: 1) the expensive computational burden caused by complex clustering steps, 2) the limitation of scalability to large-scale data sets, and 3) the failure to fully explore inter/intra-view information by tensor rank approximations. To address these issues, we propose a joint multi-structure representation learning for multi-view clustering (JMSR-MVC), where the low-dimensional latent representation structure for each view is constructed by a matrix factorization mechanism. The high-order correlated inter/intra-view structure information is explored by the low-rank tensor multi-scale entanglement renormalization ansatz (MERA). In addition, the K-means clustering structure is introduced into the model, which integrates the high-order tensor representation learning and the corresponding latent cluster assignments into a unified manipulation instead of traditional independent two-stage scheme. The alternating direction method of multipliers algorithm is developed to solve the optimization model. Furthermore, we give the analysis of the computational complexity and convergence. Extensive experiments on six challenging data sets demonstrate the superiority of the proposed method over current state-of-the-art multi-view clustering approaches.

References

[1]
Johann A Bengua, Ho N Phien, Hoang Duong Tuan, and Minh N Do. 2017. Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Transactions on Image Processing 26, 5 (2017), 2466–2479.
[2]
Xiao Cai, Feiping Nie, and Heng Huang. 2013. Multi-view k-means clustering on big data. In Twenty-Third International Joint conference on artificial intelligence.
[3]
Gene Golub, Stephen Nash, and Charles Van Loan. 1979. A Hessenberg-Schur method for the problem AX+ XB= C. IEEE Trans. Automat. Control 24, 6 (1979), 909–913.
[4]
Antony Jameson. 1968. Solution of the equation AX+XB=C by inversion of an M*M or N*N matrix. SIAM J. Appl. Math. 16, 5 (1968), 1020–1023.
[5]
Jinghuan Lao, Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2023. Towards scalable multi-view clustering via joint learning of many bipartite graphs. IEEE Transactions on Big Data (2023).
[6]
Jing Li, Quanxue Gao, Qianqian Wang, Ming Yang, and Wei Xia. 2024. Orthogonal non-negative tensor factorization based multi-view clustering. Advances in Neural Information Processing Systems 36 (2024).
[7]
Zhouchen Lin, Risheng Liu, and Zhixun Su. 2011. Linearized alternating direction method with adaptive penalty for low-rank representation. Advances in neural information processing systems 24 (2011).
[8]
Guangcan Liu, Zhouchen Lin, Shuicheng Yan, Ju Sun, Yong Yu, and Yi Ma. 2012. Robust recovery of subspace structures by low-rank representation. IEEE transactions on pattern analysis and machine intelligence 35, 1 (2012), 171–184.
[9]
Zhen Long, Ce Zhu, Jie Chen, Zihan Li, Yazhou Ren, and Yipeng Liu. 2023. Multi-view MERA subspace clustering. IEEE Transactions on Multimedia (2023).
[10]
Shikun Mei, Wenhui Zhao, Quanxue Gao, Ming Yang, and Xinbo Gao. 2023. Joint feature selection and optimal bipartite graph learning for subspace clustering. Neural Networks 164 (2023), 408–418.
[11]
Qianyao Qiang, Bin Zhang, Fei Wang, and Feiping Nie. 2021. Fast multi-view discrete clustering with anchor graphs. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 9360–9367.
[12]
Chang Tang, Zhenglai Li, Jun Wang, Xinwang Liu, Wei Zhang, and En Zhu. 2022. Unified one-step multi-view spectral clustering. IEEE Transactions on Knowledge and Data Engineering 35, 6 (2022), 6449–6460.
[13]
Chang Tang, Xinwang Liu, Xinzhong Zhu, Jian Xiong, Miaomiao Li, Jingyuan Xia, Xiangke Wang, and Lizhe Wang. 2019. Feature selective projection with low-rank embedding and dual Laplacian regularization. IEEE Transactions on Knowledge and Data Engineering 32, 9 (2019), 1747–1760.
[14]
Xinhang Wan, Xinwang Liu, Jiyuan Liu, Siwei Wang, Yi Wen, Weixuan Liang, En Zhu, Zhe Liu, and Lu Zhou. 2023. Auto-weighted multi-view clustering for large-scale data. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 10078–10086.
[15]
Siwei Wang, Xinwang Liu, Xinzhong Zhu, Pei Zhang, Yi Zhang, Feng Gao, and En Zhu. 2021. Fast parameter-free multi-view subspace clustering with consensus anchor guidance. IEEE Transactions on Image Processing 31 (2021), 556–568.
[16]
Wei Xia, Quanxue Gao, Qianqian Wang, Xinbo Gao, Chris Ding, and Dacheng Tao. 2022. Tensorized bipartite graph learning for multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 4 (2022), 5187–5202.
[17]
Yuan Xie, Dacheng Tao, Wensheng Zhang, Yan Liu, Lei Zhang, and Yanyun Qu. 2018. On unifying multi-view self-representations for clustering by tensor multi-rank minimization. International Journal of Computer Vision 126 (2018), 1157–1179.
[18]
Jinglin Xu, Junwei Han, Feiping Nie, and Xuelong Li. 2017. Re-weighted discriminatively embedded k -means for multi-view clustering. IEEE Transactions on Image Processing 26, 6 (2017), 3016–3027.
[19]
Chen Zhang, Siwei Wang, Jiyuan Liu, Sihang Zhou, Pei Zhang, Xinwang Liu, En Zhu, and Changwang Zhang. 2021. Multi-view clustering via deep matrix factorization and partition alignment. In Proceedings of the 29th ACM international conference on multimedia. 4156–4164.
[20]
Pei Zhang, Xinwang Liu, Jian Xiong, Sihang Zhou, Wentao Zhao, En Zhu, and Zhiping Cai. 2020. Consensus one-step multi-view subspace clustering. IEEE Transactions on Knowledge and Data Engineering 34, 10 (2020), 4676–4689.
[21]
Xiao Zheng, Chang Tang, Xinwang Liu, and En Zhu. 2023. Multi-view clustering via matrix factorization assisted k-means. Neurocomputing 534 (2023), 45–54.
[22]
Peng Zhou, Liang Du, Lei Shi, Hanmo Wang, and Yi-Dong Shen. 2015. Recovery of corrupted multiple kernels for clustering. In Twenty-Fourth International Joint Conference on Artificial Intelligence. Citeseer.

Index Terms

  1. Unified Multi-view Clustering based on Joint Multi-Structure Representation Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MMAsia '24: Proceedings of the 6th ACM International Conference on Multimedia in Asia
    December 2024
    939 pages
    ISBN:9798400712739
    DOI:10.1145/3696409
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 December 2024

    Check for updates

    Author Tags

    1. Multi-view clustering
    2. K-means
    3. Matrix factorization
    4. MERA decomposition

    Qualifiers

    • Research-article

    Conference

    MMAsia '24
    Sponsor:
    MMAsia '24: ACM Multimedia Asia
    December 3 - 6, 2024
    Auckland, New Zealand

    Acceptance Rates

    Overall Acceptance Rate 59 of 204 submissions, 29%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 23
      Total Downloads
    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)23
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media