Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

NOODLE: Joint Cross-View Discrepancy Discovery and High-Order Correlation Detection for Multi-View Subspace Clustering

Published: 29 April 2024 Publication History

Abstract

Benefiting from the effective exploration of the valuable topological pair-wise relationship of data points across multiple views, multi-view subspace clustering (MVSC) has received increasing attention in recent years. However, we observe that existing MVSC approaches still suffer from two limitations that need to be further improved to enhance the clustering effectiveness. Firstly, previous MVSC approaches mainly prioritize extracting multi-view consistency, often neglecting the cross-view discrepancy that may arise from noise, outliers, and view-inherent properties. Secondly, existing techniques are constrained by their reliance on pair-wise sample correlation and pair-wise view correlation, failing to capture the high-order correlations that are enclosed within multiple views. To address these issues, we propose a novel MVSC framework via joiNt crOss-view discrepancy discOvery anD high-order correLation dEtection (NOODLE), seeking an informative target subspace representation compatible across multiple features to facilitate the downstream clustering task. Specifically, we first exploit the self-representation mechanism to learn multiple view-specific affinity matrices, which are further decomposed into cohesive factors and incongruous factors to fit the multi-view consistency and discrepancy, respectively. Additionally, an explicit cross-view sparse regularization is applied to incoherent parts, ensuring the consistency and discrepancy to be precisely separated from the initial subspace representations. Meanwhile, the multiple cohesive parts are stacked into a three-dimensional tensor associated with a tensor-Singular Value Decomposition (t-SVD) based weighted tensor nuclear norm constraint, enabling effective detection of the high-order correlations implicit in multi-view data. Our proposed method outperforms state-of-the-art methods for multi-view clustering on six benchmark datasets, demonstrating its effectiveness.

References

[1]
Liang Bai, Jiye Liang, and Yunxiao Zhao. 2022. Self-constrained spectral clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence (2022), 1–13.
[2]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 586–594.
[3]
Man-Sheng Chen, Ling Huang, Chang-Dong Wang, and Dong Huang. 2020. Multi-view clustering in latent embedding space. In Proceedings of the AAAI Conference on Artificial Intelligence. 3513–3520.
[4]
Man-Sheng Chen, Chang-Dong Wang, Dong Huang, Jian-Huang Lai, and Philip S. Yu. 2022. Efficient orthogonal multi-view subspace clustering. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 127–135.
[5]
Yongyong Chen, Shuqin Wang, Chong Peng, Zhongyun Hua, and Yicong Zhou. 2021. Generalized nonconvex low-rank tensor approximation for multi-view subspace clustering. IEEE Transactions on Image Processing 30 (2021), 4022–4035.
[6]
Tao Pham Dinh and Hoai An Le Thi. 1997. Convex analysis approach to DC programming: Theory, algorithm and applications. Acta Mathematica Vietnamica 22, 1 (1997), 289–355.
[7]
Zhibin Dong, Jiaqi Jin, Yuyang Xiao, Siwei Wang, Xinzhong Zhu, Xinwang Liu, and En Zhu. 2023. Iterative deep structural graph contrast clustering for multiview raw data. IEEE Transactions on Neural Networks and Learning Systems (2023), 1–13.
[8]
Zhibin Dong, Siwei Wang, Jiaqi Jin, Xinwang Liu, and En Zhu. 2023. Cross-view topology based consistent and complementary information for deep multi-view clustering. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). 19440–19451.
[9]
Jingcan Duan, Siwei Wang, Pei Zhang, En Zhu, Jingtao Hu, Hu Jin, Yue Liu, and Zhibin Dong. 2023. Graph anomaly detection via multi-scale contrastive learning networks with augmented view. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. 7459–7467.
[10]
Quanxue Gao, Wei Xia, Zhizhen Wan, Deyan Xie, and Pu Zhang. 2020. Tensor-SVD based graph learning for multi-view subspace clustering. In Proceedings of the AAAI Conference on Artificial Intelligence. 3930–3937.
[11]
Derek Greene and Pádraig Cunningham. 2006. Practical solutions to the problem of diagonal dominance in kernel document clustering. In Proceedings of the 23rd International Conference on Machine Learning. 377–384.
[12]
Zhibin Gu, Songhe Feng, Ruiting Hu, and Gengyu Lyu. 2023. ONION: Joint unsupervised feature selection and robust subspace extraction for graph-based multi-view clustering. ACM Transactions on Knowledge Discovery from Data 17, 5 (2023).
[13]
Jipeng Guo, Yanfeng Sun, Junbin Gao, Yongli Hu, and Baocai Yin. 2022. Rank consistency induced multiview subspace clustering via low-rank matrix factorization. IEEE Transactions on Neural Networks and Learning Systems 33, 7 (2022), 3157–3170.
[14]
Junlin Hu, Jiwen Lu, and Yap-Peng Tan. 2018. Sharable and individual multi-view metric learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 9 (2018), 2281–2288.
[15]
Shudong Huang, Yixi Liu, Ivor W. Tsang, Zenglin Xu, and Jiancheng Lv. 2022. Multi-view subspace clustering by joint measuring of consistency and diversity. IEEE Transactions on Knowledge and Data Engineering (2022), 1–12.
[16]
Shudong Huang, Ivor Tsang, Zenglin Xu, Jiancheng Lv, and Quan-Hui Liu. 2022. Multi-view clustering on topological manifold. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 6944–6951.
[17]
Shudong Huang, Hongjie Wu, Yazhou Ren, Ivor Tsang, Zenglin Xu, Wentao Feng, and Jiancheng Lv. 2022. Multi-view subspace clustering on topological manifold. In Advances in Neural Information Processing Systems. 25883–25894.
[18]
Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, and Qingfu Zhang. 2021. Multi-view spectral clustering tailored tensor low-rank representation. IEEE Transactions on Circuits and Systems for Video Technology 31, 12 (2021), 4784–4797.
[19]
Jiaqi Jin, Siwei Wang, Zhibin Dong, Xinwang Liu, and En Zhu. 2023. Deep incomplete multi-view clustering with cross-view partial sample and prototype alignment. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11600–11609.
[20]
Zhao Kang, Wangtao Zhou, Zhitong Zhao, Junming Shao, Meng Han, and Zenglin Xu. 2020. Large-scale multi-view subspace clustering in linear time. In Proceedings of the AAAI Conference on Artificial Intelligence. 4412–4419.
[21]
Misha E. Kilmer, Karen Braman, Ning Hao, and Randy C. Hoover. 2010. Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J. Matrix Anal. Appl. 34, 1 (2010), 148–172.
[22]
Abhishek Kumar, Piyush Rai, and Hal Daumé. 2011. Co-regularized multi-view spectral clustering. In Proceedings of the 24th International Conference on Neural Information Processing Systems. 1413–1421.
[23]
Ruihuang Li, Changqing Zhang, Huazhu Fu, Xi Peng, Joey Tianyi Zhou, and Qinghua Hu. 2019. Reciprocal multi-layer subspace learning for multi-view clustering. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV). 8171–8179.
[24]
Ruihuang Li, Changqing Zhang, Qinghua Hu, Pengfei Zhu, and Zheng Wang. 2019. Flexible multi-view representation learning for subspace clustering. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2916–2922.
[25]
Sheng Li, Ming Shao, and Yun Fu. 2018. Person re-identification by cross-view multi-level dictionary learning. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 12 (2018), 2963–2977.
[26]
Xuelong Li, Han Zhang, Rong Wang, and Feiping Nie. 2022. Multiview clustering: A scalable and parameter-free bipartite graph fusion method. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 1 (2022), 330–344.
[27]
Zhenglai Li, Chang Tang, Xinwang Liu, Xiao Zheng, Wei Zhang, and En Zhu. 2022. Consensus graph learning for multi-view clustering. IEEE Transactions on Multimedia 24 (2022), 2461–2472.
[28]
Zhenglai Li, Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, and En Zhu. 2022. High-order correlation preserved incomplete multi-view subspace clustering. IEEE Transactions on Image Processing 31 (2022), 2067–2080.
[29]
Weixuan Liang, Xinwang Liu, Sihang Zhou, Jiyuan Liu, Siwei Wang, and En Zhu. 2022. Robust graph-based multi-view clustering. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 7462–7469.
[30]
Youwei Liang, Dong Huang, and Chang-Dong Wang. 2019. Consistency meets inconsistency: A unified graph learning framework for multi-view clustering. In 2019 IEEE International Conference on Data Mining (ICDM). 1204–1209.
[31]
Yijie Lin, Yuanbiao Gou, Zitao Liu, Boyun Li, Jiancheng Lv, and Xi Peng. 2021. COMPLETER: Incomplete multi-view clustering via contrastive prediction. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11169–11178.
[32]
Xinwang Liu. 2023. SimpleMKKM: Simple multiple kernel k-means. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 4 (2023), 5174–5186.
[33]
Xinwang Liu, Miaomiao Li, Chang Tang, Jingyuan Xia, Jian Xiong, Li Liu, Marius Kloft, and En Zhu. 2021. Efficient and effective regularized incomplete multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 8 (2021), 2634–2646.
[34]
Xinwang Liu, Li Liu, Qing Liao, Siwei Wang, Yi Zhang, Wenxuan Tu, Chang Tang, Jiyuan Liu, and En Zhu. 2021. One pass late fusion multi-view clustering. In Proceedings of the 38th International Conference on Machine Learning. 6850–6859.
[35]
Khanh Luong and Richi Nayak. 2022. Learning inter- and intra-manifolds for matrix factorization-based multi-aspect data clustering. IEEE Transactions on Knowledge and Data Engineering 34, 7 (2022), 3349–3362.
[36]
Ziyu Lv, Quanxue Gao, Xiangdong Zhang, Qin Li, and Ming Yang. 2022. View-consistency learning for incomplete multiview clustering. IEEE Transactions on Image Processing 31 (2022), 4790–4802.
[37]
Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2001. On spectral clustering: Analysis and an algorithm. In Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic. 849–856.
[38]
Feiping Nie, Guohao Cai, and Xuelong Li. 2017. Multi-view clustering and semi-supervised classification with adaptive neighbours. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 2408–2414.
[39]
Feiping Nie, Lai Tian, and Xuelong Li. 2018. Multiview clustering via adaptively weighted procrustes. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2022–2030.
[40]
ErLin Pan and Zhao Kang. 2021. Multi-view contrastive graph clustering. In Advances in Neural Information Processing Systems. 2148–2159.
[41]
Xi Peng, Zhenyu Huang, Jiancheng Lv, Hongyuan Zhu, and Joey Tianyi Zhou. 2019. COMIC: Multi-view clustering without parameter selection. In Proceedings of the 36th International Conference on Machine Learning, Vol. 97. 5092–5101.
[42]
Fanhua Shang, James Cheng, Yuanyuan Liu, Zhi-Quan Luo, and Zhouchen Lin. 2018. Bilinear factor matrix norm minimization for robust PCA: Algorithms and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 9 (2018), 2066–2080.
[43]
Mengjing Sun, Pei Zhang, Siwei Wang, Sihang Zhou, Tu Wenxuan, Xinwang Liu, En Zhu, and Changjian Wang. 2021. Scalable multi-view subspace clustering with unified anchors. In Proceedings of the 29th ACM International Conference on Multimedia. Association for Computing Machinery, 3528–3536.
[44]
Chang Tang, Zhenglai Li, Jun Wang, Xinwang Liu, Wei Zhang, and En Zhu. 2023. Unified one-step multi-view spectral clustering. IEEE Transactions on Knowledge and Data Engineering 35, 6 (2023), 6449–6460.
[45]
Chang Tang, Zhenglai Li, Weiqing Yan, Guanghui Yue, and Wei Zhang. 2022. Efficient multiple kernel clustering via spectral perturbation. In Proceedings of the 30th ACM International Conference on Multimedia. 1603–1611.
[46]
Chang Tang, Xinwang Liu, Xinzhong Zhu, En Zhu, Zhigang Luo, Lizhe Wang, and Wen Gao. 2020. CGD: Multi-view clustering via cross-view graph diffusion. In Proceedings of the AAAI Conference on Artificial Intelligence. 5924–5931.
[47]
Chang Tang, Xiao Zheng, Xinwang Liu, Wei Zhang, Jing Zhang, Jian Xiong, and Lizhe Wang. 2022. Cross-view locality preserved diversity and consensus learning for multi-view unsupervised feature selection. IEEE Transactions on Knowledge and Data Engineering 34, 10 (2022), 4705–4716.
[48]
Chang Tang, Xiao Zheng, Wei Zhang, Xinwang Liu, Xinzhong Zhu, and En Zhu. 2023. Unsupervised feature selection via multiple graph fusion and feature weight learning. Science China Information Sciences 66 (04 2023), 1–17.
[49]
Hao Wang, Yan Yang, and Bing Liu. 2020. GMC: Graph-based multi-view clustering. IEEE Transactions on Knowledge and Data Engineering 32, 6 (2020), 1116–1129.
[50]
Jing Wang, Songhe Feng, Gengyu Lyu, and Zhibin Gu. 2023. Triple-granularity contrastive learning for deep multi-view subspace clustering. In Proceedings of the 31st ACM International Conference on Multimedia. 2994–3002.
[51]
Siwei Wang, Xinwang Liu, Xinzhong Zhu, Pei Zhang, Yi Zhang, Feng Gao, and En Zhu. 2022. Fast parameter-free multi-view subspace clustering with consensus anchor guidance. IEEE Transactions on Image Processing 31 (2022), 556–568.
[52]
J. Winn and N. Jojic. 2005. LOCUS: Learning object classes with unsupervised segmentation. In Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, Vol. 1. 756–763.
[53]
Wei Xia, Quanxue Gao, Qianqian Wang, Xinbo Gao, Chris Ding, and Dacheng Tao. 2023. Tensorized bipartite graph learning for multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 4 (2023), 5187–5202.
[54]
Jie Xu, Chao Li, Liang Peng, Yazhou Ren, Xiaoshuang Shi, Heng Tao Shen, and Xiaofeng Zhu. 2023. Adaptive feature projection with distribution alignment for deep incomplete multi-view clustering. IEEE Transactions on Image Processing 32 (2023), 1354–1366.
[55]
Jie Xu, Huayi Tang, Yazhou Ren, Liang Peng, Xiaofeng Zhu, and Lifang He. 2022. Multi-level feature learning for contrastive multi-view clustering. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 16030–16039.
[56]
Ben Yang, Xuetao Zhang, Feiping Nie, Fei Wang, Weizhong Yu, and Rong Wang. 2021. Fast multi-view clustering via nonnegative and orthogonal factorization. IEEE Transactions on Image Processing 30 (2021), 2575–2586.
[57]
Jufeng Yang, Jie Liang, Kai Wang, Paul L. Rosin, and Ming-Hsuan Yang. 2020. Subspace clustering via good neighbors. IEEE Transactions on Pattern Analysis and Machine Intelligence 42, 6 (2020), 1537–1544.
[58]
Mouxing Yang, Yunfan Li, Peng Hu, Jinfeng Bai, Jian Cheng Lv, and Xi Peng. 2023. Robust multi-view clustering with incomplete information. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 1 (2023), 1055–1069.
[59]
Kun Zhan, Feiping Nie, Jing Wang, and Yi Yang. 2019. Multiview consensus graph clustering. IEEE Transactions on Image Processing 28, 3 (2019), 1261–1270.
[60]
Kun Zhan, Changqing Zhang, Junpeng Guan, and Junsheng Wang. 2018. Graph learning for multiview clustering. IEEE Transactions on Cybernetics 48, 10 (2018), 2887–2895.
[61]
Changqing Zhang, Qinghua Hu, Huazhu Fu, Pengfei Zhu, and Xiaochun Cao. 2017. Latent multi-view subspace clustering. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 4333–4341.
[62]
Chen Zhang, Siwei Wang, Jiyuan Liu, Sihang Zhou, Pei Zhang, Xinwang Liu, En Zhu, and Changwang Zhang. 2021. Multi-view clustering via deep matrix factorization and partition alignment. In Proceedings of the 29th ACM International Conference on Multimedia. 4156–4164.
[63]
Tiejian Zhang, Xinwang Liu, En Zhu, Sihang Zhou, and Zhibin Dong. 2022. Efficient anchor learning-based multi-view clustering–a late fusion method. In Proceedings of the 30th ACM International Conference on Multimedia. 3685–3693.
[64]
Zemin Zhang, Gregory Ely, Shuchin Aeron, Ning Hao, and Misha Kilmer. 2014. Novel methods for multilinear data completion and de-noising based on tensor-SVD. In 2014 IEEE Conference on Computer Vision and Pattern Recognition. 3842–3849.
[65]
Zheng Zhang, Li Liu, Fumin Shen, Heng Tao Shen, and Ling Shao. 2019. Binary multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 7 (2019), 1774–1782.
[66]
Handong Zhao, Zhengming Ding, and Yun Fu. 2017. Multi-view clustering via deep matrix factorization. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 2921–2927.
[67]
Guo Zhong and Chi-Man Pun. 2022. Improved normalized cut for multi-view clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 12 (2022), 10244–10251.
[68]
Linlin Zong, Xianchao Zhang, Xinyue Liu, and Hong Yu. 2018. Weighted multi-view spectral clustering based on spectral perturbation. In Proceedings of the AAAI Conference on Artificial Intelligence. 4261–4268.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Knowledge Discovery from Data
ACM Transactions on Knowledge Discovery from Data  Volume 18, Issue 6
July 2024
760 pages
EISSN:1556-472X
DOI:10.1145/3613684
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 April 2024
Online AM: 20 March 2024
Accepted: 08 March 2024
Revised: 03 December 2023
Received: 26 July 2023
Published in TKDD Volume 18, Issue 6

Check for updates

Author Tags

  1. Multi-view clustering
  2. cross-view discrepancy
  3. high-order correlation
  4. low-rank tensor representation

Qualifiers

  • Research-article

Funding Sources

  • National Key Research and Development Project
  • Beijing Natural Science Foundation
  • Tangshan Municipal Science and Technology Plan Project
  • Engineering Research Center of Integration and Application of Digital Learning Technology, Ministry of Education
  • Fundamental Research Funds for the Central Universities

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 303
    Total Downloads
  • Downloads (Last 12 months)303
  • Downloads (Last 6 weeks)26
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media