Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3503161.3548124acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Efficient Anchor Learning-based Multi-view Clustering -- A Late Fusion Method

Published: 10 October 2022 Publication History

Abstract

Anchor enhanced multi-view late fusion clustering has attracted numerous researchers' attention for its high clustering accuracy and promising efficiency. However, in the existing methods, the anchor points are usually generated through sampling or linearly combining the samples within the datasets, which could result in enormous time consumption and limited representation capability. To solve the problem, in our method, we learn the view-specific anchor points by learning them directly. Specifically, in our method, we first reconstruct the partition matrix of each view through multiplying a view-specific anchor matrix by a consensus reconstruction matrix. Then, by maximizing the weighted alignment between the base partition matrix and its estimated version in each view, we learn the optimal anchor points for each view. In particular, unlike previous late fusion algorithms, which define anchor points as linear combinations of existing samples, we define anchor points as a series of orthogonal vectors that are directly learned through optimization, which expands the learning space of the anchor points. Moreover, based on the above design, the resultant algorithm has only linear complexity and no hyper-parameter. Experiments on $12$ benchmark kernel datasets and 5 large-scale datasets illustrate that the proposed Efficient Anchor Learning-based Multi-view Clustering (AL-MVC) algorithm achieves the state-of-the-art performance in both clustering performance and efficiency.

Supplementary Material

MP4 File (MM22-mmfp1579.mp4)
Hello everyone, I am Tiejian Zhang. I am a master student of National University of Defense Technology. The title of my paper today is Efficient Anchor Learning-based Multi-view Clustering a Late Fusion Approach. I will introduce our work from three aspects: Motivation and method, contribution and experiment.

References

[1]
Man-Sheng Chen, Ling Huang, Chang-DongWang, Dong Huang, and Jian-Huang Lai. 2021. Relaxed multi-view clustering in latent embedding space. Information Fusion 68 (2021), 8 -- 21.
[2]
Xinlei Chen and Deng Cai. 2011. Large Scale Spectral Clustering with Landmark-Based Representation. In Aaai Conference on Artificial Intelligence.
[3]
Yongyong Chen, Xiaolin Xiao, and Yicong Zhou. 2019. Jointly learning kernel representation tensor and affinity matrix for multi-view clustering. IEEE Transactions on Multimedia (2019).
[4]
Bo Huang, Tingfa Xu, Shenwang Jiang, Yiwen Chen, and Yu Bai. 2020. Robust Visual Tracking via Constrained Multi-Kernel Correlation Filters. IEEE Transactions on Multimedia 22, 11 (2020), 2820--2832.
[5]
Hsin-Chien Huang, Yung-Yu Chuang, and Chu-Song Chen. 2011. Multiple kernel fuzzy clustering. IEEE Transactions on Fuzzy Systems 20, 1 (2011), 120--134.
[6]
S. Jegelka, A. Gretton, B Schölkopf, B. Sriperumbudur, U Von Luxburg, M. Hund, and Z. Aziz. 2009. Generalized clustering via kernel embeddings. Springer-Verlag (2009).
[7]
Z. Kang, W. Zhou, Z. Zhao, J. Shao, M. Han, and Z. Xu. 2019. Large-scale Multiview Subspace Clustering in Linear Time. arXiv (2019).
[8]
Abhishek Kumar and Hal Daumé. 2011. A co-training approach for multi-view spectral clustering. In Proceedings of the 28th international conference on machine learning (ICML-11). 393--400.
[9]
Abhishek Kumar, Piyush Rai, and Hal Daume. 2011. Co-regularized multi-view spectral clustering. Advances in neural information processing systems 24 (2011), 1413--1421.
[10]
Miaomiao Li, Xinwang Liu, Lei Wang, Yong Dou, Jianping Yin, and En Zhu. 2016. Multiple kernel clustering with local kernel alignment maximization. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. 1704--1710.
[11]
Miaomiao Li, Xinwang Liu, Lei Wang, Yong Dou, Jianping Yin, and En Zhu. 2016. Multiple Kernel Clustering with Local Kernel Alignment Maximization. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (New York, New York, USA) (IJCAI'16). AAAI Press, 1704--1710.
[12]
Xuelong Li, Han Zhang, RongWang, and Feiping Nie. 2020. Multiview Clustering: A Scalable and Parameter-Free Bipartite Graph Fusion Method. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 1 (2020), 330--344.
[13]
Yeqing Li, Feiping Nie, Heng Huang, and Junzhou Huang. 2015. Large-Scale Multi-View Spectral Clustering via Bipartite Graph. (2015).
[14]
Zhenglai Li, Chang Tang, Xinwang Liu, Xiao Zheng, Guanghui Yue, Wei Zhang, and En Zhu. 2021. Consensus Graph Learning for Multi-view Clustering. IEEE Transactions on Multimedia (2021).
[15]
Yijie Lin, Yuanbiao Gou, Zitao Liu, Boyun Li, Jiancheng Lv, and Xi Peng. 2021. COMPLETER: Incomplete multi-view clustering via contrastive prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11174--11183.
[16]
Jiyuan Liu, Xinwang Liu, Jian Xiong, Qing Liao, Sihang Zhou, Siwei Wang, and Yuexiang Yang. 2020. Optimal Neighborhood Multiple Kernel Clustering with Adaptive Local Kernels. IEEE Transactions on Knowledge and Data Engineering (2020), 1--1. https://doi.org/10.1109/TKDE.2020.3014104
[17]
Suyuan Liu, Siwei Wang, Pei Zhang, Kai Xu, Xinwang Liu, Changwang Zhang, and Feng Gao. 2022. Efficient one-pass multi-view subspace clustering with consensus anchors. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 7576--7584.
[18]
Xinwang Liu, Yong Dou, Jianping Yin, Lei Wang, and En Zhu. 2016. Multiple Kernel k-Means Clustering with Matrix-Induced Regularization. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (Phoenix, Arizona) (AAAI'16). AAAI Press, 1888--1894.
[19]
Xinwang Liu, Li Liu, Qing Liao, Siwei Wang, Yi Zhang, Wenxuan Tu, Chang Tang, Jiyuan Liu, and En Zhu. 2021. One pass late fusion multi-view clustering. In International Conference on Machine Learning. PMLR, 6850--6859.
[20]
Xinwang Liu, Lei Wang, Jianping Yin, En Zhu, and Jian Zhang. 2013. An efficient approach to integrating radius information into multiple kernel learning. IEEE transactions on cybernetics 43, 2 (2013), 557--569.
[21]
Xinwang Liu, Sihang Zhou, Yueqing Wang, Miaomiao Li, and Han Li. 2017. Optimal Neighborhood Kernel Clustering with Multiple Kernels. In AAAI2017.
[22]
X. Liu, E. Zhu, J. Liu, T. Hospedales, Y. Wang, and M. Wang. 2020. SimpleMKKM: Simple Multiple Kernel K-means. (2020).
[23]
Yue Liu, Wenxuan Tu, Sihang Zhou, Xinwang Liu, Linxuan Song, Xihong Yang, and En Zhu. 2022. Deep Graph Clustering via Dual Correlation Reduction.
[24]
Yue Liu, Xihong Yang, Sihang Zhou, and Xinwang Liu. 2022. Simple Contrastive Graph Clustering. arXiv preprint arXiv:2205.07865 (2022).
[25]
Yue Liu, Sihang Zhou, Xinwang Liu, Wenxuan Tu, and Xihong Yang. 2022. Improved Dual Correlation Reduction Network. arXiv preprint arXiv:2202.12533 (2022).
[26]
Feiping Nie, Jing Li, and Xuelong Li. 2017. Self-Weighted Multiview Clustering with Multiple Graphs. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (Melbourne, Australia) (IJCAI'17). AAAI Press, 2564--2570.
[27]
Feiping Nie, Lai Tian, and Xuelong Li. 2018. Multiview clustering via adaptively weighted procrustes. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 2022--2030.
[28]
Xi Peng, Jiashi Feng, Shijie Xiao, Wei-Yun Yau, Joey Tianyi Zhou, and Songfan Yang. 2018. Structured autoencoders for subspace clustering. IEEE Transactions on Image Processing 27, 10 (2018), 5076--5086.
[29]
Leigang Qu, Meng Liu, Da Cao, Liqiang Nie, and Qi Tian. 2020. Context-Aware Multi-View Summarization Network for Image-Text Matching. Association for Computing Machinery, New York, NY, USA, 1047--1055. https://doi.org/10.1145/3394171.3413961
[30]
Zhenwen Ren and Quansen Sun. 2020. Simultaneous global and local graph structure preserving for multiple kernel clustering. IEEE transactions on neural networks and learning systems 32, 5 (2020), 1839--1851.
[31]
Mengjing Sun, Siwei Wang, Pei Zhang, Xinwang Liu, Sihang Zhou, Xifeng Guo, and En Zhu. 2021. Projective Multiple Kernel Subspace Clustering. IEEE Transactions on Multimedia (2021).
[32]
Mengjing Sun, Pei Zhang, Siwei Wang, Sihang Zhou, Wenxuan Tu, Xinwang Liu, En Zhu, and Changjian Wang. 2021. Scalable multi-view subspace clustering with unified anchors. In Proceedings of the 29th ACM International Conference on Multimedia. 3528--3536.
[33]
Chang Tang, Xinzhong Zhu, Xinwang Liu, Miaomiao Li, PichaoWang, Changqing Zhang, and Lizhe Wang. 2018. Learning a joint affinity graph for multiview subspace clustering. IEEE Transactions on Multimedia 21, 7 (2018), 1724--1736.
[34]
Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9 (2008).
[35]
Boyue Wang, Yongli Hu, Junbin Gao, Yanfeng Sun, Fujiao Ju, and Baocai Yin. 2020. Learning Adaptive Neighborhood Graph on Grassmann Manifolds for Video/Image-Set Subspace Clustering. IEEE Transactions on Multimedia (2020).
[36]
Huibing Wang, Yang Wang, Zhao Zhang, Xianping Fu, Li Zhuo, Mingliang Xu, and Meng Wang. 2020. Kernelized multiview subspace analysis by self-weighted learning. IEEE Transactions on Multimedia (2020).
[37]
SiweiWang, Xinwang Liu, En Zhu, Chang Tang, Jiyuan Liu, Jingtao Hu, Jingyuan Xia, and Jianping Yin. 2019. Multi-view Clustering via Late Fusion Alignment Maximization. In IJCAI. 3778--3784.
[38]
SiweiWang, Xinwang Liu, Xinzhong Zhu, Pei Zhang, Yi Zhang, Feng Gao, and En Zhu. 2022. Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor Guidance. IEEE Trans. Image Process. 31 (2022), 556--568. https://doi.org/10.1109/TIP.2021.3131941
[39]
Mouxing Yang, Yunfan Li, Zhenyu Huang, Zitao Liu, Peng Hu, and Xi Peng. 2021. Partially view-aligned representation learning with noise-robust contrastive loss. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 1134--1143.
[40]
Xiwen Yao, Junwei Han, Dingwen Zhang, and Feiping Nie. 2017. Revisiting co-saliency detection: A novel approach based on two-stage multi-view spectral rotation co-clustering. IEEE Transactions on Image Processing 26, 7 (2017), 3196--3209.
[41]
Junning Zhang, Qunxing Su, Bo Tang, ChengWang, and Yining Li. 2021. DPSNet: Multitask Learning Using Geometry Reasoning for Scene Depth and Semantics. IEEE Transactions on Neural Networks and Learning Systems (2021), 1--12. https://doi.org/10.1109/TNNLS.2021.3107362
[42]
Tiejian Zhang, Xinwang Liu, Lei Gong, Siwei Wang, Xin Niu, and Li Shen. 2021. Late Fusion Multiple Kernel Clustering with Local Kernel Alignment Maximization. IEEE Transactions on Multimedia (2021), 1--1. https://doi.org/10.1109/TMM.2021.3136094
[43]
Yi Zhang, Xinwang Liu, Jiyuan Liu, Sisi Dai, Changwang Zhang, Kai Xu, and En Zhu. 2022. Fusion Multiple Kernel K-means. (2022).
[44]
Yi Zhang, Xinwang Liu, Siwei Wang, Jiyuan Liu, Sisi Dai, and En Zhu. 2021. One-Stage Incomplete Multi-view Clustering via Late Fusion. In Proceedings of the 29th ACM International Conference on Multimedia. 2717--2725.
[45]
Sihang Zhou, Xinwang Liu, Miaomiao Li, En Zhu, Li Liu, Changwang Zhang, and Jianping Yin. 2020. Multiple Kernel Clustering With Neighbor-Kernel Subspace Segmentation. IEEE Transactions on Neural Networks and Learning Systems 31, 4 (2020), 1351--1362. https://doi.org/10.1109/TNNLS.2019.2919900
[46]
Sihang Zhou, Qiyuan Ou, Xinwang Liu, Siqi Wang, Luyan Liu, Siwei Wang, En Zhu, Jianping Yin, and Xin Xu. 2021. Multiple Kernel Clustering With Compressed Subspace Alignment. IEEE Transactions on Neural Networks and Learning Systems (2021), 1--12. https://doi.org/10.1109/TNNLS.2021.3093426
[47]
Sihang Zhou, En Zhu, Xinwang Liu, Tianming Zheng, Qiang Liu, Jingyuan Xia, and Jianping Yin. 2020. Subspace segmentation-based robust multiple kernel clustering. Information Fusion 53 (2020), 145 -- 154.

Cited By

View all
  • (2024)NOODLE: Joint Cross-View Discrepancy Discovery and High-Order Correlation Detection for Multi-View Subspace ClusteringACM Transactions on Knowledge Discovery from Data10.1145/365330518:6(1-23)Online publication date: 29-Apr-2024
  • (2024)Dual Consensus Anchor Learning for Fast Multi-View ClusteringIEEE Transactions on Image Processing10.1109/TIP.2024.345965133(5298-5311)Online publication date: 2024
  • (2024)Fast Continual Multi-View Clustering With Incomplete ViewsIEEE Transactions on Image Processing10.1109/TIP.2024.338897433(2995-3008)Online publication date: 2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '22: Proceedings of the 30th ACM International Conference on Multimedia
October 2022
7537 pages
ISBN:9781450392037
DOI:10.1145/3503161
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. anchor point
  2. base partition
  3. consensus partition
  4. late fusion
  5. multi-view clustering

Qualifiers

  • Research-article

Funding Sources

Conference

MM '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24
The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne , VIC , Australia

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)136
  • Downloads (Last 6 weeks)10
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)NOODLE: Joint Cross-View Discrepancy Discovery and High-Order Correlation Detection for Multi-View Subspace ClusteringACM Transactions on Knowledge Discovery from Data10.1145/365330518:6(1-23)Online publication date: 29-Apr-2024
  • (2024)Dual Consensus Anchor Learning for Fast Multi-View ClusteringIEEE Transactions on Image Processing10.1109/TIP.2024.345965133(5298-5311)Online publication date: 2024
  • (2024)Fast Continual Multi-View Clustering With Incomplete ViewsIEEE Transactions on Image Processing10.1109/TIP.2024.338897433(2995-3008)Online publication date: 2024
  • (2024)Heat Kernel Diffusion for Enhanced Late Fusion Multi-View ClusteringIEEE Signal Processing Letters10.1109/LSP.2024.344922931(2310-2314)Online publication date: 2024
  • (2024)Enhanced Causal Reasoning and Graph Networks for Multi-agent Path Finding2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650243(1-8)Online publication date: 30-Jun-2024

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media