Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3503161.3547985acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

A Parameter-free Multi-view Information Bottleneck Clustering Method by Cross-view Weighting

Published: 10 October 2022 Publication History

Abstract

With the fast-growing multi-modal/media data in the Big Data era, multi-view clustering (MVC) has attracted lots of attentions lately. Most MVCs focus on integrating and utilizing the complementary information among views by linear sum of the learned view weights and have shown great success in some fields. However, they fail to quantify how complementary the information across views actually utilized for benefiting final clustering. Additionally, most of them contain at least one parameter for regularization without prior knowledge, which puts pressure on the parameter-tuning and thus makes them impractical. In this paper, we propose a novel parameter-free multi-view information bottleneck (PMIB) clustering method to automatically identify and exploit useful complementary information among views, thus reducing the negative impact from the harmful views. Specifically, we first discover the informative view by measuring the relevant information preserved by the original data and the compact clusters with mutual information. Then, a new cross-view weight learning scheme is designed to learn how complementary between the informative view and remaining views. Finally, the quantitative correlations among views are fully exploited to improve the clustering performance without needing any additional parameters or prior knowledge. Experimental results on different kinds of multi-view datasets show the effectiveness of the proposed method.

Supplementary Material

MP4 File (MM22-fp0984.mp4)
How to quantify the complementary information across views actually utilized for benefiting final clustering without parameters or prior knowledge? In this paper, we propose a novel parameter-free multi-view information bottleneck (PMIB) clustering method to automatically identify and exploit useful complementary information among views, thus reducing the negative impact from the harmful views. Experimental results on different kinds of multi-view datasets show the effectiveness of the proposed method.

References

[1]
Anton Bardera, Jaume Rigau, Imma Boada, Miquel Feixas, and Mateu Sbert. 2009. Image Segmentation Using Information Bottleneck Method. IEEE Trans. Image Process., Vol. 18, 7 (2009), 1601--1612.
[2]
Herbert Bay, Tinne Tuytelaars, and Luc J. Van Gool. Graz, Austria, May 2006. SURF: Speeded Up Robust Features. In Proc. Eur. Conf. Comput. Vis. 404--417.
[3]
Steffen Bickel and Tobias Scheffer. 2004. Multi-View Clustering. In Proceedings of the 4th IEEE International Conference on Data Mining (ICDM). 19--26.
[4]
Xiao Cai, Feiping Nie, and Heng Huang. 2013. Multi-View K-Means Clustering on Big Data. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 2598--2604.
[5]
Xiaochun Cao, Changqing Zhang, Chengju Zhou, Huazhu Fu, and Hassan Foroosh. 2015. Constrained Multi-View Video Face Clustering. IEEE Trans. Image Process., Vol. 24, 11 (2015), 4381--4393.
[6]
Yongyong Chen, Xiaolin Xiao, and Yicong Zhou. 2020. Jointly Learning Kernel Representation Tensor and Affinity Matrix for Multi-View Clustering. IEEE Trans. Multim., Vol. 22, 8 (2020), 1985--1997.
[7]
Thomas M. Cover and Joy A. Thomas. 2006. Elements of Information Theory. Wiley-Interscience.
[8]
Shaohua Fan, Xiao Wang, Chuan Shi, Emiao Lu, Ken Lin, and Bai Wang. 2020. One2Multi Graph Autoencoder for Multi-view Graph Clustering. In WWW '20: The Web Conference. 3070--3076.
[9]
Yan Gao, Shiwen Gu, Jianhua Li, and Zhining Liao. 2007. The Multi-view Information Bottleneck Clustering. In 12th International Conference on Database Systems for Advanced Applications, DASFAA, Vol. 4443. 912--917.
[10]
Shizhe Hu, Zhengzheng Lou, and Yangdong Ye. 2022. View-Wise Versus Cluster-Wise Weight: Which Is Better for Multi-View Clustering? IEEE Trans. Image Process., Vol. 31 (2022), 58--71.
[11]
Shizhe Hu, Xiaoqiang Yan, and Yangdong Ye. 2020. Joint specific and correlated information exploration for multi-view action clustering. Inf. Sci., Vol. 524 (2020), 148--164.
[12]
Shizhe Hu, Xiaoqiang Yan, and Yangdong Ye. 2021. Multi-Task Image Clustering through Correlation Propagation. IEEE Trans. Knowl. Data Eng., Vol. 33, 3 (2021), 1113--1127.
[13]
Zongmo Huang, Yazhou Ren, Xiaorong Pu, and Lifang He. 2021. Non-Linear Fusion for Self-Paced Multi-View Clustering. In ACM Multimedia Conference. 3211--3219.
[14]
Fahad Shahbaz Khan, Joost van de Weijer, and Mar'i a Vanrell. 2009. Top-down color attention for object recognition. In Proc. ICCV. 979--986.
[15]
Abhishek Kumar, Piyush Rai, and Hal Daumé III. 2011. Co-regularized Multi-view Spectral Clustering. In Advances in Neural Information Processing Systems. 1413--1421.
[16]
Xuelong Li, Mulin Chen, and Qi Wang. 2020. Adaptive Consistency Propagation Method for Graph Clustering. IEEE Trans. Knowl. Data Eng., Vol. 32, 4 (2020), 797--802.
[17]
Jianhua Lin. 1991. Divergence measures based on the Shannon entropy. IEEE Trans. Information Theory, Vol. 37, 1 (1991), 145--151.
[18]
Jiyuan Liu, Xinwang Liu, Yi Zhang, Pei Zhang, Wenxuan Tu, Siwei Wang, Sihang Zhou, Weixuan Liang, Siqi Wang, and Yuexiang Yang. 2021. Self-Representation Subspace Clustering for Incomplete Multi-view Data. In MM '21: ACM Multimedia Conference. 2726--2734.
[19]
Zhengzheng Lou, Yangdong Ye, and Xiaoqiang Yan. 2013. The Multi-Feature Information Bottleneck with Application to Unsupervised Image Categorization. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence. 1508--1515.
[20]
David G. Lowe. 2004. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vis., Vol. 60, 2 (2004), 91--110.
[21]
Saeid Motiian and Gianfranco Doretto. 2016. Information Bottleneck Domain Adaptation with Privileged Information for Visual Recognition. In ECCV 14th European Conference Computer Vision, Vol. 9911. 630--647.
[22]
Feiping Nie, Guohao Cai, Jing Li, and Xuelong Li. 2018. Auto-Weighted Multi-View Learning for Image Clustering and Semi-Supervised Classification. IEEE Trans. Image Process., Vol. 27, 3 (2018), 1501--1511.
[23]
Mengjing Sun, Pei Zhang, Siwei Wang, Sihang Zhou, Wenxuan Tu, Xinwang Liu, En Zhu, and Changjian Wang. 2021. Scalable Multi-view Subspace Clustering with Unified Anchors. In ACM Multimedia Conference. 3528--3536.
[24]
Naftali Tishby, Fernando C Pereira, and William Bialek. 1999. The Information Bottleneck Method. In Proc. Annual Allerton Conf. Communnication Control Computing. 368--377.
[25]
Hao Wang, Yan Yang, and Bing Liu. 2020. GMC: Graph-Based Multi-View Clustering. IEEE Trans. Knowl. Data Eng., Vol. 32, 6 (2020), 1116--1129.
[26]
Siwei Wang, Xinwang Liu, Li Liu, Sihang Zhou, and En Zhu. 2021. Late Fusion Multiple Kernel Clustering With Proxy Graph Refinement. IEEE Transactions on Neural Networks and Learning Systems (2021), 1--12.
[27]
Siwei Wang, Xinwang Liu, Xinzhong Zhu, Pei Zhang, Yi Zhang, Feng Gao, and En Zhu. 2022. Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor Guidance. IEEE Trans. Image Process., Vol. 31 (2022), 556--568.
[28]
Jie Wen, Zheng Zhang, Zhao Zhang, Lunke Fei, and Meng Wang. 2021. Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion. IEEE Trans. Cybern., Vol. 51, 1 (2021), 101--114.
[29]
L. Wolf, T. Hassner, and Y. Taigman. 2008. Descriptor Based Methods in the Wild. In Real-Life Images workshop at ECCV.
[30]
Rongkai Xia, Yan Pan, Lei Du, and Jian Yin. 2014. Robust Multi-View Spectral Clustering via Low-Rank and Sparse Decomposition. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence. 2149--2155.
[31]
Chang Xu, Dacheng Tao, and Chao Xu. 2014. Large-Margin Multi-View Information Bottleneck. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 36, 8 (2014), 1559--1572.
[32]
Jinglin Xu, Junwei Han, and Feiping Nie. 2016. Discriminatively Embedded K-Means for Multi-view Clustering. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. 5356--5364.
[33]
Zhe Xue, Guorong Li, Shuhui Wang, Jun Huang, Weigang Zhang, and Qingming Huang. 2019. Beyond global fusion: A group-aware fusion approach for multi-view image clustering. Inf. Sci., Vol. 493 (2019), 176--191.
[34]
Xiaoqiang Yan, Shizhe Hu, and Yangdong Ye. 2017. Multi-task Clustering of Human Actions by Sharing Information. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR. 4049--4057.
[35]
Longqi Yang, Liangliang Zhang, and Yuhua Tang. 2021. Scalable Auto-weighted Discrete Multi-view Clustering. In WWW '21: The Web Conference 2021. 3269--3278.
[36]
Jun Yin and Shiliang Sun. 2022. Incomplete multi-view clustering with cosine similarity. Pattern Recognit., Vol. 123 (2022), 108371.
[37]
Chen Zhang, Siwei Wang, Jiyuan Liu, Sihang Zhou, Pei Zhang, Xinwang Liu, En Zhu, and Changwang Zhang. 2021. Multi-view Clustering via Deep Matrix Factorization and Partition Alignment. In ACM Multimedia Conference. 4156--4164.
[38]
Zheng Zhang, Li Liu, Fumin Shen, Heng Tao Shen, and Ling Shao. 2019. Binary Multi-View Clustering. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 41, 7 (2019), 1774--1782.
[39]
Sihang Zhou, Xinwang Liu, Jiyuan Liu, Xifeng Guo, Yawei Zhao, En Zhu, Yongping Zhai, Jianping Yin, and Wen Gao. 2020. Multi-View Spectral Clustering with Optimal Neighborhood Laplacian Matrix. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI. 6965--6972.
[40]
Linlin Zong, Xianchao Zhang, Xinyue Liu, and Hong Yu. 2018. Weighted Multi-View Spectral Clustering Based on Spectral Perturbation. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence. 4621--4629.io

Cited By

View all
  • (2024)Learning Dual Enhanced Representation for Contrastive Multi-view ClusteringProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681030(8731-8739)Online publication date: 28-Oct-2024
  • (2024)A Survey on Information BottleneckIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.336634946:8(5325-5344)Online publication date: Aug-2024
  • (2023)Multi-View Clustering via Triplex Information MaximizationIEEE Transactions on Image Processing10.1109/TIP.2023.329741032(4299-4313)Online publication date: 1-Jan-2023

Index Terms

  1. A Parameter-free Multi-view Information Bottleneck Clustering Method by Cross-view Weighting

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '22: Proceedings of the 30th ACM International Conference on Multimedia
    October 2022
    7537 pages
    ISBN:9781450392037
    DOI:10.1145/3503161
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. information bottleneck
    2. multi-view clustering
    3. parameter-free
    4. weight learning

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    MM '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)81
    • Downloads (Last 6 weeks)13
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Learning Dual Enhanced Representation for Contrastive Multi-view ClusteringProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681030(8731-8739)Online publication date: 28-Oct-2024
    • (2024)A Survey on Information BottleneckIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.336634946:8(5325-5344)Online publication date: Aug-2024
    • (2023)Multi-View Clustering via Triplex Information MaximizationIEEE Transactions on Image Processing10.1109/TIP.2023.329741032(4299-4313)Online publication date: 1-Jan-2023

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media