Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/3304889.3305115guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Localized incomplete multiple kernel k-means

Published: 13 July 2018 Publication History

Abstract

The recently proposed multiple kernel k-means with incomplete kernels (MKKM-IK) optimally integrates a group of pre-specified incomplete kernel matrices to improve clustering performance. Though it demonstrates promising performance in various applications, we observe that it does not sufficiently consider the local structure among data and indiscriminately forces all pairwise sample similarity to equally align with their ideal similarity values. This could make the incomplete kernels less effectively imputed, and in turn adversely affect the clustering performance. In this paper, we propose a novel localized incomplete multiple kernel k-means (LI-MKKM) algorithm to address this issue. Different from existing MKKM-IK, LI-MKKM only requires the similarity of a sample to its k-nearest neighbors to align with their ideal similarity values. This helps the clustering algorithm to focus on closer sample pairs that shall stay together and avoids involving unreliable similarity evaluation for farther sample pairs. We carefully design a three-step iterative algorithm to solve the resultant optimization problem and theoretically prove its convergence. Comprehensive experiments demonstrate that our algorithm significantly outperforms the state-of-the-art comparable algorithms proposed in the recent literature, verifying the advantage of considering local structure.

References

[1]
Sahely Bhadra, Samuel Kaski, and Juho Rousu. Multi-view kernel completion. In arXiv: 1602.02518, 2016.
[2]
Xiao Cai, Feiping Nie, Weidong Cai, and Heng Huang. Heterogeneous image features integration via multi-modal semi-supervised learning model. In ICCV, pages 1737-1744, 2013.
[3]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. Diversity-induced multiview subspace clustering. In CVPR, pages 586-594, 2015.
[4]
Hongchang Gao, Feiping Nie, Xuelong Li, and Heng Huang. Multi-view subspace clustering. In ICCV, pages 4238-4246, 2015.
[5]
Zoubin Ghahramani and Michael I. Jordan. Supervised learning from incomplete data via an EM approach. In NIPS, pages 120-127, 1993.
[6]
Mehmet Gönen and Adam A. Margolin. Localized data fusion for kernel k-means clustering with application to cancer biology. In NIPS, pages 1305-1313, 2014.
[7]
Ritwik Kumar, Ting Chen, Moritz Hardt, David Beymer, Karen Brannon, and Tanveer Fathima Syeda-Mahmood. Multiple kernel completion and its application to cardiac disease discrimination. In ISBI, pages 764-767, 2013.
[8]
Shao-Yuan Li, Yuan Jiang, and Zhi-Hua Zhou. Partial multi-view clustering. In AAAI, pages 1968- 1974, 2014.
[9]
Miaomiao Li, Xinwang Liu, Lei Wang, Yong Dou, Jianping Yin, and En Zhu. Multiple kernel clustering with local kernel alignment maximization. In IJCAI, pages 1704-1710, 2016.
[10]
Xinwang Liu, Lei Wang, Jian Zhang, Jianping Yin, and Huan Liu. Global and local structure preservation for feature selection. IEEE Trans. Neural Netw. Learning Syst., 25(6):1083-1095, 2014.
[11]
Xinwang Liu, Yong Dou, Jianping Yin, Lei Wang, and En Zhu. Multiple kernel k-means clustering with matrix-induced regularization. In AAAI, pages 1888- 1894, 2016.
[12]
Xinwang Liu, Miaomiao Li, Lei Wang, Yong Dou, Jianping Yin, and En Zhu. Multiple kernel k-means with incomplete kernels. In AAAI, pages 2259- 2265, 2017.
[13]
Xinwang Liu, Sihang Zhou, Yueqing Wang, Miaomiao Li, Yong Dou, En Zhu, and Jianping Yin. Optimal neighborhood kernel clustering with multiple kernels. In AAAI, pages 2266-2272, 2017.
[14]
Feiping Nie, Xiaoqian Wang, and Heng Huang. Clustering and projected clustering with adaptive neighbors. In KDD, pages 977-986, 2014.
[15]
Weixiang Shao, Lifang He, and Philip S. Yu. Multiple incomplete views clustering via weighted nonnegative matrix factorization with l2,1 regularization. In ECML PKDD, pages 318-334, 2015.
[16]
Anusua Trivedi, Piyush Rai, Hal Daumé III, and Scott L. DuVall. Multiview clustering with incomplete views. In NIPS 2010: Machine Learning for Social Computing Workshop, Whistler, Canada, 2010.
[17]
Shuo Xiang, Lei Yuan, Wei Fan, Yalin Wang, Paul M. Thompson, and Jieping Ye. Multisource learning with block-wise missing data for alzheimer's disease prediction. In ACM SIGKDD, pages 185-193, 2013.
[18]
Chang Xu, Dacheng Tao, and Chao Xu. Multi-view intact space learning. IEEE Trans. Pattern Anal. Mach. Intell., 37(12):2531-2544, 2015.
[19]
Chang Xu, Dacheng Tao, and Chao Xu. Multi-view learning with incomplete views. IEEE Trans. Image Processing, 24(12):5812-5825, 2015.
[20]
Qiyue Yin, Shu Wu, and Liang Wang. Incomplete multi-view clustering via subspace learning. In CIKM, pages 383-392, 2015.
[21]
Shi Yu, Léon-Charles Tranchevent, Xinhai Liu, Wolfgang Glänzel, Johan A. K. Suykens, Bart De Moor, and Yves Moreau. Optimized data fusion for kernel k-means clustering. IEEE TPAMI, 34(5):1031-1039, 2012.
[22]
Changqing Zhang, Huazhu Fu, Si Liu, Guangcan Liu, and Xiaochun Cao. Low-rank tensor constrained multiview subspace clustering. In ICCV, pages 1582-1590, 2015.
[23]
Handong Zhao, Hongfu Liu, and Yun Fu. Incomplete multimodal visual data grouping. In IJCAI, pages 2392-2398, 2016.

Cited By

View all
  • (2024)Robust Tensor Recovery for Incomplete Multi-View ClusteringIEEE Transactions on Multimedia10.1109/TMM.2023.332149926(3856-3870)Online publication date: 1-Jan-2024
  • (2021)One-Stage Incomplete Multi-view Clustering via Late FusionProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475204(2717-2725)Online publication date: 17-Oct-2021
  • (2019)Spectral perturbation meets incomplete multi-view dataProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367471.3367552(3677-3683)Online publication date: 10-Aug-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings
IJCAI'18: Proceedings of the 27th International Joint Conference on Artificial Intelligence
July 2018
5885 pages
ISBN:9780999241127

Sponsors

  • Adobe
  • IBMR: IBM Research
  • ERICSSON
  • Microsoft: Microsoft
  • AI Journal: AI Journal

Publisher

AAAI Press

Publication History

Published: 13 July 2018

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Robust Tensor Recovery for Incomplete Multi-View ClusteringIEEE Transactions on Multimedia10.1109/TMM.2023.332149926(3856-3870)Online publication date: 1-Jan-2024
  • (2021)One-Stage Incomplete Multi-view Clustering via Late FusionProceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475204(2717-2725)Online publication date: 17-Oct-2021
  • (2019)Spectral perturbation meets incomplete multi-view dataProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367471.3367552(3677-3683)Online publication date: 10-Aug-2019

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media