Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3292500.3330840acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Adaptive Graph Guided Disambiguation for Partial Label Learning

Published: 25 July 2019 Publication History
  • Get Citation Alerts
  • Abstract

    Partial label learning aims to induce a multi-class classifier from training examples where each of them is associated with a set of candidate labels, among which only one is the ground-truth label. The common strategy to train predictive model is disambiguation, i.e. differentiating the modeling outputs of individual candidate labels so as to recover ground-truth labeling information. Recently, feature-aware disambiguation was proposed to generate different labeling confidences over candidate label set by utilizing the graph structure of feature space. However, the existence of noise and outliers in training data makes the similarity derived from original features less reliable. To this end, we proposed a novel approach for partial label learning based on adaptive graph guided disambiguation (PL-AGGD). Compared with fixed graph, adaptive graph could be more robust and accurate to reveal the intrinsic manifold structure within the data. Moreover, instead of the two-stage strategy in previous algorithms, our approach performs label disambiguation and predictive model training simultaneously. Specifically, we present a unified framework which jointly optimizes the ground-truth labeling confidences, similarity graph and model parameters to achieve strong generalization performance. Extensive experiments show that PL-AGGD performs favorably against state-of-the-art partial label learning approaches.

    References

    [1]
    Jaume Amores. 2013. Multiple instance classification: Review, taxonomy and comparative study. Artificial intelligence, Vol. 201 (2013), 81--105.
    [2]
    Stuart Andrews, Ioannis Tsochantaridis, and Thomas Hofmann. 2003. Support vector machines for multiple-instance learning. In Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer (Eds.). MIT Press, Cambridge, MA, 577--584.
    [3]
    Forrest Briggs, Xiaoli Z Fern, and Raviv Raich. 2012. Rank-loss support instance machines for MIML instance annotation. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . Beijing, China, 534--542.
    [4]
    Ching-Hui Chen, Vishal M Patel, and Rama Chellappa. 2018. Learning from ambiguously labeled face images. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 40, 7 (2018), 1653--1667.
    [5]
    Yi-Chen Chen, Vishal M Patel, Rama Chellappa, and P Jonathon Phillips. 2014. Ambiguously labeled learning using dictionaries. IEEE Transactions on Information Forensics and Security, Vol. 9, 12 (2014), 2076--2088.
    [6]
    Timothee Cour, Benjamin Sapp, Chris Jordan, and Ben Taskar. 2009. Learning from ambiguously labeled images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL, 919--926.
    [7]
    Timothee Cour, Ben Sapp, and Ben Taskar. 2011. Learning from partial labels. Journal of Machine Learning Research, Vol. 12, May (2011), 1501--1536.
    [8]
    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Fei-Fei Li. 2009. Imagenet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL, 248--255.
    [9]
    Lei Feng and Bo An. 2018. Leveraging latent label distributions for partial Label Learning. In Proceedings of the 27th International Joint Conference on Artificial Intelligence . Stockholm, Sweden, 2107--2113.
    [10]
    Eva Gibaja and Sebastián Ventura. 2015. A tutorial on multilabel learning. Comput. Surveys, Vol. 47, 3 (2015), 52.
    [11]
    Chen Gong, Tongliang Liu, Yuanyan Tang, Jian Yang, Jie Yang, and Dacheng Tao. 2018. A regularization approach for instance-based superset label learning. IEEE Transactions on Cybernetics, Vol. 48, 3 (2018), 967--978.
    [12]
    Matthieu Guillaumin, Jakob Verbeek, and Cordelia Schmid. 2010. Multiple instance metric learning from automatically labeled bags of faces. In Lecture Notes in Computer Science 6311, K. Daniilidis, P. Maragos, and N. Paragios (Eds.). Springer, Berlin, 634--647.
    [13]
    Eyke Hüllermeier and Jürgen Beringer. 2006. Learning from ambiguously labeled examples. Intelligent Data Analysis, Vol. 10, 5 (2006), 419--439.
    [14]
    Takashi Ishida, Gang Niu, Weihua Hu, and Masashi Sugiyama. 2017. Learning from complementary labels. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 5639--5649.
    [15]
    Rong Jin and Zoubin Ghahramani. 2003. Learning with multiple labels. In Advances in Neural Information Processing Systems 15, S. Becker, S. Thrun, and K. Obermayer (Eds.). MIT Press, Cambridge, MA, 897--904.
    [16]
    Liping Liu and Thomas G Dietterich. 2012. A conditional multinomial mixture model for superset label learning. In Advances in Neural Information Processing Systems 25, P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger (Eds.). MIT Press, Cambridge, MA, 557--565.
    [17]
    Jie Luo and Francesco Orabona. 2010. Learning from candidate labeling sets. In Advances in Neural Information Processing Systems 23, J. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. S. Zemel, and A. Culotta (Eds.). MIT Press, Cambridge, MA, 1504--1512.
    [18]
    Nam Nguyen and Rich Caruana. 2008. Classification with partial labels. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Las Vegas, NV, 381--389.
    [19]
    Gabriel Panis, Andreas Lanitis, Nicholas Tsapatsoulis, and Timothy F Cootes. 2016. Overview of research on facial ageing using the FG-NET ageing database. IET Biometrics, Vol. 5, 2 (2016), 37--46.
    [20]
    George Papandreou, Liang-Chieh Chen, Kevin P Murphy, and Alan L Yuille. 2015. Weakly- and semi-supervised learning of a deep convolutional network for semantic image segmentation. In Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile, 1742--1750.
    [21]
    Grigorios Tsoumakas, Ioannis Katakis, and Ioannis Vlahavas. 2010. Mining multi-label data. In Data Mining and Knowledge Discovery Handbook. Springer, Berlin, 667--686.
    [22]
    Jing Wang and Min-Ling Zhang. 2018. Towards mitigating the class-imbalance problem for partial label learning. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . London, UK, 2427--2436.
    [23]
    Lichen Wang, Zhengming Ding, and Yun Fu. 2018. Adaptive graph guided embedding for multi-label annotation. In Proceedings of the 27th International Joint Conference on Artificial Intelligence . Stockholm, Sweden, 2798--2804.
    [24]
    Fei Yu and Min-Ling Zhang. 2017. Maximum margin partial label learning. Machine Learning, Vol. 106, 4 (2017), 573--593.
    [25]
    Zinan Zeng, Shijie Xiao, Kui Jia, Tsung-Han Chan, Shenghua Gao, Dong Xu, and Yi Ma. 2013. Learning by associating ambiguously labeled images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Portland, OR, 708--715.
    [26]
    Lefei Zhang, Qian Zhang, Bo Du, Jane You, and Dacheng Tao. 2017. Adaptive manifold regularized matrix factorization for data clustering. In Proceedings of the 26th International Joint Conference on Artificial Intelligence . Melbourne, Australia, 3399--3405.
    [27]
    Min-Ling Zhang and Fei Yu. 2015. Solving the partial label learning problem: An instance-based approach. In Proceedings of the 24th International Joint Conference on Artificial Intelligence . Buenos Aires, Argentina, 4048--4054.
    [28]
    Min-Ling Zhang, Bin-Bin Zhou, and Xu-Ying Liu. 2016. Partial label learning via feature-aware disambiguation. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . San Francisco, CA, 1335--1344.
    [29]
    Min-Ling Zhang and Zhi-Hua Zhou. 2014. A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering, Vol. 26, 8 (2014), 1819--1837.
    [30]
    Xiang Zhang, Junbo Zhao, and Yann LeCun. 2015. Character-level convolutional networks for text classification. In Advances in Neural Information Processing Systems 28, C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Eds.). Curran Associates, Inc., 649--657.
    [31]
    Zhi-Hua Zhou, Min-Ling Zhang, Sheng-Jun Huang, and Yu-Feng Li. 2012. Multi-instance multi-label learning. Artificial Intelligence, Vol. 176, 1 (2012), 2291--2320.
    [32]
    Xiaojin Zhu and Andrew B Goldberg. 2009. Introduction to semi-supervised learning. In Synthesis Lectures to Artificial Intelligence and Machine Learning, R. J. Brachman and T. G. Dietterich (Eds.). Morgan & Claypool Publishers, San Francisco, CA, 1--130.

    Cited By

    View all
    • (2024)PiCO+: Contrastive Label Disambiguation for Robust Partial Label LearningIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3342650(1-15)Online publication date: 2024
    • (2024)Partial Sequence Labeling With Structured Gaussian ProcessesIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.319172635:2(2783-2792)Online publication date: Mar-2024
    • (2024)Partial label feature selection based on noisy manifold and label distributionPattern Recognition10.1016/j.patcog.2024.110791156(110791)Online publication date: Dec-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
    July 2019
    3305 pages
    ISBN:9781450362016
    DOI:10.1145/3292500
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. adaptive graph
    2. disambiguation
    3. partial label learning

    Qualifiers

    • Research-article

    Funding Sources

    • National Science Foundation of China

    Conference

    KDD '19
    Sponsor:

    Acceptance Rates

    KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)90
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 26 Jul 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)PiCO+: Contrastive Label Disambiguation for Robust Partial Label LearningIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3342650(1-15)Online publication date: 2024
    • (2024)Partial Sequence Labeling With Structured Gaussian ProcessesIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.319172635:2(2783-2792)Online publication date: Mar-2024
    • (2024)Partial label feature selection based on noisy manifold and label distributionPattern Recognition10.1016/j.patcog.2024.110791156(110791)Online publication date: Dec-2024
    • (2024)Partial label learning via identifying outlier featuresKnowledge-Based Systems10.1016/j.knosys.2024.112278(112278)Online publication date: Jul-2024
    • (2024)Partial multi-label feature selection via low-rank and sparse factorization with manifold learningKnowledge-Based Systems10.1016/j.knosys.2024.111899(111899)Online publication date: May-2024
    • (2024)Partial label feature selection via label disambiguation and neighborhood mutual informationInformation Sciences10.1016/j.ins.2024.121163(121163)Online publication date: Jul-2024
    • (2024)Exploiting counter-examples for active learning with partial labelsMachine Learning10.1007/s10994-023-06485-9113:6(3849-3868)Online publication date: 8-Jan-2024
    • (2023)Semantic Dissimilarity Guided Locality Preserving Projections for Partial Label Dimensionality ReductionProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599496(964-973)Online publication date: 6-Aug-2023
    • (2023)A Unifying Probabilistic Framework for Partially Labeled Data LearningIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.3228755(1-12)Online publication date: 2023
    • (2023)Discriminative Metric Learning for Partial Label LearningIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2021.311836234:8(4428-4439)Online publication date: Aug-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media