Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2733373.2806329acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
short-paper

Exclusive Constrained Discriminative Learning for Weakly-Supervised Semantic Segmentation

Published: 13 October 2015 Publication History

Abstract

How to import image-level labels as weak supervision to direct the region-level labeling task is the core task of weakly-supervised semantic segmentation. In this paper, we focus on designing an effective but simple weakly-supervised constraint, and propose an exclusive constrained discriminative learning model for image semantic segmentation. To be specific, we employ a discriminative linear regression model to assign subsets of superpixels with different labels. During the assignment, we construct an exclusive weakly-supervised constraint term to suppress the labeling responses of each superpixel on the labels outside its parent image-level label set. Besides, a spectral smoothing term is integrated to encourage that both visually and semantically similar superpixels have similar labels. Combining these terms, we formulate the problem as a convex objective function, which can be easily optimized via alternative iterations. Extensive experiments on MSRC-21 and LabelMe datasets demonstrate the effectiveness of the proposed model.

References

[1]
R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk. Slic superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(11):2274--2282, 2012.
[2]
L. Ladicky, C. Russell, P. Kohli, and P. H. Torr. Associative hierarchical crfs for object class image segmentation. In ICCV, 2009, pages 739--746, 2009.
[3]
L.-J. Li, R. Socher, and L. Fei-Fei. Towards total scene understanding: Classification, annotation and segmentation in an automatic framework. In CVPR 2009., pages 2036--2043. IEEE, 2009.
[4]
Y. Li, J. Liu, Y. Wang, H. Lu, and S. Ma. Weakly supervised rbm for semantic segmentation. In IJCAI, pages 1888--1894, 2015.
[5]
C. Liu, J. Yuen, and A. Torralba. Nonparametric scene parsing: Label transfer via dense scene alignment. In CVPR 2009., pages 1972--1979. IEEE, 2009.
[6]
S. Liu, S. Yan, T. Zhang, C. Xu, J. Liu, and H. Lu. Weakly supervised graph propagation towards collective image parsing. IEEE Transactions on Multimedia., 14(2):361--373, 2012.
[7]
X. Liu, S. Yan, J. Luo, J. Tang, Z. Huango, and H. Jin. Nonparametric label-to-region by search. In CVPR, 2010, pages 3320--3327. IEEE, 2010.
[8]
Y. Liu, J. Liu, Z. Li, J. Tang, and H. Lu. Weakly-supervised dual clustering for image semantic segmentation. In CVPR, 2013, pages 2075--2082, 2013.
[9]
H. Myeong and K. M. Lee. Tensor-based high-order semantic relation transfer for semantic scene segmentation. In CVPR, pages 3073--3080, 2013.
[10]
S. Qiu, J. Cheng, X. Zhang, B. Niu, and H. Lu. Community discovering guided cold-start recommendation: A discriminative approach. In Multimedia and Expo (ICME), 2014 IEEE International Conference on, pages 1--6. IEEE, 2014.
[11]
J. Shotton, J. Winn, C. Rother, and A. Criminisi. Textonboost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In ECCV 2006, pages 1--15. 2006.
[12]
J. Shotton, J. Winn, C. Rother, and A. Criminisi. Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context. IJCV, 2009.
[13]
J. Tighe and S. Lazebnik. Superparsing: scalable nonparametric image parsing with superpixels. In ECCV 2010, pages 352--365. Springer, 2010.
[14]
J. Verbeek and B. Triggs. Region classification with markov field aspect models. In CVPR,2007, pages 1--8.
[15]
A. Vezhnevets and J. M. Buhmann. Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning. In CVPR, 2010, pages 3249--3256. IEEE, 2010.
[16]
A. Vezhnevets, V. Ferrari, and J. M. Buhmann. Weakly supervised semantic segmentation with a multi-image model. In ICCV, pages 643--650, 2011.
[17]
A. Vezhnevets, V. Ferrari, and J. M. Buhmann. Weakly supervised structured output learning for semantic segmentation. In CVPR, pages 845--852, 2012.

Cited By

View all
  • (2018)GraphNetProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240542(483-491)Online publication date: 15-Oct-2018

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '15: Proceedings of the 23rd ACM international conference on Multimedia
October 2015
1402 pages
ISBN:9781450334594
DOI:10.1145/2733373
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. semantic segmentation
  2. weak supervision

Qualifiers

  • Short-paper

Funding Sources

  • National Natural Science Foundation of China

Conference

MM '15
Sponsor:
MM '15: ACM Multimedia Conference
October 26 - 30, 2015
Brisbane, Australia

Acceptance Rates

MM '15 Paper Acceptance Rate 56 of 252 submissions, 22%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2018)GraphNetProceedings of the 26th ACM international conference on Multimedia10.1145/3240508.3240542(483-491)Online publication date: 15-Oct-2018

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media