Abstract
For multi-label image classification, we use active learning to select example-label pairs to acquire labels from experts. The core of active learning is to select the most informative examples to request their labels. Most previous studies in active learning for multi-label classification have two shortcomings. One is that they didn’t pay enough attention on label correlations. The other shortcoming is that existing example-label selection methods predict all the rest labels of the selected example-label pair. This leads to a bad performance for classification when the number of the labels is large. In this paper, we propose a semi-automatic labeling multi-label active learning (SLMAL) algorithm. Firstly, SLMAL integrates uncertainty and label informativeness to select example-label pairs to request labels. Then we choose the most uncertain example-label pair and predict its partial labels using its nearest neighbor. Our empirical results demonstrate that our proposed method SLMAL outperforms the state-of-the-art active learning methods for multi-label classification. It significantly reduces the labeling workloads and improves the performance of a classifier built.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., et al.: Mulan: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)
Tsoumakas, G., Katakis, I.: Multi-label classification: an overview. Int. J. Data Warehouse. Min. 3(3), 1–13 (2007)
Agrawal, R., Gupta, A., Prabhu, Y., et al.: Multi-label learning with millions of labels: recommending advertiser bid phrases for web pages. In: Proceedings of the 22nd International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, pp. 13–24 (2013)
Zhang, M., Zhou, Z.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2013)
Settles, B.: Active learning literature survey. Computer science technical report 1648, University of Wisconsin-Madison, USA (2010)
Holub, A., Perona, P., Burl, M.C.: Entropy-based active learning for object recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2008)
Luo, T., Kramer, K., Goldgof, D.B., Hall, L.O., et al.: Active learning to recognize multiple types of plankton. In: Proceedings of the International Conference on Pattern Recognition (ICPR), vol. 3, pp. 478–481 (2004)
Vijayanarasimhan, S., Jain, P., Grauman, K.: Far-sighted active learning on a budget for image and video recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3035–3042 (2010)
Tsoumakas, G., Zhang, M.L., Zhou, Z.H.: Introduction to the special issue on learning from multi-label data. Mach. Learn. 88(1–2), 1–4 (2012)
Li, X., Wang, L., Sung, E.: Multilabel SVM active learning for image classification. In: Proceedings of the International Conference on Image Processing (ICIP), vol. 4, pp. 2207–2210 (2004)
Li, X., Guo, Y.: Active learning with multi-label SVM classification. In: Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 1479–1485 (2013)
Vasisht, D., Damianou, A., Varma, M., et al.: Active learning for sparse bayesian multilabel classification. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 472–481. ACM (2014)
Qi, G.-J., Hua, X.-S., Rui, Y., Tang, J., Zhang, H.-J.: Two-dimensional active learning for image classification. In: Proceedings of the IEEE International Conference on Computer Vision (CVPR), pp. 1–8 (2008)
Qi, G.J., Hua, X.S., Rui, Y., Tang, J.H., Zhang, H.J.: Two-dimensional multilabel active learning with an efficient online adaptation model for image classification. IEEE Trans. Pattern Anal. Mach. Intell. 31(10), 1880–1897 (2009)
Zhang, B., Wang, Y., Wang, W.: Batch mode active learning for multi-label image classification with informative label correlation mining. In: Proceedings of the IEEE Workshop on Applications of Computer Vision (WACV) (2012)
Vasisht, D., Damianou, A., Varma, M., et al.: Active learning for sparse bayesian multilabel classification. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pp. 472–481 (2014)
Wu, J., Sheng, V.S., Zhang, J., Zhao, P., Cui, Z.: Multi-label active learning for image classification. In: Proceedings of the 21st International Conference on Image Processing (ICIP), pp. 5227–5231 (2014)
Acknowledgement
This research was partially supported by the Natural Science Foundation of China under grant No. 61170020, 61402311 and 61440053, Jiangsu Province Colleges and Universities Natural Science Research Project under grant No. 13KJB520021, and the U.S. National Science Foundation (IIS-1115417).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wu, J., Ye, C., Sheng, V.S., Yao, Y., Zhao, P., Cui, Z. (2015). Semi-automatic Labeling with Active Learning for Multi-label Image Classification. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9314. Springer, Cham. https://doi.org/10.1007/978-3-319-24075-6_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-24075-6_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24074-9
Online ISBN: 978-3-319-24075-6
eBook Packages: Computer ScienceComputer Science (R0)