Abstract
Traditional image matting methods often have strict requirements on user input. This paper proposes a new matting method based on spectral clustering, which generates a well matte using a sparse user input. Firstly, connected components are obtained using spectral clustering, which actually utilizes a linear transformation of the smallest eigenvectors of the matting Laplacian matrix. An accurate trimap is obtained via user input and threshold segmentation. Secondly, sample sets are gathered by two-level hierarchical clustering and Fast Approximate Nearest Neighbors algorithm and unknown pixels are evaluated by the samples. Finally, an optimal matte is obtained by constructing an energy function with local smoothness constraint. Experiments show that the proposed method outperforms most of the state-of-the-art methods with a sparse user input and our method has fewer requirements to get a robust matte.
Similar content being viewed by others
References
Chen Q, Li D, Tang C (2012) KNN matting. CVPR, 2175–2188
Chen X, Zou D, Tan P (2013) Image matting with local and nonlocal smooth priors, CVPR, 1902–1907
Chuang Y-Y, Curless B, Salesin DH, Szeliski R (2001) A Bayesian approach to digital matting. In Proc. 2001 I.E. Computer Society Conf. Computer Vision and Pattern Recognition. 2:II-264–271
Gastal ESL, Oliveira MM (2010) Shared sampling for real-time alpha matting. Eurographics, pp 575–584
Grady L, Schiwietz T, Aharon S (2005) Random walks for interactive alpha-matting. VIIP, pp 423–429
Guan Y, Chen W, Liang X, Ding Z, Peng Q (2006) Easy matting–a stroke based approach for continuous image matting. Computer Graphics Forum 25(3):567–576
He K, Sun J, Tang X (2010) Fast matting using large kernel matting Laplacian matrices, CVPR, pp 2165–2172
He K, Rhemann C, Rother C, Tang X, Sun J (2011) A global sampling method for alpha matting. In Proc. 2011 I.E. Conf. Computer Vision and Pattern Recognition, pp 2049–2056
He B, Wang G, Ruan Z, Yin X, Pei X, Lin X (2012) Local matting based on sample-pair propagation and iterative refinement, ICIP, pp 285–288
He B, Wang G, Shi C, Yin X, Liu B, Lin X (2013) Iterative transductive learning for alpha matting. ICIP, 4282–4286
Johnson J, Rajan D, Cholakkal H (2014) Sparse codes as alpha mattes, BMVC
Kim B-K, Jin M, Song W-J (2014) Local and nonlocal color line models for image matting. IEICE Trans Fundam Electron Commun Comput Sci E97-A(8):1814–1819
Lee P, Wu Y (2011) Nonlocal matting. In Proc. 201 1 I.E. Conf. Computer Vision and Pattern Recognition, pp 2193–2200
Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Analysis and Machine Intelligence 30(2):228–242
Levin A, Rav Acha A, Lischinski D (2008) Spectral matting. IEEE Trans Pattern Analysis and Machine Intelligence 30(10):1699–1712
Muja M, Lowe D (2009) Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP, pp 331–340
Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. In: Advances in neural information processing systems, MIT Press, Cambridge, pp 849–856
Rhemann C, Rother C, Gelautz M (2008) Improving color modeling for alpha matting. BMVC, pp 115.1–115.10
Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P (2009) A perceptually motivated online benchmark for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR ‘09), Miami, 20–25 June 2009, 8 p
Rhemann C, Rother C, Kohli P, Gelautz M (2010) A spatially varying PSF-based prior for alpha matting. CVPR, pp 2149–2156
Shahrian E, Rajan D, Price B, et al (2013) Improving image matting using comprehensive sampling sets. In Proc. 2013 I.E. Conf. Computer Vision and Pattern Recognition
Sun J, Jia J, Tang C-K, Shum H-Y (2004) Poisson matting. In Proc. ACM SIGGRAPH 23(3):315–321
Tseng C, Wang S (2012) A cell-based matting Laplacian for contrast enhancement. ICIP, pp 945–948
Wang J, Cohen M (2007) Optimized color sampling for robust matting. In Proc. 2007 I.E. Conf. Computer Vision and Pattern Recognition, pp 1–8
Wang J, Cohen MF (2008) Image and video matting: a survey. 3(2). Now Publishers Inc.
Xiang S, Nie F, Zhang C (2010) Semi-supervised classification via local spline regression. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(11):2039–2053
Zhang Z, Zhu Q, Xie Y (2012) Learning based alpha matting using support vector regression, ICIP, 2109–2122
Zheng Y, Kambhamettu C, Zheng Y, Kambhamettu C (2009) Learning based digital matting. ICCV, pp 889–896
Acknowledgments
This paper is supported by “the Fundamental Research Funds for the Central Universities” and “the Science and Technology Planning Project of Hunan Province (2014WK3002)”.
This work was partly supported by the National Science Foundation of China under grant No. 61262033,61262009; the Natural Science Foundation of Jiangxi Province, China under grant No. 20142BAB207009; the Science Foundation of Jiangxi Provincial Department of Education, China under grant No. GJJ13303.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tan, G., Chen, H. & Qi, J. A novel image matting method using sparse manual clicks. Multimed Tools Appl 75, 10213–10225 (2016). https://doi.org/10.1007/s11042-015-3160-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-3160-x