Abstract
Previous gradient mesh recoloring methods usually have dependencies on an additional reference image and the rasterized gradient mesh. To circumvent such dependencies, we propose a user scribble-based recoloring method, in which users are allowed to annotate gradient meshes with a few color scribbles. Our approach builds an auxiliary mesh from gradient meshes, namely control net, by taking both colors and local color gradients at mesh points into account. We then develop an extended chrominance blending method to propagate the user specified colors over the control net. The recolored gradient mesh is finally reconstructed from the recolored control net. Experiments validate the effectiveness of our approach on multiple gradient meshes. Compared with various alternative solutions, our method has no color bleedings nor sampling artifacts, and can achieve fast performance.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abadpour A, Kasaei S (2007) An efficient pca-based color transfer method. J Vis Commun Image Represent 18(1):15-34
An X, Pellacini F (2010) User-controllable color transfer. Comput Graphics Forum 29(2):263-271
Drew MS, Finlayson GD (2008) Realistic colorization via the structure tensor 15th IEEE international conference on image processing, pp 457-460
Ferguson J (1964) Multivariable curve interpolation. J ACM 11(2):221-228
Forrest W (2014) http://www.wizard2.com/
Highside (2009) http://homepage3.nifty.com/highside/
Horiuchi T, Kotera H (2005) Colorization for monochrome image with texture Color imaging conference, pp 245-250
Huang Y-C, Tung Y-S, Chen J-C, Wang S-W, Wu J-L (2005) An adaptive edge detection based colorization algorithm and its applications. ACM, New York, pp 351-354
Irony R, Cohen-Or D, Lischinski D (2005) Colorization by example Rendering techniques, pp 201-210
Kawulok M, Kawulok J, Smolka B (2011) Textural features for scribble-based image colorization. Comput Recognit Syst 4(95):269-278
Kawulok M, Smolka B (2010) Competitive image colorisation Proceedings of 17th international conference on image processing, pp 405-408
Lai Y-K, Hu S-M, Martin RR (2009) Automatic and topology-preserving gradient mesh generation for image vectorization. ACM Trans Graph 28(3):1-8
Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. ACM Trans Graph 23(3):689-694
Liu X-P, Wan L, Qu Y-G, Wong T-T, Lin S, Leung C-S, Heng P-A (2008) Intrinsic colorization. ACM Trans Graph 27(5):1-9
Luan Q, Wen F, Cohen-Or D, Liang L, Xu Y-Q, Shum H-Y (2007) Natural image colorization Rendering techniques 2007 (Proceedings Eurographics Symposium on Rendering). Eurographics
Miao Z, Zhang Y, Zheng Z, Sun Z (2016) Image palette: painting style transfer via brushstroke control synthesis. Multimedia Tools and Applications, pp 1-22
Morisaki T (2014) http://www.real-trace.com/
Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34-41
Sapiro G (2005) Inpainting the colors Proceedings of IEEE international conference on image processing, vol 2, pp 698-701
Seo S, Park YS, Ostromoukhov V (2013) Image recoloring using linear template mapping. Multimed Tool Appl 64(2):293-308
Su Z, Deng D, Yang X, Luo X (2012) Color transfer based on multiscale gradient-aware decomposition and color distribution mapping Proceedings of the 20th ACM international conference on Multimedia, MM '12. ACM, New York, pp 753-756
Su Z, Zeng K, Liu L, Li B, Luo X (2014) Corruptive artifacts suppression for example-based color transfer. IEEE Trans Multimedia 16(4):988-999
Sun J, Liang L, Wen F, Shum H-Y (2007) Image vectorization using optimized gradient meshes. ACM Trans Graph 26(3):11
Tai Y-W, Jia J-Y, Tang C-K (2005) Local color transfer via probabilistic segmentation by expectation-maximization Proceedings of the 2005 IEEE conference on computer vision and pattern recognition, volume 1, pp 747-754, Washington, DC, USA
Wen C-L, Hsieh C-H, Chen B-Y, Ouhyoung M (2008) Example-based multiple local color transfer by strokes. Comput Graphics Forum 27(7):1765-1772
Xiao Y, Wan L, Leung C-S, Lai Y-K, Wong T-T (2013) Example-based color transfer for gradient meshes. IEEE Trans Multimedia 15(3):549-560
Xiao Y, Wan L, Leung C-S, Lai Y-K, Wong T-T (2015) Optimization-based gradient mesh colour transfer. Comput Graphics Forum 34(6):123-134
Yang Y, Zhao H, You L, Tu R, Wu X, Jin X (2015) Semantic portrait color transfer with internet images. Multimedia Tools and Applications, pp 1-19
Yao C, Yang X, Chen L, Xu Y (2011) Image colorization using bayesian nonlocal inference. J Electron Imaging 20(2):023008-1-023008-6
Yatziv L, Sapiro G (2006) Fast image and video colorization using chrominance blending. IEEE Trans Image Process 15(5):1120-1129
Acknowledgement
The authors want to thank the reviewers for their valuable suggestions. The work is supported by NSFC from PRC (Project Num.:61572354, 61502158), GRF from Hong Kong (Project Num.:CityU 11259516), Fundamental Research Funds for the Central Universities (Project Num.:531107040842), and Hunan NSF (Project Num.:2017JJ3042).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wan, L., Xiao, Y., Dou, N. et al. Scribble-based gradient mesh recoloring. Multimed Tools Appl 77, 13753–13771 (2018). https://doi.org/10.1007/s11042-017-4987-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4987-0