Abstract
Tattooing portraits of loved ones is a popular form of love expression and tribute. Tattooing portraits is complicated and challenging because of detailed facial expressions and unique characters of each person. Currently, it is hard for clients to give clear instructions on tattoo designs to tattooists, because there is no effective way to see a portrait tattoo before putting it on the body. In this paper, an algorithm which transforms a given portrait photo to a portrait tattoo is proposed. It takes a portrait photo, a reference portrait tattoo image, a skin image and a set of parameters as inputs. The portrait photo is the person’s face whom the client wants to put on his/her skin. The reference portrait tattoo image is used to control the color and style of the synthetic portrait tattoo. The skin image is taken from the skin region where the client wants to tattoo. By adjusting the parameters, portrait tattoos with different characteristics can be generated. The proposed algorithm uses a series of tailor-made image processing methods and a digital tattoo needle model to perform digital tattooing on the skin image. Comparing with the state-of-the-art style transfer methods, the proposed algorithm produces more realistic portrait tattoos.
Similar content being viewed by others
References
Burger W, Burge J M (2010) Principles of Digital Image Processing Core Algorithms. Springer Science & Business Media, pp 110–111. ISBN 978-1-84800-195-4
Calmon J, Queiroz J, Goes C, Loula A (2015) Augmented tattoo: Evaluation of an augmented reality system for tattoo visualization. SIBGRAPI Conference on Graphics, Patterns and Images
Chen Z, Kin B, Ito D, Wang H (2015) Wetbrush: GPU-based 3D painting simulation at the bristle level. ACM Trans Graph 34:200–211
Chen T, Schmidt M (2016) Fast patch-based style transfer of arbitrary style. Workshop in Constructive Machine Learning, NIPS
Statista Research Department (2016) Share of Americans with one or more tattoos from 2003 to 2015 (by age group). http://tiny.cc/l2baaz
Deussen O, Spicker M, Zheng Q (2017) Weighted Linde-Buzo-Gray stippling. ACM Trans Graph 36:233–245
Di X, Patel VM (2016) Deep tattoo recognition. IEEE Conference on Computer Vision and Pattern Recognition Workshops
Edmonds L (2016) Tattooist Dave Stewart fined £300 for botched inking of marilyn monroe. http://tiny.cc/0xbaaz
Gatys L A, Ecker AS, Bethge M (2016) Image style transfer using convolutional neural networks. IEEE Conference on Computer Vision and Pattern Recognition
Goodfello I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Advances in Neural Information Processing Systems
Haddad A R, Akansu N A (1991) A class of fast gaussian binomial filters for speech and image processing. IEEE Trans Acoust Speech Signal Process 39:723–727
He K, Sun J, Tang X (2013) Guided image filtering. IEEE Trans Pattern Anal Mach Intell 35:1397–1409
Hsu R, Jain A K (2003) Generating discriminating cartoon faces using interacting snakes. IEEE Trans Pattern Anal Mach Intellx 25:1388–1398
Huang Y, Yu P, Xu X, Kong AWK (2015) The impact of tattoo segmentation on the performance of tattoo matching. IEEE International WIE Conference on Electrical and Computer Engineering
Huang X, Belongie SJ (2017) Arbitrary style transfer in real-time with adaptive instance normalization. IEEE International Conference on Computer Vision
Isola P, Zhu J Y, Zhou T, Efros AA (2017) Image-to-image translation with conditional adversarial networks. IEEE Conference on Computer Vision and Pattern Recognition
Johnson J, Alahi A, Li F (2016) Perceptual losses for real-time style transfer and super-resolution. European Conference on Computer Vision
Kin D, Son M, Lee Y, Kang H, Lee S (2008) Feature-guided image stippling. Comput Graph Forum 27:1209–1216
Larry L, Shannon-Missal LL (2016) Tattoo takeover: Three in ten Americans have tattoos, and most don’t stop at just one. http://tiny.cc/xwbaaz
Laumann A E, Derick A J (2006) Tattoos and body piercings in the united states: a national data set. J Am Acad Dermatol 55:413–421
Lee J E, Jain A K, Jin R (2008) Scars, marks and tattoos (SMT): Soft biometric for suspect and victim identification. Biometrics Symposium
Lee J, Jin R, Jain A K, Tong W (2012) Image retrieval in forensics: Tattoo image database application. IEEE MultiMedia 19:40–49
Lu J, Barnes Cm DiVerdi S, Finkelstein A (2013) Realbrush: Painting with examples of physical media. ACM Trans Graph 32:117–129
Lunapic (2018) Use Lunapic.com to tattoo an image instantly. https://www194.lunapic.com/editor/?action=tattoo/
Maurer C R, Qi R, Raghavan V (2003) A linear time algorithm for computing exact euclidean distance transforms of binary images in arbitrary dimensions. IEEE Trans Pattern Anal Mach Intell 25:265–270
Mauricio G, Bonelli J, Chagas M (2015) TattooAR: Augmented reality interactive tattoos. International Conference of Design, User Experience, and Usability
Newson A, Delon J, Galerne B (2017) A stochastic film grain model for resolution-independent rendering. Comput Graph Forum 36:684–699
Nirkin Y, Masi I, Tran A, Hassner T, Medioni G (2018) On face segmentation, face swapping, and face perception. IEEE International Conference on Automatic Face & Gesture Recognition
Parker RJ (1997) Algorithms for image processing and computer vision. Wiley, New York, pp 23–29
PhotoFunia (2018) Making tattoo. https://photofunia.com/effects/making_tattoo/
Proud A (2015) We’re not going to reach ’peak tattoo’ until 2025. https://bit.ly/2xZ1IJ3
Radford A, Metz l, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. International Conference on Learning Representations
Selim A, Elgharib M, Doyle L (2016) Painting style transfer for head portraits using convolutional neural networks. ACM Trans Graph 35:129–147
Shahrian E, Rajan D, Price B, Cohen S (2013) Improving image matting using comprehensive sampling sets. IEEE Conference on Computer Vision and Pattern Recognition
Smith A (2015) 7 most frequently asked questions from tattoo removal patients. http://tiny.cc/yzbaaz
Sullivan R (2017) Tattoo laser removal: Queensland man suffers serious burns after trying to get his tattoos removed. https://bit.ly/2Z8UmyW
Taigman Y, Polyak A, Wolf L (2016) Unsupervised cross-domain image generation. International Conference on Learning Representations
Tuur S, Fang D, Sunil H, Philip D (2016) Real-time oil painting on mobile hardware. Comput Graph Forum 36:69–79
Venkatanath N, Praneeth D, Chandrasekhar M Bh, Channappayya S S, Medasani S S (2015) Blind Image Quality Evaluation Using Perception Based Features. Inproceedings of the 21st National Conference on Communications (NCC)
Baxter W (2004) Physically-based modeling techniques for interactive digital painting. Ph.D. thesis
Winnemöller H, Kyprianidis J, Olsen S C (2012) XDOg: An extended Difference-of-Gaussians compendium including advanced image stylization. Comput Graph 36:740–753
Xia Y, Wu J, Gao P, Lin Y, Mao T (2013) Ontology-based model for Chinese calligraphy synthesis. Comput Graph Forum 32:11–20
Zhang Y, Dong W, Ma C, Mei X, Li K, Huang F, Hu B G, Deussen O (2017) Data-driven synthesis of cartoon faces using different styles. IEEE Trans Image Process 26:464–478
Zhu J Y, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. IEEE International Conference on Computer Vision
Acknowledgments
This work is partially supported by the Ministry of Education, Singapore through Academic Research Fund Tier 1, RG30/17 (S).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xu, X., Matkowski, W.M. & Kong, A.W.K. A portrait photo-to-tattoo transform based on digital tattooing. Multimed Tools Appl 79, 24367–24392 (2020). https://doi.org/10.1007/s11042-020-09101-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-09101-3