A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
Article No.: 1, Pages 1 - 19
Abstract
We present a method for example-based texturing of triangular 3D meshes. Our algorithm maps a small 2D texture sample onto objects of arbitrary size in a seamless fashion, with no visible repetitions and low overall distortion. It requires minimal user interaction and can be applied to complex, multi-layered input materials that are not required to be tileable. Our framework integrates a patch-based approach with per-pixel compositing. To minimize visual artifacts, we run a three-level optimization that starts with a rigid alignment of texture patches (macro scale), then continues with non-rigid adjustments (meso scale) and finally performs pixel-level texture blending (micro scale). We demonstrate that the relevance of the three levels depends on the texture content and type (stochastic, structured, or anisotropic textures).
Supplementary Material
Supplemental movie, appendix, image and software files for, A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
- Download
- 192.86 MB
References
[1]
Paul J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb. 1992), 239--256.
[2]
David Bommes, Marcel Campen, Hans-Christian Ebke, Pierre Alliez, and Leif Kobbelt. 2013. Integer-grid maps for reliable quad meshing. ACM Transactions on Graphics (TOG) 32, 4 (2013), 98.
[3]
David Bommes, Henrik Zimmer, and Leif Kobbelt. 2009. Mixed-integer Quadrangulation. ACM Trans. Graph. 28, 3, Article 77 (July 2009), 10 pages.
[4]
David Bommes, Henrik Zimmer, and Leif Kobbelt. 2010. Practical mixed-integer optimization for geometry processing. In International Conference on Curves and Surfaces. Springer, 193--206.
[5]
Brent Burley. 2019. On Histogram-Preserving Blending for Randomized Texture Tiling. Journal of Computer Graphics Techniques (JCGT) 8, 4 (8 November 2019), 31--53.
[6]
Marcel Campen, David Bommes, and Leif Kobbelt. 2015. Quantized global parametrization. ACM Transactions on Graphics (TOG) 34, 6 (2015), 192.
[7]
Thomas Deliot and Eric Heitz. 2019. Procedural Stochastic Textures by Tiling and Blending. In GPU Zen 2: Advanced Rendering Techniques, W. Engel (Ed.). Black Cat Publishing Inc., 144 West D Street Suite 204, Encinitas, CA 92009, Chapter 2 in Part IV, 177--200.
[8]
Yue Dong, Sylvain Lefebvre, Xin Tong, and George Drettakis. 2008. Lazy Solid Texture Synthesis. In Proceedings of the Nineteenth Eurographics Conference on Rendering (EGSR '08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 1165--1174.
[9]
Qiang. Du, Vance. Faber, and Max. Gunzburger. 1999. Centroidal Voronoi Tessellations: Applications and Algorithms. SIAM Rev. 41, 4 (1999), 637--676.
[10]
Jérémie Dumas, An Lu, Sylvain Lefebvre, Jun Wu, and Christian Dick. 2015. By-example Synthesis of Structurally Sound Patterns. ACM Trans. Graph. 34, 4, Article 137 (July 2015), 12 pages.
[11]
Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 341--346.
[12]
Alexei A. Efros and Thomas K. Leung. 1999. Texture Synthesis by Non-Parametric Sampling. In Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2 (ICCV '99). IEEE Computer Society, Washington, DC, USA, 1033-.
[13]
Martin A. Fischler and Robert C. Bolles. 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 6 (June 1981), 381--395.
[14]
Bruno Galerne, Ares Lagae, Sylvain Lefebvre, and George Drettakis. 2012. Gabor noise by example. ACM Transactions on Graphics (TOG) 31, 4 (2012), 73.
[15]
Leon Gatys, Alexander S Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. In Advances in neural information processing systems. 262--270.
[16]
Guillaume Gilet, Basile Sauvage, Kenneth Vanhoey, Jean-Michel Dischler, and Djamchid Ghazanfarpour. 2014. Local random-phase noise for procedural texturing. ACM Transactions on Graphics (TOG) 33, 6 (2014), 195.
[17]
Gabriele Gorla, Victoria Interrante, and Guillermo Sapiro. 2001. Growing fitted textures. SIGGRAPH 2001 Sketches and Applications (2001), 191.
[18]
Gael Guennebaud, Benoît Jacob, et al. 2010. Eigen v3. http://eigen.tuxfamily.org.
[19]
Jianwei Han, Kun Zhou, Li-Yi Wei, Minmin Gong, Hujun Bao, Xinming Zhang, and Baining Guo. 2006. Fast example-based surface texture synthesis via discrete optimization. The Visual Computer 22, 9-11 (2006), 918--925.
[20]
Christopher G Harris, Mike Stephens, et al. 1988. A combined corner and edge detector. In Alvey vision conference, Vol. 15. Citeseer, 10--5244.
[21]
David J. Heeger and James R. Bergen. 1995. Pyramid-based Texture Analysis/Synthesis. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). ACM, New York, NY, USA, 229--238.
[22]
Eric Heitz and Fabrice Neyret. 2018. High-Performance By-Example Noise Using a Histogram-Preserving Blending Operator. Proc. ACM Comput. Graph. Interact. Tech. 1, 2, Article 31 (Aug. 2018), 25 pages.
[23]
Alec Jacobson, Daniele Panozzo, et al. 2018. libigl: A simple C++ geometry processing library. https://libigl.github.io/.
[24]
Nikolay Jetchev, Urs Bergmann, and Roland Vollgraf. 2016. Texture synthesis with spatial generative adversarial networks. arXiv preprint arXiv:1611.08207 (2016).
[25]
Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. 2006. Drag-and-drop Pasting. ACM Trans. Graph. 25, 3 (July 2006), 631--637.
[26]
Johannes Kopf, Chi-Wing Fu, Daniel Cohen-Or, Oliver Deussen, Dani Lischinski, and Tien-Tsin Wong. 2007. Solid Texture Synthesis from 2D Exemplars. ACM Trans. Graph. 26, 3, Article 2 (July 2007).
[27]
Vivek Kwatra, Arno Schödl, Irfan Essa, Greg Turk, and Aaron Bobick. 2003. Graphcut textures: image and video synthesis using graph cuts. In ACM Transactions on Graphics (ToG), Vol. 22. ACM, 277--286.
[28]
Ares Lagae, Peter Vangorp, Toon Lenaerts, and Philip Dutré. 2010. Procedural Isotropic Stochastic Textures by Example. Computers & Graphics (Special issue on Procedural Methods in Computer Graphics) 34, 4 (2010), 312--321.
[29]
Anass Lasram and Sylvain Lefebvre. 2012. Parallel Patch-based Texture Synthesis. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics Conference on High-Performance Graphics (EGGH-HPG'12). Eurographics Association, Goslar Germany, Germany, 115--124.
[30]
Sylvain Lefebvre and Hugues Hoppe. 2005. Parallel Controllable Texture Synthesis. In ACM SIGGRAPH 2005 Papers (SIGGRAPH '05). ACM, New York, NY, USA, 777--786.
[31]
Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space Texture Synthesis. In ACM SIGGRAPH 2006 Papers (SIGGRAPH '06). ACM, New York, NY, USA, 541--548.
[32]
Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. ACM Trans. Graph. 21, 3 (July 2002), 362--371.
[33]
Andrew Nealen and Marc Alexa. 2003. Hybrid Texture Synthesis. In Proceedings of the 14th Eurographics Workshop on Rendering (EGRW '03). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 97--105.
[34]
Marcin Novotni, Reinhard Klein, et al. 2002. Computing geodesic distances on triangular meshes. In In Proc. of WSCG'2002.
[35]
Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson Image Editing. ACM Trans. Graph. 22, 3 (July 2003), 313--318.
[36]
Ken Perlin. 1985. An image synthesizer. ACM Siggraph Computer Graphics 19, 3 (1985), 287--296.
[37]
Nico Pietroni, Paolo Cignoni, Miguel Otaduy, and Roberto Scopigno. 2010. Solid-texture synthesis: a survey. IEEE Computer Graphics and Applications 30, 4 (2010), 74--89.
[38]
Javier Portilla and Eero P. Simoncelli. 2000. A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients. International Journal of Computer Vision 40, 1 (01 Oct 2000), 49--70.
[39]
Emil Praun, Adam Finkelstein, and Hugues Hoppe. 2000. Lapped Textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 465--470.
[40]
Michael Rabinovich, Roi Poranne, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Scalable Locally Injective Mappings. ACM Trans. Graph. 36, 4, Article 37a (April 2017).
[41]
Ryan Schmidt, Cindy Grimm, and Brian Wyvill. 2006. Interactive Decal Compositing with Discrete Exponential Maps. ACM Trans. Graph. 25, 3 (July 2006), 605--613.
[42]
Stanford. 2020. The Stanford 3D Scanning Repository. http://www-graphics.stanford.edu/data/3Dscanrep/. Accessed: 2020-03-13.
[43]
Textures.com. 2020. Textures for 3D, graphic design and Photoshop. https://www.textures.com/. Accessed: 2019-12--12.
[44]
Thingiverse. 2011a. Ghost Model by navalguijo on Thingiverse. https://www.thingiverse.com/thing:12585 Accessed March 17, 2020.
[45]
Thingiverse. 2011b. Part of Sesame Street Sign Model by cptnAWESOME on Thingiverse. https://www.thingiverse.com/thing:14974 Accessed March 17, 2020.
[46]
Thingiverse. 2012. Anvil Model by WorksBySolo on Thingiverse. https://www.thingiverse.com/thing:31397 Accessed March 17, 2020.
[47]
Thingiverse. 2015. Metatron/Entangled Model by bathsheba on Thingiverse. https://www.thingiverse.com/thing:1146870 Accessed March 17, 2020.
[48]
Xin Tong, Jingdan Zhang, Ligang Liu, Xi Wang, Baining Guo, and Heung-Yeung Shum. 2002. Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces. ACM Trans. Graph. 21, 3 (July 2002), 665--672.
[49]
Greg Turk. 2001. Texture Synthesis on Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 347--354.
[50]
Dmitry Ulyanov, Vadim Lebedev, Andrea Vedaldi, and Victor S Lempitsky. 2016. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. In ICML, Vol. 1. 4.
[51]
Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the art in example-based texture synthesis.
[52]
Li-Yi Wei and Marc Levoy. 2000. Fast Texture Synthesis Using Tree-structured Vector Quantization. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 479--488.
[53]
Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 355--360.
[54]
Jingdan Zhang, Kun Zhou, Luiz Velho, Baining Guo, Heung-Yeung Shum, Heung-Yeung Shum, and Heung-Yeung Shum. 2003. Synthesis of Progressively-variant Textures on Arbitrary Surfaces. ACM Trans. Graph. 22, 3 (July 2003), 295--302.
Index Terms
- A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
Recommendations
Texture synthesis on surfaces
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesMany natural and man-made surface patterns are created by interactions between texture elements and surface geometry. We believe that the best way to create such patterns is to synthesize a texture directly on the surface of the model. Given a texture ...
Synthesis of progressively-variant textures on arbitrary surfaces
SIGGRAPH '03: ACM SIGGRAPH 2003 PapersWe present an approach for decorating surfaces with progressively-variant textures. Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of ...
Synthesis of progressively-variant textures on arbitrary surfaces
We present an approach for decorating surfaces with progressively-variant textures. Unlike a homogeneous texture, a progressively-variant texture can model local texture variations, including the scale, orientation, color, and shape variations of ...
Comments
Information & Contributors
Information
Published In
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 May 2020
Published in PACMCGIT Volume 3, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Funding Sources
- German Federal Ministry of Education and Research
- Governmental District Cologne
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 446Total Downloads
- Downloads (Last 12 months)37
- Downloads (Last 6 weeks)2
Reflects downloads up to 02 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in