research-article

Clustered vector textures

Authors:

Matthias ZwickerAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 41, Issue 4

Article No.: 159, Pages 1 - 23

https://doi.org/10.1145/3528223.3530062

Published: 22 July 2022 Publication History

Abstract

Repetitive vector patterns are common in a variety of applications but can be challenging and tedious to create. Existing automatic synthesis methods target relatively simple, unstructured patterns such as discrete elements and continuous Bézier curves. This paper proposes an algorithm for generating vector patterns with diverse shapes and structured local interactions via a sample-based representation. Our main idea is adding explicit clustering as part of neighborhood similarity and iterative sample optimization for more robust sample synthesis and pattern reconstruction. The results indicate that our method can outperform existing methods on synthesizing a variety of structured vector textures. Our project page is available at https://phtu-cs.github.io/cvt-sig22/.

Supplemental Material

MP4 File

supplemental material

Download
149.50 MB

MP4 File

presentation

Download
140.44 MB

SRT File

presentation

Download
24.67 KB

ZIP File

supplemental material

Download
24.62 MB

References

[1]

Pascal Barla, Simon Breslav, Joëlle Thollot, François Sillion, and Lee Markosian. 2006. Stroke pattern analysis and synthesis. In Computer Graphics Forum, Vol. 25. Wiley Online Library, 663--671.

[2]

Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Trans. Graph. 28, 3, Article 24 (July 2009), 11 pages.

Digital Library

[3]

Connelly Barnes and Fang-Lue Zhang. 2017. A survey of the state-of-the-art in patch-based synthesis. Computational Visual Media 3, 1 (2017), 3--20.

[4]

Serge Belongie, Jitendra Malik, and Jan Puzicha. 2001. Shape context: A new descriptor for shape matching and object recognition. In Advances in neural information processing systems. 831--837.

[5]

Robert L Cook. 1986. Stochastic sampling in computer graphics. ACM Transactions on Graphics (TOG) 5, 1 (1986), 51--72.

Digital Library

[6]

Jean-Dominique Favreau, Florent Lafarge, and Adrien Bousseau. 2017. Photo2clipart: Image Abstraction and Vectorization Using Layered Linear Gradients. ACM Trans. Graph. 36, 6, Article 180 (Nov. 2017), 11 pages.

Digital Library

[7]

Noa Fish, Lilach Perry, Amit Bermano, and Daniel Cohen-Or. 2020. SketchPatch: Sketch Stylization via Seamless Patch-level Synthesis. ACM Trans. Graph. 39, 6, Article 227 (12 2020).

Digital Library

[8]

Jakub Fišer, Ondřej Jamriška, Michal Lukáč, Eli Shechtman, Paul Asente, Jingwan Lu, and Daniel Sýkora. 2016. StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings. ACM Trans. Graph. 35, 4, Article 92 (July 2016), 11 pages.

Digital Library

[9]

Guojun Gan, Chaoqun Ma, and Jianhong Wu. 2020. Data clustering: theory, algorithms, and applications. SIAM.

[10]

Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, and Stefano Saliceti. 2021. Computer-Aided Design as Language. arXiv:cs.CV/2105.02769

[11]

Lena Gieseke, Paul Asente, Radomir Mech, Bedrich Benes, and Martin Fuchs. 2021. A Survey of Control Mechanisms for Creative Pattern Generation. Computer Graphics Forum (2021).

[12]

Pascal Guehl, Rémi Allegre, J-M Dischler, Bedrich Benes, and Eric Galin. 2020. Semi-Procedural Textures Using Point Process Texture Basis Functions. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 159--171.

[13]

Paul Guerrero, Gilbert Bernstein, Wilmot Li, and Niloy J. Mitra. 2016. PATEX: Exploring Pattern Variations. ACM Trans. Graph. 35, 4, Article 48 (July 2016), 13 pages.

Digital Library

[14]

Jianwei Guo, Haiyong Jiang, Bedrich Benes, Oliver Deussen, Xiaopeng Zhang, Dani Lischinski, and Hui Huang. 2020. Inverse Procedural Modeling of Branching Structures by Inferring L-Systems. ACM Trans. Graph. 39, 5, Article 155 (June 2020), 13 pages.

Digital Library

[15]

Alejo Hausner. 2001. Simulating Decorative Mosaics. In SIGGRAPH '01. 573--580.

Digital Library

[16]

Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, and David H. Salesin. 2001. Image Analogies. In SIGGRAPH '01. Association for Computing Machinery, New York, NY, USA, 327--340.

Digital Library

[17]

Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2018. Brushing Element Fields. In SIGGRAPH Asia 2018 Technical Briefs (SA '18). Article 6, 4 pages.

Digital Library

[18]

Chen-Yuan Hsu, Li-Yi Wei, Lihua You, and Jian Jun Zhang. 2020. Autocomplete Element Fields. In CHI '20. 1--13.

Digital Library

[19]

Siu Chi Hsu and Irene H. H. Lee. 1994. Drawing and Animation Using Skeletal Strokes. In SIGGRAPH '94. 109--118.

Digital Library

[20]

Hao-Da Huang, Xin Tong, and Wen-Cheng Wang. 2007. Accelerated parallel texture optimization. Journal of Computer Science and Technology 22, 5 (2007), 761--769.

Digital Library

[21]

T. Hurtut, P.-E. Landes, J. Thollot, Y. Gousseau, R. Drouillhet, and J.-F. Coeurjolly. 2009. Appearance-guided Synthesis of Element Arrangements by Example. In NPAR '09. 51--60.

Digital Library

[22]

Takashi Ijiri, Radomír Mech, Takeo Igarashi, and Gavin Miller. 2008. An Example-based Procedural System for Element Arrangement. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 429--436.

[23]

Jennifer Jacobs, Joel Brandt, Radomír Mech, and Mitchel Resnick. 2018. Extending Manual Drawing Practices with Artist-Centric Programming Tools. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 590, 13 pages.

Digital Library

[24]

Alexandre Kaspar, Boris Neubert, Dani Lischinski, Mark Pauly, and Johannes Kopf. 2015. Self Tuning Texture Optimization. Comput. Graph. Forum 34, 2 (May 2015), 349--359.

Digital Library

[25]

Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, and Richard Davis. 2012. Vignette: Interactive Texture Design and Manipulation with Freeform Gestures for Pen-and-ink Illustration. In CHI '12. 1727--1736.

Digital Library

[26]

Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1--2 (1955), 83--97.

[27]

Kin Chung Kwan, Lok Tsun Sinn, Chu Han, Tien-Tsin Wong, and Chi-Wing Fu. 2016. Pyramid of Arclength Descriptor for Generating Collage of Shapes. ACM Trans. Graph. 35, 6, Article 229 (Nov. 2016), 12 pages.

Digital Library

[28]

Vivek Kwatra, Irfan Essa, Aaron Bobick, and Nipun Kwatra. 2005. Texture Optimization for Example-based Synthesis. ACM Trans. Graph. 24, 3 (July 2005), 795--802.

Digital Library

[29]

Pierre-Edouard Landes, Bruno Galerne, and Thomas Hurtut. 2013. A Shape-Aware Model for Discrete Texture Synthesis. Computer Graphics Forum 32, 4 (2013), 67--76.

Digital Library

[30]

Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space Texture Synthesis. In ACM SIGGRAPH 2006 Papers (SIGGRAPH '06). ACM, New York, NY, USA, 541--548.

Digital Library

[31]

Muxingzi Li, Florent Lafarge, and Renaud Marlet. 2020. Approximating shapes in images with low-complexity polygons. In The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]

Guilin Liu, Rohan Taori, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum A. Reda, Karan Sapra, Andrew Tao, and Bryan Catanzaro. 2020. Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter. arXiv:cs.CV/2007.07243

[33]

Lifeng Liu and Stan Sclaroff. 2001. Region segmentation via deformable model-guided split and merge. In Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vol. 1. IEEE, 98--104.

[34]

Yitzchak David Lockerman, Basile Sauvage, Rémi Allègre, Jean-Michel Dischler, Julie Dorsey, and Holly Rushmeier. 2016. Multi-scale Label-map Extraction for Texture Synthesis. ACM Trans. Graph. 35, 4, Article 140 (July 2016), 12 pages.

Digital Library

[35]

Hugo Loi, Thomas Hurtut, Romain Vergne, and Joelle Thollot. 2017. Programmable 2D Arrangements for Element Texture Design. ACM Trans. Graph. 36, 4, Article 105a (May 2017).

Digital Library

[36]

Jingwan Lu, Connelly Barnes, Stephen DiVerdi, and Adam Finkelstein. 2013. RealBrush: Painting with Examples of Physical Media. ACM Trans. Graph. 32, 4, Article 117 (July 2013), 12 pages.

Digital Library

[37]

Jingwan Lu, Connelly Barnes, Connie Wan, Paul Asente, Radomir Mech, and Adam Finkelstein. 2014. DecoBrush: Drawing Structured Decorative Patterns by Example. ACM Trans. Graph. 33, 4, Article 90 (July 2014), 9 pages.

Digital Library

[38]

Jingwan Lu, Fisher Yu, Adam Finkelstein, and Stephen DiVerdi. 2012. HelpingHand: Example-based Stroke Stylization. ACM Trans. Graph. 31, 4, Article 46 (July 2012), 10 pages.

Digital Library

[39]

Chongyang Ma, Li-Yi Wei, Sylvain Lefebvre, and Xin Tong. 2013. Dynamic Element Textures. ACM Trans. Graph. 32, 4, Article 90 (July 2013), 10 pages.

Digital Library

[40]

Chongyang Ma, Li-Yi Wei, and Xin Tong. 2011. Discrete Element Textures. ACM Trans. Graph. 30, 4, Article 62 (July 2011), 10 pages.

Digital Library

[41]

Morteza Mardani, Guilin Liu, Aysegul Dundar, Shiqiu Liu, Andrew Tao, and Bryan Catanzaro. 2020. Neural FFTs for Universal Texture Image Synthesis. In NeurIPS '20.

[42]

Giacomo Nazzaro, Enrico Puppo, and Fabio Pellacini. 2020. DecoSurf: Recursive Geodesic Patterns on Triangle Meshes. arXiv:cs.GR/2007.10918

[43]

Giacomo Nazzaro, Enrico Puppo, and Fabio Pellacini. 2021. GeoTangle: Interactive Design of Geodesic Tangle Patterns on Surfaces. ACM Trans. Graph. 41, 2, Article 12 (nov 2021), 17 pages.

Digital Library

[44]

Hans Pedersen and Karan Singh. 2006. Organic Labyrinths and Mazes. In NPAR '06. 79--86.

Digital Library

[45]

Brian Price and William Barrett. 2006. Object-based vectorization for interactive image editing. The Visual Computer 22, 9 (2006), 661--670.

Digital Library

[46]

Pradyumna Reddy, Michael Gharbi, Michal Lukac, and Niloy J Mitra. 2021. Im2vec: Synthesizing vector graphics without vector supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7342--7351.

[47]

Amir Rosenberger, Daniel Cohen-Or, and Dani Lischinski. 2009. Layered Shape Synthesis: Automatic Generation of Control Maps for Non-Stationary Textures. ACM Trans. Graph. 28, 5 (Dec. 2009), 1--9.

Digital Library

[48]

Riccardo Roveri, A Cengiz Öztireli, Sebastian Martin, Barbara Solenthaler, and Markus Gross. 2015. Example based repetitive structure synthesis. Computer Graphics Forum 34, 5 (2015), 39--52.

Digital Library

[49]

Christian Santoni and Fabio Pellacini. 2016. gTangle: A Grammar for the Procedural Generation of Tangle Patterns. ACM Trans. Graph. 35, 6, Article 182 (Nov. 2016), 11 pages.

Digital Library

[50]

Reza Adhitya Saputra, Craig S. Kaplan, and Paul Asente. 2020. AnimationPak: Packing Elements with Scripted Animations. In Graphics Interface '20. https://openreview.net/forum?id=sr89orrDo-o.

[51]

WWCRE Schapire and Yoram Singer. 1998. Learning to order things. Advances in Neural Information Processing Systems 10 (1998), 451.

[52]

Jianbo Shi and Jitendra Malik. 2000. Normalized cuts and image segmentation. IEEE Transactions on pattern analysis and machine intelligence 22, 8 (2000), 888--905.

Digital Library

[53]

Denis Simakov, Yaron Caspi, Eli Shechtman, and Michal Irani. 2008. Summarizing visual data using bidirectional similarity. In CVPR 2008. 1--8.

[54]

Ondrej Št'ava, Bedrich Beneš, Radomir Měch, Daniel G Aliaga, and Peter Krištof. 2010. Inverse procedural modeling by automatic generation of L-systems. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 665--674.

[55]

Kenshi Takayama, Olga Sorkine, Andrew Nealen, and Takeo Igarashi. 2010. Volumetric Modeling with Diffusion Surfaces. In SIGGRAPH ASIA '10. Article Article 180, 8 pages.

Digital Library

[56]

Peihan Tu, Li-Yi Wei, Koji Yatani, Takeo Igarashi, and Matthias Zwicker. 2020. Continuous Curve Textures. ACM Trans. Graph. 39, 6, Article 168 (12 2020).

Digital Library

[57]

Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Statistics and computing 17, 4 (2007), 395--416.

[58]

W3. 2020. SVG Rendering Model. https://www.w3.org/TR/SVG/render.html.

[59]

Lvdi Wang, Yizhou Yu, Kun Zhou, and Baining Guo. 2011. Multiscale vector volumes. ACM Transactions on Graphics (TOG) 30, 6 (2011), 1--8.

Digital Library

[60]

Li-Yi Wei. 2010. Multi-class Blue Noise Sampling. ACM Trans. Graph. 29, 4, Article 79 (July 2010), 8 pages.

Digital Library

[61]

Li-Yi Wei, Arjun V Anand, Shally Kumar, and Tarun Beri. 2020. Simple Methods to Represent Shapes with Sample Spheres. In SA '20 Technical Communications. Article 3, 4 pages.

Digital Library

[62]

Li-Yi Wei, Jianwei Han, Kun Zhou, Hujun Bao, Baining Guo, and Heung-Yeung Shum. 2008. Inverse Texture Synthesis. ACM Trans. Graph. 27, 3, Article 52 (Aug. 2008), 9 pages.

Digital Library

[63]

Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the Art in Example-based Texture Synthesis. In Eurographics 2009, State of the Art Report, EG-STAR. Eurographics Association. http://www-sop.inria.fr/reves/Basilic/2009/WLKT09

[64]

Michael T Wong, Douglas E Zongker, and David H Salesin. 1998. Computer-generated floral ornament. In SIGGRAPH '98. 423--434.

Digital Library

[65]

Yi-Ting Yeh and Radomír Měch. 2009. Detecting symmetries and curvilinear arrangements in vector art. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 707--716.

[66]

Kun Zhou, Xin Huang, Xi Wang, Yiying Tong, Mathieu Desbrun, Baining Guo, and Heung-Yeung Shum. 2006. Mesh Quilting for Geometric Texture Synthesis. ACM Trans. Graph. 25, 3 (July 2006), 690--697.

Digital Library

[67]

Shizhe Zhou, Changyun Jiang, and Sylvain Lefebvre. 2014. Topology-constrained Synthesis of Vector Patterns. ACM Trans. Graph. 33, 6, Article 215 (Nov. 2014), 11 pages.

Digital Library

[68]

Yang Zhou, Zhen Zhu, Xiang Bai, Dani Lischinski, Daniel Cohen-Or, and Hui Huang. 2018. Non-Stationary Texture Synthesis by Adversarial Expansion. ACM Trans. Graph. 37, 4, Article 49 (July 2018), 13 pages.

Digital Library

[69]

Changqing Zou, Junjie Cao, Warunika Ranaweera, Ibraheem Alhashim, Ping Tan, Alla Sheffer, and Hao Zhang. 2016. Legible Compact Calligrams. ACM Trans. Graph. 35, 4, Article 122 (July 2016), 12 pages.

Digital Library

Cited By

Xia FLi XDu ZZhao L(2024)Intelligent pattern reconstruction based on primitive spatial relationship adaptive transformationFifteenth International Conference on Graphics and Image Processing (ICGIP 2023)10.1117/12.3021534(92)Online publication date: 25-Mar-2024
https://doi.org/10.1117/12.3021534
SANZHAROV VFROLOV VGALAKTIONOV V(2023)SUPPORTING VECTOR TEXTURES IN A GPU PHOTOREALISTIC RENDERING SYSTEMПрограммирование10.31857/S0132347423030044(3-12)Online publication date: 1-May-2023
https://doi.org/10.31857/S0132347423030044
Xue TWu MLu LWang HDong HChen B(2023)Learning Gradient Fields for Scalable and Generalizable Irregular PackingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618235(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618235
Show More Cited By

Index Terms

Clustered vector textures
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
      1. Texturing

Recommendations

Continuous curve textures

Repetitive patterns are ubiquitous in natural and human-made objects, and can be created with a variety of tools and methods. Manual authoring provides unmatched degree of freedom and control, but can require significant artistic expertise and manual ...
PLBP: An effective local binary patterns texture descriptor with pyramid representation

Local binary pattern (LBP) is an effective texture descriptor which has successful applications in texture classification and face recognition. Many extensions are made for conventional LBP descriptors. One of the extensions is dominant local binary ...
Efficient synthesis of gradient solid textures

Solid textures require large storage and are computationally expensive to synthesize. In this paper, we propose a novel solid representation called gradient solids to compactly represent solid textures, including a tricubic interpolation scheme of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 41, Issue 4

July 2022

1978 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3528223

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2022

Published in TOG Volume 41, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Adobe

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
312
Total Downloads

Downloads (Last 12 months)80
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xia FLi XDu ZZhao L(2024)Intelligent pattern reconstruction based on primitive spatial relationship adaptive transformationFifteenth International Conference on Graphics and Image Processing (ICGIP 2023)10.1117/12.3021534(92)Online publication date: 25-Mar-2024
https://doi.org/10.1117/12.3021534
SANZHAROV VFROLOV VGALAKTIONOV V(2023)SUPPORTING VECTOR TEXTURES IN A GPU PHOTOREALISTIC RENDERING SYSTEMПрограммирование10.31857/S0132347423030044(3-12)Online publication date: 1-May-2023
https://doi.org/10.31857/S0132347423030044
Xue TWu MLu LWang HDong HChen B(2023)Learning Gradient Fields for Scalable and Generalizable Irregular PackingSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618235(1-11)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618235
Yang J(2023)Animated Patterns: Applying Dynamic Patterns to Vector IllustrationsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3583941(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3583941
Sanzharov VFrolov VGalaktionov V(2023)Supporting Vector Textures in a GPU Photorealistic Rendering SystemProgramming and Computing Software10.1134/S036176882303004049:3(131-139)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1134/S0361768823030040
Chen JZhu XEven MBasset JBénard PBarla P(2023)Efficient Interpolation of Rough Line DrawingsComputer Graphics Forum10.1111/cgf.1494642:7Online publication date: 5-Nov-2023
https://doi.org/10.1111/cgf.14946

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents