research-article

Synthesis of tiled patterns using factor graphs

Authors:

Katherine Breeden,

Matthew Fisher,

Pat HanrahanAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 32, Issue 1

Article No.: 3, Pages 1 - 13

https://doi.org/10.1145/2421636.2421639

Published: 07 February 2013 Publication History

Abstract

Patterns with pleasing structure are common in art, video games, and virtual worlds. We describe a method for synthesizing new patterns of tiles on a regular grid that are similar in appearance to a set of example patterns. Exemplars are used both to specify valid tile arrangements and to emphasize multi-tile structures. We model a pattern as a probabilistic graphical model called a factor graph. Factors represent the hard logical constraints between tiles, the soft statistical relationships that determine style, and the local dependencies between tiles at neighboring sites. We describe a simple method for learning factor functions from a small exemplar. We then synthesize new patterns through a stochastic search method that is inspired by MC-SAT. Efficient synthesis is challenging because of the combination of hard and soft constraints. Our synthesis algorithm, called BlockSS, scales linearly with the number of tiles and the hardness of the problem. We use our technique to model building facades, cities, and decorative patterns.

Supplementary Material

a3-yeh-apndx.pdf (yeh.zip)

Supplemental movie, appendix, image and software files for, Synthesis of tiled patterns using factor graphs

Download
4.00 MB

MP4 File (tp140.mp4)

Download
16.84 MB

References

[1]

Ashikhmin, M. 2001. Synthesizing natural textures. In Proceedings of the Symposium on Interactive 3D Graphics. ACM, 217--226.

Digital Library

[2]

Bokeloh, M., Wand, M., and Seidel, H.-P. 2010. A connection between partial symmetry and inverse procedural modeling. ACM Trans. Graph. 29, 4.

Digital Library

[3]

Campbell, C. 2006. Vitruvius Britannicus: The Classic of Eighteenth-Century British Architecture. Dover Publications.

[4]

Cho, T. S., Avidan, S., and Freeman, W. T. 2010. A probabilistic image jigsaw puzzle solver. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]

Cohen, M., Shade, J., Hiller, S., and Deussen, O. 2003. Wang tiles for image and texture generation. ACM Trans. Graph. 22, 3, 287--294.

Digital Library

[6]

Edwards, R. and Sokal, A. 1988. Generalization of the Fortuin-Kasteleyn-Swendsen-Wang representation and Monte Carlo algorithm. Phys. Rev. D 38, 6, 2009--2012.

[7]

Efros, A. and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques ACM SIGGRAPH.

Digital Library

[8]

Efros, A. A. and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In ICCV (2). 1033--1038.

Digital Library

[9]

Gent, I., Jefferson, C., and Miguel, I. 2006. MINION: A fast, scalable, constraint solver. In Proceeding of the 17th European Conference on Artificial Intelligence. 98--102.

Digital Library

[10]

Goldberger, J., Gordon, S., and Greenspan, H. 2003. An efficient image similarity measure based on approximations of KL-divergence between two Gaussian mixtures. In Proceedings of the International Conference on Computer Vision (ICCV). 487--493.

Digital Library

[11]

Hastings, W. K. 1970. Monte carlo sampling methods using markov chains and their applications. Biometrika 57, 1, pp. 97--109.

[12]

Koller, D. and Friedman, N. 2009. Probabilistic Graphical Models. MIT Press.

Digital Library

[13]

Kschischang, F. R., Frey, B. J., and Loeliger, H.-A. 2001. Factor graphs and the sum-product algorithm. IEEE Trans. Inf. Theory 47, 498-- 519.

Digital Library

[14]

Kwatra, V., Schdl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Trans. Graph. 22, 3, 277--286.

Digital Library

[15]

Lagae, A., Kaplan, C. S., Fu, C.-W., Ostromoukhov, V., and Deussen, O. 2008. Tile-Based methods for interactive applications. In ACM SIGGRAPH Classes. ACM, New York, 93:1--93:267.

Digital Library

[16]

Loeliger, H. A. 2004. An introduction to factor graphs. IEEE Signal Process. Mag. 21, 1, 28--41.

[17]

Merrell, P. 2007. Example-Based model synthesis. In (I3D '07) Proceedings of the Symposium on Interactive 3D Graphics and Games. ACM, New York, 105--112.

Digital Library

[18]

Mira, A. and Tierney, L. 1997. On the use of auxiliary variables in Markov chain Monte Carlo sampling. Scand. J. Statist.

[19]

Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Gool, L. V. 2006. Procedural modeling of buildings. ACM Trans. Graph. 25, 3, 614-- 623.

Digital Library

[20]

Neal, R. 2000. Slice sampling. Ann. Statist. 31, 705--767.

[21]

Parish, Y. I. H. and Müller, P. 2001. Procedural modeling of cities. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York, 301--308.

Digital Library

[22]

Paskin, M. 2002. Maximum-Entropy probabilistic logics. Tech. rep., University of California at Berkeley.

Digital Library

[23]

Poon, H. and Domingos, P. 2006. Sound and efficient inference with probabilistic and deterministic dependencies. In Proceedings of the 21st National Conference on Artificial Intelligence. AAAI Press, 458-- 463.

Digital Library

[24]

Prusinkiewicz, P. and Lindenmayer, A. 1996. The Algorithmic Beauty of Plants. Springer.

Digital Library

[25]

Son, G. B. and Co. 1976. Victorian Frames, Borders and Cuts: From the 1882 Type Catalog of George Bruce's Son and Co. Dover Publications.

[26]

Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In Eurographics State of the Art Report, EG-STAR. Eurographics Association.

[27]

Wei, L.-Y. and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Computer Graphics Proceedings, K. Akeley, Ed., ACM Press Addison Wesley Longman, 479--488.

Digital Library

[28]

Wei, W., Erenrich, J., and Selman, B. 2004. Towards efficient sampling: Exploiting random walk strategies. In Proceedings of the 19th National Conference on Artifical Intelligence. AAAI Press/The MIT Press, 670--676.

Digital Library

[29]

Wong, M. T., Zongker, D. E., and Salesin, D. H. 1998. Computer-generated floral ornament. Comput. Graph. 32. Annual Conference Series, 423--434.

Digital Library

[30]

Yokoo, M. 1997. Why adding more constraints makes a problem easier for hill-climbing algorithms: Analyzing landscapes of csps. Principl. and Pract. Constr. Program.-CP97, 356--370.

[31]

Zhu, S. C., Wu, Y., and Mumford, D. 1998. Filters, random fields and maximum entropy (frame) -- Towards a unified theory for texture modeling. Int. J. Comput. Vis. 27, 2, 1--20.

Digital Library

Cited By

Merrell P(2023)Example-Based Procedural Modeling Using Graph GrammarsACM Transactions on Graphics10.1145/359211942:4(1-16)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592119
Sun JWu WLiu LMin WZhang GZheng L(2022)WallPlanACM Transactions on Graphics10.1145/3528223.353013541:4(1-14)Online publication date: Jul-2022
https://doi.org/10.1145/3528223.3530135
Niese TPirk SAlbrecht MBenes BDeussen O(2022)Procedural Urban ForestryACM Transactions on Graphics10.1145/350222041:2(1-18)Online publication date: 3-Mar-2022
https://dl.acm.org/doi/10.1145/3502220
Show More Cited By

Index Terms

Synthesis of tiled patterns using factor graphs
1. Computing methodologies
  1. Computer graphics
    1. Image manipulation
    2. Rendering

Recommendations

Synthesizing open worlds with constraints using locally annealed reversible jump MCMC

We present a novel Markov chain Monte Carlo (MCMC) algorithm that generates samples from transdimensional distributions encoding complex constraints. We use factor graphs, a type of graphical model, to encode constraints as factors. Our proposed MCMC ...
Topology-constrained synthesis of vector patterns

Decorative patterns are observed in many forms of art, typically enriching the visual aspect of otherwise simple shapes. Such patterns are especially difficult to create, as they often exhibit intricate structural details and at the same time have to ...
Example-based model synthesis
I3D '07: Proceedings of the 2007 symposium on Interactive 3D graphics and games

Model synthesis is a new approach to 3D modeling which automatically generates large models that resemble a small example model provided by the user. Model synthesis extends the 2D texture synthesis problem into higher dimensions and can be used to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 32, Issue 1

January 2013

125 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2421636

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 February 2013

Accepted: 01 April 2012

Revised: 01 April 2012

Received: 01 August 2011

Published in TOG Volume 32, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
732
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Merrell P(2023)Example-Based Procedural Modeling Using Graph GrammarsACM Transactions on Graphics10.1145/359211942:4(1-16)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592119
Sun JWu WLiu LMin WZhang GZheng L(2022)WallPlanACM Transactions on Graphics10.1145/3528223.353013541:4(1-14)Online publication date: Jul-2022
https://doi.org/10.1145/3528223.3530135
Niese TPirk SAlbrecht MBenes BDeussen O(2022)Procedural Urban ForestryACM Transactions on Graphics10.1145/350222041:2(1-18)Online publication date: 3-Mar-2022
https://dl.acm.org/doi/10.1145/3502220
Tao YZhang YChen X(2022)Element-Arrangement Context Network for Facade ParsingJournal of Computer Science and Technology10.1007/s11390-022-2189-337:3(652-665)Online publication date: 31-May-2022
https://doi.org/10.1007/s11390-022-2189-3
Fritzsche WGoebbels SHensel SRußinski MSchuch N(2022)Inpainting Applied to Facade Images: A Comparison of AlgorithmsPattern Recognition and Artificial Intelligence10.1007/978-3-031-09037-0_34(410-422)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-09037-0_34
Liang YFan LRen PXie XHua X(2021)DecorIn: An Automatic Method for Plane-Based DecoratingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.297289727:8(3438-3450)Online publication date: 1-Aug-2021
https://doi.org/10.1109/TVCG.2020.2972897
Para WGuerrero PKelly TGuibas LWonka P(2021)Generative Layout Modeling using Constraint Graphs2021 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV48922.2021.00662(6670-6680)Online publication date: Oct-2021
https://doi.org/10.1109/ICCV48922.2021.00662
van Aanholt LBidarra R(2020)Declarative procedural generation of architecture with semantic architectural profiles2020 IEEE Conference on Games (CoG)10.1109/CoG47356.2020.9231561(351-358)Online publication date: Aug-2020
https://doi.org/10.1109/CoG47356.2020.9231561
Derouet‐Jourdan ASalvati MJonchier T(2019)Generating Stochastic Wall Patterns On‐the‐fly with Wang TilesComputer Graphics Forum10.1111/cgf.1363538:2(255-264)Online publication date: 7-Jun-2019
https://doi.org/10.1111/cgf.13635
Jiang HYan DZhang XWonka P(2019)Selection Expressions for Procedural ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.2877614(1-1)Online publication date: 2019
https://doi.org/10.1109/TVCG.2018.2877614
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents