research-article

Inverse procedural modeling of facade layouts

Authors:

Xiaopeng Zhang,

Peter WonkaAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 33, Issue 4

Article No.: 121, Pages 1 - 10

https://doi.org/10.1145/2601097.2601162

Published: 27 July 2014 Publication History

Abstract

In this paper, we address the following research problem: How can we generate a meaningful split grammar that explains a given facade layout? To evaluate if a grammar is meaningful, we propose a cost function based on the description length and minimize this cost using an approximate dynamic programming framework. Our evaluation indicates that our framework extracts meaningful split grammars that are competitive with those of expert users, while some users and all competing automatic solutions are less successful.

Supplementary Material

ZIP File (a121-wu.zip)

Supplemental material.

Download
173.55 MB

MP4 File (a121-sidebyside.mp4)

Download
11.97 MB

References

[1]

Aliaga, D. G., Rosen, P. A., and Bekins, D. R. 2007. Style grammars for interactive visualization of architecture. IEEE Trans. on Vis. and Comp. Graph. 13, 4, 786--797.

Digital Library

[2]

Bao, F., Schwarz, M., and Wonka, P. 2013. Procedural facade variations from a single layout. ACM Trans. Graph. 32, 1, 8:1--8:13.

Digital Library

[3]

Becker, S. 2009. Generation and application of rules for quality dependent facade reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing 64, 6, 640--653.

[4]

Bekins, D. R., and Aliaga, D. G. 2005. Build-by-number: Rear-ranging the real world to visualize novel architectural spaces. In Proceedings of 16th IEEE Visualization, 143--150.

[5]

Bokeloh, M., Wand, M., and Seidel, H.-P. 2010. A connection between partial symmetry and inverse procedural modeling. ACM TOG (SIGGRAPH) 29, 104:1--104:10.

Digital Library

[6]

Carrascosa, R., Coste, F., Gallé, M., and Infante-Lopez, G. 2010. Choosing word occurrences for the smallest grammar problem. In Proceedings of the 4th international conference on Language and Automata Theory and Applications, 154--165.

Digital Library

[7]

Carrascosa, R., Coste, F., Gallé, M., and Infante-Lopez, G. 2012. Searching for smallest grammars on large sequences and application to DNA. Journal of Discrete Algorithms 11, 62--72.

Digital Library

[8]

Charikar, M., Lehman, E., Liu, D., Panigrahy, R., Prabhakaran, M., Sahai, A., and Shelat, A. 2005. The smallest grammar problem. IEEE Transactions on Information Theory 51, 7, 2554--2576.

Digital Library

[9]

de Marcken, C. G. 1996. Unsupervised Language Acquisition. PhD thesis, MIT, Cambridge, MA.

Digital Library

[10]

Hohmann, B., Krispel, U., Havemann, S., and Fellner, D. 2009. Cityfit - high-quality urban reconstructions by fitting shape grammars to images and derived textured point clouds. In Proceedings of the 3rd ISPRS International Workshop 3D-ARCH 2009: "3D Virtual Reconstruction and Visualization of Complex Architectures".

[11]

Lefebvre, S., Hornus, S., and Lasram, A. 2010. By-example synthesis of architectural textures. ACM TOG (SIGGRAPH) 29, 4, 84:1--84:8.

Digital Library

[12]

Lin, J., Cohen-Or, D., Zhang, H., Liang, C., Sharf, A., Deussen, O., and Chen, B. 2011. Structure-preserving retargeting of irregular 3D architecture. ACM TOG (SIGGRAPH Asia) 30, 6, 183:1--183:10.

Digital Library

[13]

Lipp, M., Wonka, P., and Wimmer, M. 2008. Interactive visual editing of grammars for procedural architecture. ACM TOG (SIGGRAPH) 27, 3, 102:1--102:10.

Digital Library

[14]

Martinovic, A., and Van Gool, L. 2013. Bayesian grammar learning for inverse procedural modeling. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, 201--208.

Digital Library

[15]

Mathias, M., Martinovic, A., Weissenberg, J., and Gool, L. V. 2011. Procedural 3D building reconstruction using shape grammars and detectors. In Proc. of 3DIMPVT, 304--311.

Digital Library

[16]

Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Gool, L. V. 2006. Procedural modeling of buildings. ACM TOG (SIGGRAPH) 25, 3, 614--623.

Digital Library

[17]

Müller, P., Zeng, G., Wonka, P., and Gool, L. V. 2007. Image-based procedural modeling of facades. ACM TOG (SIGGRAPH) 26, 3, 85:1--85:9.

Digital Library

[18]

Musialski, P., Wimmer, M., and Wonka, P. 2012. Interactive coherence-based façade modeling. Computer Graphics Forum (Proc. of Eurographics) 31, 2, 661--670.

Digital Library

[19]

Musialski, P., Wonka, P., Aliaga, D. G., Wimmer, M., van Gool, L., and Purgathofer, W. 2013. A survey of urban reconstruction. Computer Graphics Forum 32, 6, 146--177.

Digital Library

[20]

Patow, G. 2012. User-friendly graph editing for procedural modeling of buildings. IEEE Computer Graphics and Applications 32, 2, 66--75.

Digital Library

[21]

Powell, W. B. 2011. Approximate Dynamic Programming: Solving the curses of dimensionality, 2nd ed. John Wiley and Sons.

[22]

Prusinkiewicz, P., and Lindenmayer, A. 1990. The Algorithmic Beauty of Plants. Springer-Verlag, New York.

Digital Library

[23]

Riemenschneider, H., Krispel, U., Thaller, W., Donoser, M., Havemann, S., Fellner, D., and Bischof, H. 2012. Irregular lattices for complex shape grammar facade parsing. In CVPR, 1640--1647.

Digital Library

[24]

Ripperda, N., and Brenner, C. 2009. Application of a formal grammar to facade reconstruction in semiautomatic and automatic environments. In Proc. of 12th AGILE Conf. on GIScience.

[25]

Simon, L., Teboul, O., Koutsourakis, P., and Paragios, N. 2011. Random exploration of the procedural space for single-view 3D modeling of buildings. International Journal of Computer Vision 93, 253--271.

Digital Library

[26]

Talton, J. O., Yang, L., Kumar, R., Lim, M., Goodman, N. D., and Mech, R. 2012. Learning design patterns with bayesian grammar induction. In UIST, 63--74.

Digital Library

[27]

Teboul, O., Kokkinos, I., Simon, L., Koutsourakis, P., and Paragios, N. 2011. Shape grammar parsing via reinforcement learning. In CVPR, 2273--2280.

Digital Library

[28]

Teboul, O., Kokkinos, I., Simon, L., Koutsourakis, P., and Paragios, N. 2013. Parsing facades with shape grammars and reinforcement learning. IEEE PAMI 35, 7, 1744--1756.

Digital Library

[29]

Toshev, A., Mordohai, P., and Taskar, B. 2010. Detecting and parsing architecture at city scale from range data. In CVPR, 398--405.

[30]

Vanegas, C. A., Aliaga, D. G., and Benevs, B. 2010. Building reconstruction using manhattan-world grammars. In CVPR, 358--365.

[31]

Št'ava, O., Beneš, B., Měch, R., Aliaga, D. G., and Krištof, P. 2010. Inverse procedural modeling by automatic generation of 1-systems. Computer Graphics Forum 29, 2, 665--674.

[32]

Watson, B., and Wonka, P. 2008. Procedural methods for urban modeling. IEEE Computer Graphics and Applications 28, 3, 16--17.

Digital Library

[33]

Weissenberg, J., Riemenschneider, H., Prasad, M., and Van Gool, L. 2013. Is there a procedural logic to architecture? In CVPR, 185--192.

Digital Library

[34]

Wonka, P., Wimmer, M., Sillion, F., and Ribarsky, W. 2003. Instant architecture. ACM TOG (SIGGRAPH) 22, 3, 669--677.

Digital Library

[35]

Yeh, Y.-T., Breeden, K., Yang, L., Fisher, M., and Hanrahan, P. 2013. Synthesis of tiled patterns using factor graphs. ACM Trans. Graph. 32, 1, 3:1--3:13.

Digital Library

[36]

Zhang, H., Xu, K., Jiang, W., Lin, J., Cohen-Or, D., and Chen, B. 2013. Layered analysis of irregular facades via symmetry maximization. ACM TOG (SIGGRAPH) 32, 4, 121:1--121:10.

Digital Library

[37]

Zhao, P., Yang, L., Zhang, H., and Quan, L. 2012. Per-pixel translational symmetry detection, optimization, and segmentation. In CVPR, 526--533.

Digital Library

Cited By

Garifullin AMaiorov NFrolov VVoloboy A(2024)Single-View 3D Reconstruction via Differentiable Rendering and Inverse Procedural ModelingSymmetry10.3390/sym1602018416:2(184)Online publication date: 4-Feb-2024
https://doi.org/10.3390/sym16020184
Płocharski ASwidzinski JPorter-Sobieraj JMusialski P(2024)Neuro-Symbolic Transformation of Architectural Facades into Their Procedural RepresentationsACM SIGGRAPH 2024 Posters10.1145/3641234.3671063(1-2)Online publication date: 25-Jul-2024
https://dl.acm.org/doi/10.1145/3641234.3671063
Zhu JWang HHogg DKelly T(2024)Learning to sculpt neural cityscapesThe Visual Computer10.1007/s00371-024-03528-7Online publication date: 12-Jul-2024
https://doi.org/10.1007/s00371-024-03528-7
Show More Cited By

Index Terms

Inverse procedural modeling of facade layouts
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Graphics recognition and interpretation
2. Computing methodologies
  1. Computer graphics

Recommendations

Inverse design of urban procedural models

We propose a framework that enables adding intuitive high level control to an existing urban procedural model. In particular, we provide a mechanism to interactively edit urban models, a task which is important to stakeholders in gaming, urban planning, ...
Bayesian Grammar Learning for Inverse Procedural Modeling
CVPR '13: Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition

Within the fields of urban reconstruction and city modeling, shape grammars have emerged as a powerful tool for both synthesizing novel designs and reconstructing buildings. Traditionally, a human expert was required to write grammars for specific ...
Procedural Urban Modeling in Practice

Film and game studios can no longer meet audience demand for visual content by increasing production budgets. Instead they are turning to procedural modeling, particularly for modeling cities. The authors review procedural modeling, examine the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 33, Issue 4

July 2014

1366 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2601097

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2014

Published in TOG Volume 33, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
1,118
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)5

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Garifullin AMaiorov NFrolov VVoloboy A(2024)Single-View 3D Reconstruction via Differentiable Rendering and Inverse Procedural ModelingSymmetry10.3390/sym1602018416:2(184)Online publication date: 4-Feb-2024
https://doi.org/10.3390/sym16020184
Płocharski ASwidzinski JPorter-Sobieraj JMusialski P(2024)Neuro-Symbolic Transformation of Architectural Facades into Their Procedural RepresentationsACM SIGGRAPH 2024 Posters10.1145/3641234.3671063(1-2)Online publication date: 25-Jul-2024
https://dl.acm.org/doi/10.1145/3641234.3671063
Zhu JWang HHogg DKelly T(2024)Learning to sculpt neural cityscapesThe Visual Computer10.1007/s00371-024-03528-7Online publication date: 12-Jul-2024
https://doi.org/10.1007/s00371-024-03528-7
Wang X(2023)Procedural Modeling Method of Pipe Network Based on Spline GrammarFrontiers in Computing and Intelligent Systems10.54097/fcis.v3i2.75953:2(127-132)Online publication date: 17-Apr-2023
https://doi.org/10.54097/fcis.v3i2.7595
Lee JLi BBenes B(2023)Latent L-systems: Transformer-based Tree GeneratorACM Transactions on Graphics10.1145/362710143:1(1-16)Online publication date: 2-Nov-2023
https://dl.acm.org/doi/10.1145/3627101
Alfadalat MAl-Azhari WDabbour L(2023)Procedural Modeling Based Shape Grammar as a Key to Generating Digital Architectural HeritageJournal on Computing and Cultural Heritage 10.1145/360670116:4(1-17)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.1145/3606701
Jones RGuerrero PMitra NRitchie D(2023)ShapeCoder: Discovering Abstractions for Visual Programs from Unstructured PrimitivesACM Transactions on Graphics10.1145/359241642:4(1-17)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592416
Merrell P(2023)Example-Based Procedural Modeling Using Graph GrammarsACM Transactions on Graphics10.1145/359211942:4(1-16)Online publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1145/3592119
Hossain IShen IIgarashi Tvan Kaick O(2023)Data‐guided Authoring of Procedural Models of ShapesComputer Graphics Forum10.1111/cgf.1493542:7Online publication date: 5-Nov-2023
https://doi.org/10.1111/cgf.14935
Zhang JWan ZLiao J(2023)Adaptive Joint Optimization for 3D Reconstruction With Differentiable RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314824529:6(3039-3051)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3148245
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents