Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Procedural Urban Forestry

Published: 03 March 2022 Publication History

Abstract

The placement of vegetation plays a central role in the realism of virtual scenes. We introduce procedural placement models (PPMs) for vegetation in urban layouts. PPMs are environmentally sensitive to city geometry and allow identifying plausible plant positions based on structural and functional zones in an urban layout. PPMs can either be directly used by defining their parameters or learned from satellite images and land register data. This allows us to populate urban landscapes with complex 3D vegetation and enhance existing approaches for generating urban landscapes. Our framework’s effectiveness is shown through examples of large-scale city scenes and close-ups of individually grown tree models. We validate the results generated with our framework with a perceptual user study and its usability based on urban scene design sessions with expert users.

References

[1]
S. AlHalawani, Y.-L. Yang, H. Liu, and N. J. Mitra. 2013. Interactive facades analysis and synthesis of semi-regular facades. Computer Graphics Forum 32, 2pt2 (2013), 215–224.
[2]
M. Aono and T. L. Kunii. 1984. Botanical tree image generation. IEEE Computer Graphics and Applications 4, 5 (1984), 10–34.
[3]
F. Bao, M. Schwarz, and P. Wonka. 2013. Procedural facade variations from a single layout. ACM Transactions on Graphics 32, 1 (2013), 13 pages.
[4]
B. Benes, J. A. Cordóba, and J. M. Soto. 2003. Modeling virtual gardens by autonomous procedural agents. In Proceedings of the Theory and Practice of Computer Graphics. IEEE Computer Society, 58–65.
[5]
B. Benes, M. A. Massih, P. Jarvis, D. G. Aliaga, and C. A. Vanegas. 2011. Urban ecosystem design. In Proceedings of the Symposium on Interactive 3D Graphics and Games. 167–174.
[6]
B. Benes and E. U. Millán. 2002. Virtual climbing plants competing for space. In Proceedings of the Computer Animation. IEEE Computer Society, 33–42.
[7]
D. V. Bloniarz and H. D. P. Ryan. 1993. Designing alternatives to avoid street tree conflicts. Journal of Arboriculture 19, 3 (1993), 152–152.
[8]
M. Bokeloh, M. Wand, and H.-P. Seidel. 2010. A connection between partial symmetry and inverse procedural modeling. In ACM Transactions on Graphics 29, 4 (2010), 1–10.
[9]
G. Chen, G. Esch, P. Wonka, P. Müller, and E. Zhang. 2008. Interactive procedural street modeling. In Proceedings of the ACM SIGGRAPH.
[10]
H. I. Choi, S. W. Choi, H. P. Moon, and N.-S. Wee. 1997. New algorithm for medial axis transform of plane domain. CVGIP: Graphical Model and Image Processing 59, 6 (1997), 463–483.
[11]
G. Cordonnier, E. Galin, J. Gain, B. Benes, E. Guérin, A. Peytavie, and M.-P. Cani. 2017. Authoring landscapes by combining ecosystem and terrain erosion simulation. ACM Transactions on Graphics 36, 4 (2017), 1–12.
[12]
M. Dang, D. Ceylan, B. Neubert, and M. Pauly. 2014. SAFE: Structure-aware facade editing. Computer Graphics Forum 33, 2 (2014), 83–93.
[13]
M. Dang, S. Lienhard, D. Ceylan, B. Neubert, P. Wonka, and M. Pauly. 2015. Interactive design of probability density functions for shape grammars. ACM Transactions on Graphics 34, 6 (2015), 13 pages.
[14]
P. de Reffye, C. Edelin, J. Françon, M. Jaeger, and C. Puech. 1988. Plant models faithful to botanical structure and development. SIGGRAPH Computer Graphics 22, 4 (1988), 151–158.
[15]
O. Deussen, P. Hanrahan, B. Lintermann, R. Měch, M. Pharr, and P. Prusinkiewicz. 1998. Realistic modeling and rendering of plant ecosystems. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques. ACM, 275–286.
[16]
A. Emilien, U. Vimont, M.-P. Cani, P. Poulin, and B. Benes. 2015. WorldBrush: Interactive example-based synthesis of procedural virtual worlds. ACM Transactions on Graphics 34, 4(2015), 11 pages.
[17]
T. A Endreny. 2018. Strategically growing the urban forest will improve our world. Nature Communications 9, 1 (2018), 1160.
[18]
J. Gain, H. Long, G. Cordonnier, and M-P Cani. 2017. EcoBrush: Interactive control of visually consistent large-scale ecosystems. In Computer Graphics Forum 36, 2 (2017), 63–73.
[19]
G. W Grey. 1995. The Urban forest: Comprehensive Management. John Wiley & Sons.
[20]
P. Guehl, R. Allegre, J.-M. Dischler, B. Benes, and E. Galin. 2020. Semi-procedural textures using point process texture basis functions. Computer Graphics Forum 39, 4 (2020), 159–171. DOI:
[21]
É. Guérin, J. Digne, É. Galin, A. Peytavie, C. Wolf, B. Benes, and B. Martinez. 2017. Interactive example-based terrain authoring with conditional generative adversarial Networks. ACM Transactions on Graphics 36, 6 (2017), 13 pages.
[22]
J. Guo, H. Jiang, B. Benes, O. Deussen, D. Lischinski, and H. Huang. 2020. Inverse procedural modeling of branching structures by inferring l-systems. ACM Transactions on Graphics 39, 5 (2020), 1–13.
[23]
T. Hädrich, D. T. Banuti, W. Pałubicki, S. Pirk, and D. L. Michels. 2021. Fire in paradise: Mesoscale simulation of wildfires. ACM Transactions on Graphics 40, 4 (July 2021), 15 pages.
[24]
T. Hädrich, B. Benes, O. Deussen, and S. Pirk. 2017. Interactive modeling and authoring of climbing plants. Computer Graphics Forum 36, 2 (2017), 49–61.
[25]
Y. Hu, J. Dorsey, and H. Rushmeier. 2019. A novel framework for inverse procedural texture modeling. ACM Transactions on Graphics 38, 6 (2019), 1–14.
[26]
T. Ijiri, S. Owada, and T. Igarashi. 2006. Seamless integration of initial sketching and subsequent detail editing in flower modeling. Computer Graphics Forum 25, 3 (2006), 617–624.
[27]
M. Ilčík, P. Musialski, T. Auzinger, and M. Wimmer. 2015. Layer-based procedural design of Façades. Computer Graphics Forum 34, 2 (2015), 205–216.
[28]
P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. 2016. Image-to-image translation with conditional adversarial Networks. In Proceedings of the2017 IEEE Conference on Computer Vision and Pattern Recognition.5967–5976.
[29]
T. H. Kebrom. 2017. A growing stem inhibits bud outgrowth—the overlooked theory of apical dominance. Frontiers in Plant Science 8 (2017), 1874. DOI:
[30]
T. Kelly, J. Femiani, P. Wonka, and N. Mitra. 2017. BigSUR: Large-scale structured urban reconstruction. ACM Transactions on Graphics 36, 6 (2017), 1–16.
[31]
T. Kelly, P. Guerrero, A. Steed, P. Wonka, and N. J. Mitra. 2018. FrankenGAN: Guided detail synthesis for building mass models using style-synchonized GANs. ACM Transactions on Graphics 37, 6 (2018), 1:1–1:14.
[32]
A. Khan, A. Sohail, U. Zahoora, and A. Saeed. 2020. A survey of the recent architectures of deep convolutional neural networks.
[33]
J. Kratt, Mark Spicker, A. Guayaquil, M. Fišer, S. Pirk, O. Deussen, J. C. Hart, and B. Benes. 2015. Woodification: User-controlled cambial growth modeling. Computer Graphics Forum 34, 2 (2015), 361–372.
[34]
B. Li, J. Kałużny, J. Klein, D. L. Michels, W. Pałubicki, B. Benes, and S. Pirk. 2021. Learning to reconstruct botanical trees from single images. ACM Transaction on Graphics 40, 6 (2021), 1–15.
[35]
C. Li, O. Deussen, Y.-Z. Song, P. Willis, and P. Hall. 2011a. Modeling and generating moving trees from video. ACM Transactions on Graphics 30, 6(2011), 127:1–127:12 pages.
[36]
M. Li, A. G. Patil, K. Xu, S. Chaudhuri, O. Khan, A. Shamir, C. Tu, B. Chen, D. Cohen-Or, and H. Zhang. 2019. GRAINS: Generative recursive autoencoders for INdoor scenes. ACM Transactions on Graphics 38, 2 (Feb. 2019), 16 pages.
[37]
Y. Li, Q. Zheng, A. Sharf, D. Cohen-Or, B. Chen, and N. J. Mitra. 2011. 2D–3D fusion for layer decomposition of urban facades. In Proceedings of the 2011 International Conference on Computer Vision. 882–889.
[38]
A. Lindenmayer. 1968. Mathematical models for cellular interaction in development. Journal of Theoretical Biology Parts I and II, 18 (1968), 280–315. http://www.sciencedirect.com/science/article/pii/0022519368900805.
[39]
B. Lintermann and O. Deussen. 1999. Interactive modeling of plants. IEEE Computer Graphics and Applications 19, 1 (1999), 56–65.
[40]
Y. Livny, S. Pirk, Z. Cheng, F. Yan, O. Deussen, D. Cohen-Or, and B. Chen. 2011. Texture-lobes for tree modelling. ACM Transactions on Graphics 30, 4 (2011), 10 pages.
[41]
S. Longay, A. Runions, F. Boudon, and P. Prusinkiewicz. 2012. TreeSketch: Interactive procedural modeling of trees on a tablet. In Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling. 107–120.
[42]
M. Makowski, T. Hädrich, J. Scheffczyk, D. L. Michels, S. Pirk, and W. Palubicki. 2019. Synthetic silviculture: Multi-scale modeling of plant ecosystems. ACM Transactions on Graphics 38, 4 (2019), 14 pages.
[43]
A Martinovic and L Van Gool. 2013. Bayesian grammar learning for inverse procedural modeling. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 201–208.
[44]
P. Merrell and D. Manocha. 2008. Continuous model synthesis. ACM Transactions on Graphics 27, 5 (2008), 7 pages.
[45]
P. Merrell and D. Manocha. 2011. Model synthesis: A general procedural modeling algorithm. IEEE Transactions on Visualization and Computer Graphics 17, 6 (2011), 715–728.
[46]
R. W Miller, R. J Hauer, and L. P Werner. 2015. Urban Forestry: Planning and Managing Urban Greenspaces. Waveland press.
[47]
R. Minamino and M. Tateno. 2014. Tree branching: Leonardo da vinci’s rule versus biomechanical models. PloS One 9, 4 (2014), e93535.
[48]
S. Mitchell, A. Rand, M. Ebeida, and C. Bajaj. 2012. Variable radii poisson-disk sampling. In Proceedings of the24th Canadian Conference on Computational Geometry.
[49]
P. Müller, P. Wonka, S. Haegler, A. Ulmer, and L. Van Gool. 2006. Procedural modeling of buildings. ACM Transactions on Graphics 25, 3 (July 2006), 614–623.
[50]
P. Müller, G. Zeng, P. Wonka, and L. Van Gool. 2007. Image-based procedural modeling of facades. ACM Transactions on Graphics 26, 3(2007), 85 pages.
[51]
R. Měch and P. Prusinkiewicz. 1996. Visual models of plants interacting with their environment. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, New York, NY, 397–410.
[52]
G. Nishida, I. Garcia-Dorado, D. G. Aliaga, B. Benes, and A. Bousseau. 2016. Interactive sketching of urban procedural models. ACM Transactions on Graphics 35, 4 (2016), 130.
[53]
NYCOpenData. 2019. The next decade of open data. (2019). Retrieved 15 July, 2019 from https://data.ny.gov/.
[54]
M. Okabe, S. Owada, and T. Igarashi. 2007. Interactive design of botanical trees using freehand sketches and example-based editing. In Proceedings of the ACM SIGGRAPH Courses. ACM, 26 pages.
[55]
P. E. Oppenheimer. 1986. Real time design and animation of fractal plants and trees. ACM SIGGRAPH Computer Graphics 20, 4 (1986), 55–64.
[56]
W. Palubicki, K. Horel, S. Longay, A. Runions, B. Lane, R. Měch, and P. Prusinkiewicz. 2009. Self-organizing tree models for image synthesis. ACM Transactions on Graphics 28, 3 (2009), 10 pages.
[57]
Y. I. H. Parish and P. Müller. 2001. Procedural modeling of cities In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 301–308.
[58]
S. Pirk, B. Benes, T. Ijiri, Y. Li, O. Deussen, B. Chen, and R. Měch. 2016. Modeling plant life in computer graphics. In Proceedings of the ACM SIGGRAPH 2016 Courses. 180 pages.
[59]
S. Pirk, M. Jarząbek, T. Hädrich, D. L. Michels, and W. Palubicki. 2017. Interactive wood combustion for botanical tree models. ACM Transactions on Graphics 36, 6 (2017), 12 pages.
[60]
S. Pirk, T. Niese, O. Deussen, and B. Neubert. 2012a. Capturing and animating the morphogenesis of polygonal tree models. ACM Transactions on Graphics 31, 6 (2012), 10 pages.
[61]
S. Pirk, T. Niese, T. Hädrich, B. Benes, and O. Deussen. 2014. Windy trees: Computing stress response for developmental tree models. ACM Transactions on Graphics 33, 6 (2014), 11 pages.
[62]
S. Pirk, O. Stava, J. Kratt, M. A. M. Said, B. Neubert, R. Měch, B. Benes, and O. Deussen. 2012b. Plastic trees: Interactive self-adapting botanical tree models. ACM Transactions on Graphics 31, 4 (2012), 10 pages.
[63]
P. Prusinkiewicz. 1986. Graphical applications of l-systems. In Proceedings on Graphics Interface ’86/Vision Interface ’86. Canadian Information Processing Society, 247–253.
[64]
D. Ritchie, B. Mildenhall, N. D. Goodman, and P. Hanrahan. 2015. Controlling procedural modeling programs with stochastically-ordered sequential monte carlo. ACM Transactions on Graphics 34, 4 (2015), 105.
[65]
D. Ritchie, K. Wang, and Y.-A. Lin. 2018. Fast and flexible indoor scene synthesis via deep convolutional generative models. In Proceedings of theComputer Vision and Pattern Recognition. 6182–6190.
[66]
A. Runions, B. Lane, and P. Prusinkiewicz. 2007. Modeling trees with a space colonization algorithm. In Proceedings of the 3rd Eurographics Conference on Natural Phenomena. 63–70.
[67]
M. Schwarz and P. Müller. 2015. Advanced procedural modeling of architecture. ACM Transactions on Graphics 34, 4 (2015), 107:1–107:12.
[68]
R. M. Smelik, T. Tutenel, R. Bidarra, and B. Benes. 2014. A survey on procedural modelling for virtual worlds. Computer Graphics Forum 33, 6 (2014), 31–50.
[69]
O. Stava, B. Benes, R. Měch, D. G. Aliaga, and P. Kristof. 2010. Inverse procedural modeling by automatic generation of l-systems. Computer Graphics Forum 29, 2 (2010), 665–674.
[70]
O. Stava, S. Pirk, J. Kratt, B. Chen, R. Mech, O. Deussen, and B. Benes. 2014. Inverse procedural modelling of trees. Computer Graphics Forum 33, 6 (2014), 118–131.
[71]
J. O. Talton, Y. Lou, S. Lesser, J. Duke, R. Měch, and V. Koltun. 2011. Metropolis procedural modeling. ACM Transactions on Graphics 30, 2 (2011), 14 pages.
[72]
P. Tan, T. Fang, J. Xiao, P. Zhao, and L. Quan. 2008. Single image tree modeling. ACM Transactions on Graphics 27, 5 (2008), 7 pages.
[73]
P. Tan, G. Zeng, J. Wang, S. B. Kang, and L. Quan. 2007. Image-based tree modeling. ACM Transactions on Graphics 26, 3 (2007), 87 pages.
[74]
C. A. Vanegas, D. G. Aliaga, and B. Benes. 2010. Building reconstruction using manhattan-world grammars. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.358–365.
[75]
C. A. Vanegas, D. G. Aliaga, B. Benes, and P. A. Waddell. 2009. Interactive design of urban spaces using geometrical and behavioral modeling. In Proceedings of the ACM SIGGRAPH Asia. 10 pages.
[76]
C. A. Vanegas, D. G. Aliaga, P. Wonka, P. Müller, P. Waddell, and B. Watson. 2010b. Modelling the appearance and behaviour of urban spaces. Computer Graphics Forum 29, 1 (2010), 25–42.
[77]
C. A. Vanegas, I. Garcia-Dorado, D. G. Aliaga, B. Benes, and P. Waddell. 2012. Inverse design of urban procedural models. ACM Transactions on Graphics 31, 6 (Nov. 2012), 11 pages.
[78]
P. Waddell. 2002. UrbanSim: Modeling urban development for land use, transportation, and environmental planning. Journal of the American Planning Association 68, 3 (2002), 297–314.
[79]
P. Waddell, G. F. Ulfarsson, J. P. Franklin, and J. Lobb. 2007. Incorporating land use in metropolitan transportation planning. Transportation Research Part A: Policy and Practice 41, 5 (2007), 382–410.
[80]
B. Wang, Y. Zhao, and J. Barbič. 2017. Botanical materials based on biomechanics. ACM Transactions on Graphics 36, 4 (2017), 13 pages.
[81]
K. Wang, Y.-A. Lin, B. Weissmann, M. Savva, A. X. Chang, and D. Ritchie. 2019. PlanIT: Planning and instantiating indoor scenes with relation graph and spatial prior Networks. ACM Transactions on Graphics 38, 4 (2019), 15 pages.
[82]
B. Watson, P. Müller, O. Veryovka, A. Fuller, P. Wonka, and C. Sexton. 2008. Procedural urban modeling in practice. IEEE Computer Graphics and Applications 28, 3 (2008), 18–26.
[83]
B. Weber, P. Müller, P. Wonka, and M. Gross. 2009. Interactive geometric simulation of 4D cities. Computer Graphics Forum 28, 2 (2009), 481–492.
[84]
J. Wither, F. Boudon, M.-P. Cani, and C. Godin. 2009. Structure from silhouettes: A new paradigm for fast sketch-based design of trees. Computer Graphics Forum 28, 2 (2009), 541–550.
[85]
P. Wonka, M. Wimmer, F. Sillion, and W. Ribarsky. 2003. Instant architecture. ACM Transactions on Graphics 22, 3 (2003), 669–677.
[86]
F. Wu, D.-M. Yan, W. Dong, X. Zhang, and P. Wonka. 2014. Inverse procedural modeling of facade layouts. ACM Transactions on Graphics 33, 4 (2014), 10 pages.
[87]
X. Wu, K. Xu, and P. Hall. 2017. A survey of image synthesis and editing with generative adversarial networks. Tsinghua Science and Technology 22, 6 (2017), 660–674.
[88]
K. Xie, F. Yan, A. Sharf, D. Deussen, H. Huang, and B. Chen. 2016. Tree modeling with real tree-parts examples. IEEE Transactions on Visualization and Computer Graphics 22, 12 (2016), 2608–2618.
[89]
Y.-T. Yeh, K. Breeden, L. Yang, M. Fisher, and P. Hanrahan. 2013. Synthesis of tiled patterns using factor graphs. ACM Transactions on Graphics 32, 1 (2013), 13 pages.
[90]
H. Zeng, J. Wu, and Y. Furukawa. 2018. Neural procedural reconstruction for residential buildings. In European Conference on Computer Vision. 737–753.
[91]
H. Zhang, K. Xu, W. Jiang, J. Lin, D. Cohen-Or, and B. Chen. 2013. Layered analysis of irregular facades via symmetry maximization. ACM Transactions Graph. 32, 4 (July 2013), 13 pages.
[92]
Y. Zhao and J. Barbič. 2013. Interactive authoring of simulation-ready plants. ACM Transactions on Graphics 32, 4 (2013), 12 pages.

Cited By

View all
  • (2024)TreeDetector: Using Deep Learning for the Localization and Reconstruction of Urban Trees from High-Resolution Remote Sensing ImagesRemote Sensing10.3390/rs1603052416:3(524)Online publication date: 30-Jan-2024
  • (2024)Scintilla: Simulating Combustible Vegetation for WildfiresACM Transactions on Graphics10.1145/365819243:4(1-21)Online publication date: 19-Jul-2024
  • (2024)DeadWood: Including Disturbance and Decay in the Depiction of Digital NatureACM Transactions on Graphics10.1145/364181643:2(1-19)Online publication date: 14-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 41, Issue 2
April 2022
197 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3501283
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 March 2022
Accepted: 01 November 2021
Revised: 01 November 2021
Received: 01 January 2021
Published in TOG Volume 41, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Urban models
  2. vegetation
  3. procedural generation
  4. urban forestry

Qualifiers

  • Research-article
  • Refereed

Funding Sources

  • Deutsche Forschungsgemeinschaft (DFG)
  • National Science Foundation
  • Foundation for Food and Agriculture Research

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)223
  • Downloads (Last 6 weeks)15
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)TreeDetector: Using Deep Learning for the Localization and Reconstruction of Urban Trees from High-Resolution Remote Sensing ImagesRemote Sensing10.3390/rs1603052416:3(524)Online publication date: 30-Jan-2024
  • (2024)Scintilla: Simulating Combustible Vegetation for WildfiresACM Transactions on Graphics10.1145/365819243:4(1-21)Online publication date: 19-Jul-2024
  • (2024)DeadWood: Including Disturbance and Decay in the Depiction of Digital NatureACM Transactions on Graphics10.1145/364181643:2(1-19)Online publication date: 14-Feb-2024
  • (2024)Hierarchical Co‐generation of Parcels and Streets in Urban ModelingComputer Graphics Forum10.1111/cgf.1505343:2Online publication date: 27-Apr-2024
  • (2024)DeepTree: Modeling Trees With Situated LatentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.330788730:8(5795-5809)Online publication date: 1-Aug-2024
  • (2024)SVDTree: Semantic Voxel Diffusion for Single Image Tree Reconstruction2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00449(4692-4702)Online publication date: 16-Jun-2024
  • (2023)Tree-Structured Shading Decomposition2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.00051(488-498)Online publication date: 1-Oct-2023
  • (2023)Tree Instance Segmentation with Temporal Contour Graph2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00218(2193-2202)Online publication date: Jun-2023
  • (2023)When a tree model meets texture baking: an approach for quality-preserving lightweight visualization in virtual 3D scene constructionInternational Journal of Digital Earth10.1080/17538947.2023.217775816:1(645-670)Online publication date: Mar-2023
  • (2022)EcoclimatesACM Transactions on Graphics10.1145/3528223.353014641:4(1-19)Online publication date: 22-Jul-2022

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media