research-article

Representing and scheduling procedural generation using operator graphs

Authors:

Michael Kenzel,

Hans-Peter Seidel,

Dieter Schmalstieg, and

Markus SteinbergerAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 35, Issue 6

Article No.: 183, Pages 1 - 12

https://doi.org/10.1145/2980179.2980227

Published: 05 December 2016 Publication History

Abstract

In this paper, we present the concept of operator graph scheduling for high performance procedural generation on the graphics processing unit (GPU). The operator graph forms an intermediate representation that describes all possible operations and objects that can arise during a specific procedural generation. While previous methods have focused on parallelizing a specific procedural approach, the operator graph is applicable to all procedural generation methods that can be described by a graph, such as L-systems, shape grammars, or stack based generation methods. Using the operator graph, we show that all partitions of the graph correspond to possible ways of scheduling a procedural generation on the GPU, including the scheduling strategies of previous work. As the space of possible partitions is very large, we describe three search heuristics, aiding an optimizer in finding the fastest valid schedule for any given operator graph. The best partitions found by our optimizer increase performance of 8 to 30x over the previous state of the art in GPU shape grammar and L-system generation.

Supplementary Material

ZIP File (a183-boechat.zip)

Supplemental file.

Download
133.62 MB

References

[1]

Beneš, B., Štava, O., Měch, R., and Miller, G. 2011. Guided Procedural Modeling. Comp. Graph. Forum 30, 2, 325--334.

[2]

Guerrero, P., Jeschke, S., Wimmer, M., and Wonka, P. 2015. Learning shape placements by example. ACM Trans. Graph. 34, 4 (July), 108:1--108:13.

Digital Library

[3]

Haegler, S., Wonka, P., Arisona, S. M., Gool, L. J. V., and Müller, P. 2010. Grammar-based Encoding of Facades. Comp. Graph. Forum 29, 4, 1479--1487.

Digital Library

[4]

Havemann, S. 2005. Generative Mesh Modeling. PhD thesis, TU Braunschweig.

[5]

He, Y., Foley, T., Tatarchuk, N., and Fatahalian, K. 2015. A system for rapid, automatic shader level-of-detail. ACM Trans. Graph. 34, 6 (Oct.), 187:1--187:12.

Digital Library

[6]

Krecklau, L., and Kobbelt, L. 2011. Procedural Modeling of Interconnected Structures. Comp. Graph. Forum 30.

[7]

Krecklau, L., Pavic, D., and Kobbelt, L. 2011. Generalized Use of Non-Terminal Symbols for Procedural Modeling. Comp. Graph. Forum 29, 2291--2303.

[8]

Krejcie, R. V., and Morgan, D. W. 1970. Determining sample size for research activities. Educ Psychol Meas.

[9]

Lacz, P., and Hart, J. 2004. Procedural Geometry Synthesis on the GPU. In Workshop on General Purpose Computing on Graphics Processors, 23--23.

[10]

Li, Y., Bao, F., Zhang, E., Kobayashi, Y., and Wonka, P. 2011. Geometry Synthesis on Surfaces Using Field-Guided Shape Grammars. IEEE Trans. Visualization and Computer Graphics 17, 2, 231--243.

Digital Library

[11]

Lipp, M., Wonka, P., and Wimmer, M. 2010. Parallel Generation of Multiple L-systems. Computers & Graphics 34, 5, 585--593.

Digital Library

[12]

Magdics, M. 2009. Real-time Generation of L-system Scene Models for Rendering and Interaction. In Spring Conf. on Computer Graphics, Comenius Univ., 77--84.

Digital Library

[13]

Marvie, J.-E., Pascal, G., Hirtzlin, P., and Gael, S. 2011. Render-Time Procedural Per-Pixel Geometry Generation. In Graphics Interface, 167--174.

Digital Library

[14]

Marvie, J.-E., Buron, C., Gautron, P., Hirtzlin, P., and Sourimant, G. 2012. GPU Shape Grammars. Comp. Graph. Forum 31, 7-1, 2087--2095.

Digital Library

[15]

Mullapudi, R. T., Adams, A., Sharlet, D., Ragan-Kelley, J., and Fatahalian, K. 2016. Automatically scheduling Halide image processing pipelines. ACM Trans. Graph. 35, 4 (July), 83:1--83:11.

Digital Library

[16]

Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Gool, L. V. 2006. Procedural Modeling of Buildings. ACM Trans. Graph. 25, 3, 614--623.

Digital Library

[17]

Parish, Y. I. H., and Müller, P. 2001. Procedural modeling of cities. In Proc. SIGGRAPH 2001, 301--308.

Digital Library

[18]

Parker, S. G., Bigler, J., Dietrich, A., Friedrich, H., Hoberock, J., Luebke, D., McAllister, D., McGuire, M., Morley, K., Robison, A., and Stich, M. 2010. Optix: A general purpose ray tracing engine. ACM Trans. Graph. 29, 4 (July), 66:1--66:13.

Digital Library

[19]

Patney, A., Tzeng, S., Seitz, Jr., K. A., and Owens, J. D. 2015. Piko: A framework for authoring programmable graphics pipelines. ACM Trans. Graph. 34, 4 (July), 147:1--147:13.

Digital Library

[20]

Patow, G. 2012. User-friendly graph editing for procedural modeling of buildings. Computer Graphics and Applications, IEEE 32, 2 (March), 66--75.

Digital Library

[21]

Prusinkiewicz, P., and Lindenmayer, A. 1990. The Algorithmic Beauty of Plants. Springer-Verlag.

Digital Library

[22]

Prusinkiewicz, P., James, M., and Měch, R. 1994. Synthetic Topiary. In Proc. SIGGRAPH 94, 351--358.

Digital Library

[23]

Ragan-Kelley, J., Adams, A., Paris, S., Levoy, M., Amarasinghe, S., and Durand, F. 2012. Decoupling algorithms from schedules for easy optimization of image processing pipelines. ACM Trans. Graph. 31, 4 (July), 32:1--32:12.

Digital Library

[24]

Ritchie, D., Mildenhall, B., Goodman, N. D., and Hanrahan, P. 2015. Controlling procedural modeling programs with stochastically-ordered sequential monte carlo. ACM Transactions on Graphics (TOG) 34, 4, 105.

Digital Library

[25]

Schwarz, M., and Müller, P. 2015. Advanced procedural modeling of architecture. ACM Trans. Graph. 34, 4 (July), 107:1--107:12.

Digital Library

[26]

Steinberger, M., Kenzel, M., Boechat, P., Kerbl, B., Dokter, M., and Schmalstieg, D. 2014. Whippletree: Task-based scheduling of dynamic workloads on the GPU. ACM Trans. Graph. 33, 6, 228:1--228:11.

Digital Library

[27]

Steinberger, M., Kenzel, M., Kainz, B., Müller, J., Wonka, P., and Schmalstieg, D. 2014. Parallel generation of architecture on the GPU. Computer Graphics Forum 33, 2, 73--82.

Digital Library

[28]

Steinberger, M., Kenzel, M., Kainz, B., Wonka, P., and Schmalstieg, D. 2014. On-the-fly generation and rendering of infinite cities on the GPU. Computer Graphics Forum 33, 2, 105--114.

Digital Library

[29]

Stiny, G. 1975. Pictorial and Formal Aspects of Shape and Shape Grammars. Birkhauser Verlag.

[30]

Stiny, G. 1982. Spatial Relations and Grammars. Environment and Planning B 9, 313--314.

[31]

Sugerman, J., Fatahalian, K., Boulos, S., Akeley, K., and Hanrahan, P. 2009. GRAMPS: A programming model for graphics pipelines. ACM Trans. Graph. 28, 1 (Feb.), 4:1--4:11.

Digital Library

[32]

Sussman, G., Abelson, H., and Sussman, J., 1983. Structure and interpretation of computer programs.

Digital Library

[33]

Talton, J. O., Lou, Y., Lesser, S., Duke, J., Měch, R., and Koltun, V. 2011. Metropolis Procedural Modeling. ACM Trans. Graph. 30, 11:1--11:14.

Digital Library

[34]

Wadge, W. W., and Ashcroft, E. A. 1985. Lucid, the dataflow programming langugage1. Academic Press.

Digital Library

[35]

Wonka, P., Wimmer, M., Sillion, F. X., and Ribarsky, W. 2003. Instant Architecture. ACM Trans. Graph. 22, 669--677.

Digital Library

Cited By

Makatura LWang BChen YDeng BWojtan CBickel BMatusik W(2023)Procedural Metamaterials: A Unified Procedural Graph for Metamaterial DesignACM Transactions on Graphics10.1145/360538942:5(1-19)Online publication date: 28-Jul-2023
https://doi.org/10.1145/3605389
Krs VMech RGaillard MCarr NBenes B(2021)PICO: Procedural Iterative Constrained Optimizer for Geometric ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.299555627:10(3968-3981)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TVCG.2020.2995556
Ahmad MRagan-Kelley JCheung AKamil S(2019)Automatically translating image processing libraries to halideACM Transactions on Graphics10.1145/3355089.335654938:6(1-13)Online publication date: 8-Nov-2019
https://dl.acm.org/doi/10.1145/3355089.3356549
Show More Cited By

Index Terms

Representing and scheduling procedural generation using operator graphs
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Graphics processors
  2. Parallel computing methodologies
    1. Parallel algorithms
      1. Massively parallel algorithms

Recommendations

Scheduling of pipelined operator graphs

We investigate a class of scheduling problems that arise in the optimization of SQL queries for parallel machines (Chekuri et al. in PODS'95, pp. 255---265, 1995). In these problems, an undirected graph is used to represent communication and inter-...
Read More
clSpMV: A Cross-Platform OpenCL SpMV Framework on GPUs
ICS '12: Proceedings of the 26th ACM international conference on Supercomputing

Sparse matrix vector multiplication (SpMV) kernel is a key computation in linear algebra. Most iterative methods are composed of SpMV operations with BLAS1 updates. Therefore, researchers make extensive efforts to optimize the SpMV kernel in sparse ...
Read More
Procedural generation of stylized 2D maps
ACE '07: Proceedings of the international conference on Advances in computer entertainment technology

Outdoor worlds are often the setting for games and game worlds are often accompanied by a stylized version of the world drawn by an artist as a 2D map. Procedurally generating the terrain allows games to have a higher replay value. A limitation of ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 35, Issue 6

November 2016

1045 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2980179

Issue’s Table of Contents

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2016

Published in TOG Volume 35, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Max Planck Center for Visual Computing and Communication

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
450
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Makatura LWang BChen YDeng BWojtan CBickel BMatusik W(2023)Procedural Metamaterials: A Unified Procedural Graph for Metamaterial DesignACM Transactions on Graphics10.1145/360538942:5(1-19)Online publication date: 28-Jul-2023
https://doi.org/10.1145/3605389
Krs VMech RGaillard MCarr NBenes B(2021)PICO: Procedural Iterative Constrained Optimizer for Geometric ModelingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.299555627:10(3968-3981)Online publication date: 1-Oct-2021
https://doi.org/10.1109/TVCG.2020.2995556
Ahmad MRagan-Kelley JCheung AKamil S(2019)Automatically translating image processing libraries to halideACM Transactions on Graphics10.1145/3355089.335654938:6(1-13)Online publication date: 8-Nov-2019
https://dl.acm.org/doi/10.1145/3355089.3356549
Klein TAutin LKozlikova BGoodsell DOlson AGroller MViola I(2018)Instant Construction and Visualization of Crowded Biological EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.274425824:1(862-872)Online publication date: Jan-2018
https://doi.org/10.1109/TVCG.2017.2744258
Steinberger M(2018)On Dynamic Scheduling for the GPU and its Applications in Computer Graphics and BeyondIEEE Computer Graphics and Applications10.1109/MCG.2018.03242165938:3(119-130)Online publication date: May-2018
https://doi.org/10.1109/MCG.2018.032421659
Haubenwallner KSeidel HSteinberger M(2017)ShapeGeneticsComputer Graphics Forum10.1111/cgf.1312036:2(213-223)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1111/cgf.13120

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents