research-article

Modeling and generating moving trees from video

Authors:

Oliver Deussen,

Peter HallAuthors Info & Claims

SA '11: Proceedings of the 2011 SIGGRAPH Asia Conference

Article No.: 127, Pages 1 - 12

https://doi.org/10.1145/2024156.2024161

Published: 12 December 2011 Publication History

Abstract

We present a probabilistic approach for the automatic production of tree models with convincing 3D appearance and motion. The only input is a video of a moving tree that provides us an initial dynamic tree model, which is used to generate new individual trees of the same type. Our approach combines global and local constraints to construct a dynamic 3D tree model from a 2D skeleton. Our modeling takes into account factors such as the shape of branches, the overall shape of the tree, and physically plausible motion. Furthermore, we provide a generative model that creates multiple trees in 3D, given a single example model. This means that users no longer have to make each tree individually, or specify rules to make new trees. Results with different species are presented and compared to both reference input data and state of the art alternatives.

Supplementary Material

Supplemental material. (a127-li.zip)

Download
144.85 MB

References

[1]

Akagi, Y., and Kitajima, K. 2006. Computer animations of swaying trees based on physical animation. Computers and Graphics 30, 4, 529--539.

[2]

Anastacio, F., Sousa, M. C., Samavati, F., and Jorge, J. A. 2006. Modeling plant structures using concept sketches. Proceedings of the 4th international symposium on Non-photorealistic animation and rendering, 105--113.

Digital Library

[3]

Bishop, C. 2006. Pattern Recognition and Machine Learning. Springer-Velrag.

Digital Library

[4]

Chen, X., Neubert, B., Xu, Y.-Q., Deussen, O., and Kang, S. B. 2008. Sketch-based tree modeling using markov random field. ACM Trans. Graph. 27, 5, 1--9.

Digital Library

[5]

Deussen, O., and Lintermann, B. 2005. Digital Design of Nature: Computer Generated Plants and Organics. SpringerVerlag.

Digital Library

[6]

Diener, J., Reveret, L., and Fiume, E. 2006. Hierarchical retargetting of 2d motion fields to the animation of 3d plant models. ACM SIGGRAPH/Eurographics Symposium on Computer animation, 187--195.

Digital Library

[7]

Diener, J., Rodriguez, M., Baboud, L., and Reveret, L. 2009. Wind projection basis for real-time animation of trees. Computer Graphics Forum (Proceedings Eurographics 2009) 28, 2, 533--540.

[8]

Flash, T., and Hogan, N. 1984. The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience 5, 1688--1703.

[9]

Habel, R., Kusternig, A., and Wimmer, M. 2009. Physically guided animation of trees. Computer Graphics Forum (Proceedings Eurographics 2009) 28, 2, 523--532.

[10]

Harris, C., and Stephens, M. 1988. In Proc. 4th Alvey Vision Conference, 189--192.

[11]

Lindenmayer, A. 1968. Mathematical models for cellular interactions in development ii. simple and branching filaments with two-sided inputs. Journal of Theoretical Biology 18, 3, 300--315.

[12]

Lintermann, B., and Deussen, O. 1999. Interactive modeling of plants. IEEE Computer Graphics and Applications 19, 1, 56--65.

Digital Library

[13]

Liu, C., Torralba, A., Freeman, W. T., Durand, F., and Adelson, E. H. 2005. Motion magnification. In ACM SIGGRAPH, 519--526.

Digital Library

[14]

Livny, Y., Yan, F., Olson, M., Chen, B., Zhang, H., and El-Sana, J. 2010. Automatic reconstruction of tree skeletal structures from point clouds. ACM Trans. Graph. 29 (December), 151:1--151:8.

Digital Library

[15]

Livny, Y., Pirk, S., Cheng, Z., Yan, F., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Texture-lobes for tree modeling. ACM Siggraph, to appear.

Digital Library

[16]

Lucas, B. D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, 674--679.

Digital Library

[17]

Minka, T. P. 2003. Estimating a dirichlet distribution. M.I.T Technical report.

[18]

Neubert, B., Franken, T., and Deussen, O. 2007. Approximate image-based tree-modeling using particle flows. ACM Trans. Graph. 26, 3, 88--95.

Digital Library

[19]

Okabe, M., Owada, S., and Igarashi, T. 2005. Interactive design of botanical trees using freehand sketches and example-based editing. Comput. Graph. Forum 24, 3, 487--496.

[20]

Ota, S., Tamura, M., Fujimoto, T., and K, M. 2004. A hybrid method for the real-time animation of trees swaying in wind fields. The Visual Computer 20, 11, 613--623.

Digital Library

[21]

Palubicki, W., Horel, K., Longay, S., Runions, A., Lane, B., Měch, R., and Prusinkiewicz, P. 2009. Self-organizing tree models for image synthesis. ACM SIGGRAPH, 1--10.

Digital Library

[22]

Prusinkiewicz, P., and Lindenmayer, A. 1990. The algorithmic beauty of plants. Springer-Verlag.

Digital Library

[23]

Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J., and Kang, S. B. 2006. Image-based plant modeling. ACM Trans. Graph. 25, 3, 599--604.

Digital Library

[24]

Reche-Martinez, A., Martin, I., and Drettakis, G. 2004. Volumetric reconstruction and interactive rendering of trees from photographs. ACM Trans. Graph. 23, 3, 720--727.

Digital Library

[25]

Sakaguchi, T., and Ohya, J. 1999. Modeling and animation of botanical trees for interactive virtual environments. In ACM symposium on Virtual reality software and technology, 139--146.

Digital Library

[26]

Shi, J., and Malik, J. 2000. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22, 8, 888--905.

Digital Library

[27]

Shinya, M., and A, F. 1992. Stochastic motion-motion under the influence of wind. Computer Graphics Forum 11, 3, 119--128.

[28]

Shlyakhter, I., Rozenoer, M., Dorsey, J., and Teller, S. 2001. Reconstructing 3d tree models from instrumented photographs. IEEE Comput. Graph. Appl. 21, 3, 53--61.

Digital Library

[29]

Sun, M., Jepson., A. D., and Fiume, E. 2003. Video input driven animation (vida). In Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2, 96--103.

Digital Library

[30]

Talton, J. O., Lou, Y., Lesser, S., Duke, L, Mech, R., and Koltun, V 2011. Metropolis procedural modeling. ACM Tran-s. Graph. 30, 11:1--11:14.

Digital Library

[31]

Tan, P., Zeng, G., Wang, L, Kang, S. B., and Quan, L. 2007. Image-based tree modeling. In ACM SIGGRAPH, 87--93.

Digital Library

[32]

Tan, P., Fang, T., Xiao, L, Zhao, P., and Quan, L. 2008. Single image tree modeling. ACM Trans. Graph. 27, 5, 1--7.

Digital Library

[33]

Wessélen, D., and Seipel, S. 2005. Real-time visualisation of animated trees. The Visual Computer 21, 6, 397--405.

[34]

Xu, FL, Gossett, N., and Chen, B. 2007. Knowledge and heuristic-based modeling of laser-scanned trees. ACM Trans. Gr 26, 4, 19--31.

Digital Library

Cited By

Li CKan J(2019)An improvement approach for pixel-based illumination estimation algorithmsTenth International Conference on Signal Processing Systems10.1117/12.2520825(27)Online publication date: 17-Apr-2019
https://doi.org/10.1117/12.2520825
Wang GLaga HJia JXie NTabia H(2018)Statistical Modeling of the 3D Geometry and Topology of Botanical TreesComputer Graphics Forum10.1111/cgf.1350137:5(185-198)Online publication date: 8-Aug-2018
https://doi.org/10.1111/cgf.13501
Quigley EYu YHuang JLin WFedkiw R(2018)Real-Time Interactive Tree AnimationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.266130824:5(1717-1727)Online publication date: 1-May-2018
https://doi.org/10.1109/TVCG.2017.2661308
Show More Cited By

Index Terms

Modeling and generating moving trees from video
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Image manipulation
    2. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Modeling and generating moving trees from video

We present a probabilistic approach for the automatic production of tree models with convincing 3D appearance and motion. The only input is a video of a moving tree that provides us an initial dynamic tree model, which is used to generate new individual ...
Generating functions for multi-labeled trees

Multi-labeled trees are a generalization of phylogenetic trees that are used, for example, in the study of gene versus species evolution and as the basis for phylogenetic network construction. Unlike phylogenetic trees, in a leaf-multi-labeled tree it ...
Rank-Balanced Trees

Since the invention of AVL trees in 1962, many kinds of binary search trees have been proposed. Notable are red-black trees, in which bottom-up rebalancing after an insertion or deletion takes O(1) amortized time and O(1) rotations worst-case. But the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SA '11: Proceedings of the 2011 SIGGRAPH Asia Conference

December 2011

730 pages

ISBN:9781450308076

DOI:10.1145/2024156

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Engineering and Physical Sciences Research Council

Conference

SA '11

Sponsor:

SIGGRAPH

SA '11: SIGGRAPH Asia 2011

December 12 - 15, 2011

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
1,160
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li CKan J(2019)An improvement approach for pixel-based illumination estimation algorithmsTenth International Conference on Signal Processing Systems10.1117/12.2520825(27)Online publication date: 17-Apr-2019
https://doi.org/10.1117/12.2520825
Wang GLaga HJia JXie NTabia H(2018)Statistical Modeling of the 3D Geometry and Topology of Botanical TreesComputer Graphics Forum10.1111/cgf.1350137:5(185-198)Online publication date: 8-Aug-2018
https://doi.org/10.1111/cgf.13501
Quigley EYu YHuang JLin WFedkiw R(2018)Real-Time Interactive Tree AnimationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.266130824:5(1717-1727)Online publication date: 1-May-2018
https://doi.org/10.1109/TVCG.2017.2661308
Ji LGooch AGammon LWyvill BSezgin MRosin P(2015)Rendering artistic light patternsProceedings of the workshop on Computational Aesthetics10.5555/2811239.2811241(1-13)Online publication date: 20-Jun-2015
https://dl.acm.org/doi/10.5555/2811239.2811241
Hall P(2014)Introduction to machine learning for computer graphicsACM SIGGRAPH 2014 Courses10.1145/2614028.2615461(1-33)Online publication date: 27-Jul-2014
https://dl.acm.org/doi/10.1145/2614028.2615461
Long JJones M(2013)Reconstructing 3D tree models using motion capture and particle flowInternational Journal of Computer Games Technology10.1155/2013/3631602013(5-5)Online publication date: 1-Jan-2013
https://dl.acm.org/doi/10.1155/2013/363160
Kim JCho H(2012)Efficient modeling of numerous trees by introducing growth volume for real-time virtual ecosystemsComputer Animation and Virtual Worlds10.1002/cav.143823:3-4(155-165)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1002/cav.1438

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents