research-article

Motion field texture synthesis

Authors:

Kun ZhouAuthors Info & Claims

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

Article No.: 110, Pages 1 - 8

https://doi.org/10.1145/1661412.1618456

Published: 01 December 2009 Publication History

Abstract

A variety of animation effects such as herds and fluids contain detailed motion fields characterized by repetitive structures. Such detailed motion fields are often visually important, but tedious to specify manually or expensive to simulate computationally. Due to the repetitive nature, some of these motion fields (e.g. turbulence in fluids) could be synthesized by procedural texturing, but procedural texturing is known for its limited generality.

We apply example-based texture synthesis for motion fields. Our technique is general and can take on a variety of user inputs, including captured data, manual art, and physical/procedural simulation. This data-driven approach enables artistic effects that are difficult to achieve via previous methods, such as heart shaped swirls in fluid animation. Due to the use of texture synthesis, our method is able to populate a large output field from a small input exemplar, imposing minimum user workload. Our algorithm also allows the synthesis of output motion fields not only with the same dimension as the input (e.g. 2D to 2D) but also of higher dimension, such as 3D volumetric outputs from 2D planar inputs. This cross-dimension capability supports a convenient usage scenario, i.e. the user could simply supply 2D images and our method produces a 3D motion field with similar characteristics. The motion fields produced by our method are generic, and could be combined with a variety of large-scale low-resolution motions that are easy to specify either manually or computationally but lack the repetitive structures to be characterized as textures. We apply our technique to a variety of animation phenomena, including smoke, liquid, and group motion.

Supplementary Material

Supplemental material. (110-ma.zip)

Download
95.62 MB

References

[1]

Ashikhmin, M. 2001. Synthesizing natural textures. In SI3D '01, 217--226.

Digital Library

[2]

Bargteil, A. W., Sin, F., Michaels, J. E., Goktekin, T. G., and O'Brien, J. F. 2006. A texture synthesis method for liquid animations. In SCA '06, 345--351.

Digital Library

[3]

Bhat, K. S., Seitz, S. M., Hodgins, J. K., and Khosla, P. K. 2004. Flow-based video synthesis and editing. In SIGGRAPH '04, 360--363.

Digital Library

[4]

Bridson, R., and Müller-Fischer, M. 2007. Fluid simulation: Siggraph 2007 course notes. 1--81.

Digital Library

[5]

Bridson, R., Houriham, J., and Nordenstam, M. 2007. Curl-noise for procedural fluid flow. In SIGGRAPH '07, 46:1--3.

Digital Library

[6]

Cabral, B., and Leedom, L. C. 1993. Imaging vector fields using line integral convolution. In SIGGRAPH '93, 263--270.

Digital Library

[7]

Chuang, Y.-Y., Goldman, D. B., Zheng, K. C., Curless, B., Salesin, D. H., and Szeliski, R. 2005. Animating pictures with stochastic motion textures. In SIGGRAPH '05, 853--860.

Digital Library

[8]

Dong, Y., Lefebvre, S., Tong, X., and Drettakis, G. 2008. Lazy solid texture synthesis. In EGSR '08, 1165--1174.

Digital Library

[9]

Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH '01, 341--346.

Digital Library

[10]

Fattal, R., and Lischinski, D. 2004. Target-driven smoke animation. In SIGGRAPH '04, 441--448.

Digital Library

[11]

Fedkiw, R., Stam, J., and Jensen, H. W. 2001. Visual simulation of smoke. In SIGGRAPH '01, 15--22.

Digital Library

[12]

Fidaner, I. B., 2008. A survey on variational image inpainting, texture synthesis and image completion. http://www.scribd.com/doc/3012627/.

[13]

Fisher, M., Schröder, P., Desbrun, M., and Hoppe, H. 2007. Design of tangent vector fields. In SIGGRAPH '07, 56:1--9.

Digital Library

[14]

Han, J., Zhou, K., Wei, L.-Y., Gong, M., Bao, H., Zhang, X., and Guo, B. 2006. Fast example-based surface texture synthesis via discrete optimization. Vis. Comput. 22, 9, 918--925.

Digital Library

[15]

Hong, J.-M., Lee, H.-Y., Yoon, J.-C., and Kim, C.-H. 2008. Bubbles alive. In SIGGRAPH '08, 48:1--4.

Digital Library

[16]

Kim, T., Thürey, N., James, D., and Gross, M. 2008. Wavelet turbulence for fluid simulation. In SIGGRAPH '08, 50:1--6.

Digital Library

[17]

Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., and Wong, T.-T. 2007. Solid texture synthesis from 2d exemplars. In SIGGRAPH '07, 2:1--10.

Digital Library

[18]

Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. In SIGGRAPH '05, 795--802.

Digital Library

[19]

Kwatra, V., Adalsteinsson, D., Kim, T., Kwatra, N., Carlson, M., and Lin, M. 2007. Texturing fluids. IEEE TVCG 13, 5, 939--952.

Digital Library

[20]

Kyriakou, M., and Chrysanthou, Y. 2008. Texture synthesis based simulation of secondary agents. In Motion in Games, 1--10.

Digital Library

[21]

Li, Y., Wang, T., and Shum, H.-Y. 2002. Motion texture: a two-level statistical model for character motion synthesis. In SIGGRAPH '02, 465--472.

Digital Library

[22]

Liang, L., Liu, C., Xu, Y.-Q., Guo, B., and Shum, H.-Y. 2001. Real-time texture synthesis by patch-based sampling. ACM TOG 20, 3, 127--150.

Digital Library

[23]

Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. In SIGGRAPH '04, 368--376.

Digital Library

[24]

Long, B., and Reinhard, E. 2009. Real-time fluid simulation using discrete sine/cosine transforms. In SI3D '09, 99--106.

Digital Library

[25]

McNamara, A., Treuille, A., Popović, Z., and Stam, J. 2004. Fluid control using the adjoint method. In SIGGRAPH '04, 449--456.

Digital Library

[26]

Narain, R., Kwatra, V., Lee, H., Kim, T., Carlson, M., and Lin, M. 2007. Feature-guided dynamic texture synthesis on continuous flows. In EGSR '07, 361--370.

Digital Library

[27]

Narain, R., Sewall, J., Carlson, M., and Lin, M. C. 2008. Fast animation of turbulence using energy transport and procedural synthesis. In SIGGRAPH Asia '08, 166:1--8.

Digital Library

[28]

Okabe, M., Anjyo, K., Igarashi, T., and Seidel, H.-P. 2009. Animating pictures of fluid using video examples. In Eurographics '09, 677--686.

[29]

Palacios, J., and Zhang, E. 2007. Rotational symmetry field design on surfaces. In SIGGRAPH '07, 55:1--10.

Digital Library

[30]

Pullen, K., and Bregler, C. 2002. Motion capture assisted animation: texturing and synthesis. In SIGGRAPH '02, 501--508.

Digital Library

[31]

Reynolds, C. W. 1987. Flocks, herds and schools: A distributed behavioral model. In SIGGRAPH '87, 25--34.

Digital Library

[32]

Schechter, H., and Bridson, R. 2008. Evolving sub-grid turbulence for smoke animation. In SCA '08, 1--7.

Digital Library

[33]

Stam, J. 1999. Stable fluids. In SIGGRAPH '99, 121--128.

Digital Library

[34]

Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. In SIGGRAPH '02, 665--672.

Digital Library

[35]

Tong, Y., Lombeyda, S., Hirani, A. N., and Desbrun, M. 2003. Discrete multiscale vector field decomposition. In SIGGRAPH '03, 445--452.

Digital Library

[36]

Treuille, A., Cooper, S., and Popović, Z. 2006. Continuum crowds. In SIGGRAPH '06, 1160--1168.

Digital Library

[37]

Turk, G. 2001. Texture synthesis on surfaces. In SIGGRAPH '01, 347--354.

Digital Library

[38]

van den Berg, J., Patil, S., Sewall, J., Manocha, D., and Lin, M. 2008. Interactive navigation of multiple agents in crowded environments. In SI3D '08, 139--147.

Digital Library

[39]

van der Laan, W. J., Green, S., and Sainz, M. 2009. Screen space fluid rendering with curvature flow. In SI3D '09, 91--98.

Digital Library

[40]

Wang, L., Yu, Y., Zhou, K., and Guo, B. 2009. Example-based hair geometry synthesis. In SIGGRAPH '09, 56:1--9.

Digital Library

[41]

Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In SIGGRAPH '01, 355--360.

Digital Library

[42]

Wei, L.-Y., Lefebvre, S., Kwatra, V., and Turk, G. 2009. State of the art in example-based texture synthesis. In EG STAR, 93--117.

[43]

Yuksel, C., House, D. H., and Keyser, J. 2007. Wave particles. In SIGGRAPH '07, 99:1--8.

Digital Library

Cited By

Kim JLee J(2020)Synthesizing Large‐Scale Fluid Simulations with Surface and Wave Foams via Sharp Wave Pattern and Cloudy FoamComputer Animation and Virtual Worlds10.1002/cav.198432:2Online publication date: 4-Dec-2020
https://doi.org/10.1002/cav.1984
Kim JLee JCha SKim C(2017)Efficient Representation of Detailed Foam Waves by Incorporating Projective SpaceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.260942923:9(2056-2068)Online publication date: 28-Jul-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2609429
Liu XJiang LWong TFu C(2012)Statistical Invariance for Texture SynthesisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.7518:11(1836-1848)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.75
Show More Cited By

Index Terms

Motion field texture synthesis
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Shape representations
  2. Computer graphics
    1. Animation
    2. Image manipulation
      1. Texturing

Recommendations

Motion field texture synthesis

A variety of animation effects such as herds and fluids contain detailed motion fields characterized by repetitive structures. Such detailed motion fields are often visually important, but tedious to specify manually or expensive to simulate ...
Motion texture: a two-level statistical model for character motion synthesis

In this paper, we describe a novel technique, called motion texture, for synthesizing complex human-figure motion (e.g., dancing) that is statistically similar to the original motion captured data. We define motion texture as a set of motion textons and ...
Motion texture: a two-level statistical model for character motion synthesis
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

In this paper, we describe a novel technique, called motion texture, for synthesizing complex human-figure motion (e.g., dancing) that is statistically similar to the original motion captured data. We define motion texture as a set of motion textons and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH Asia '09: ACM SIGGRAPH Asia 2009 papers

December 2009

669 pages

ISBN:9781605588582

DOI:10.1145/1661412

Conference Chair:
Masa Inakage
Keio University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SA09

Sponsor:

SIGGRAPH

SA09: SIGGRAPH ASIA 2009

December 16 - 19, 2009

Yokohama, Japan

Acceptance Rates

SIGGRAPH Asia '09 Paper Acceptance Rate 70 of 275 submissions, 25%;

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
1,184
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim JLee J(2020)Synthesizing Large‐Scale Fluid Simulations with Surface and Wave Foams via Sharp Wave Pattern and Cloudy FoamComputer Animation and Virtual Worlds10.1002/cav.198432:2Online publication date: 4-Dec-2020
https://doi.org/10.1002/cav.1984
Kim JLee JCha SKim C(2017)Efficient Representation of Detailed Foam Waves by Incorporating Projective SpaceIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2016.260942923:9(2056-2068)Online publication date: 28-Jul-2017
https://dl.acm.org/doi/10.1109/TVCG.2016.2609429
Liu XJiang LWong TFu C(2012)Statistical Invariance for Texture SynthesisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.7518:11(1836-1848)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.75
Ma CWei LTong X(2011)Discrete element texturesACM SIGGRAPH 2011 papers10.1145/1964921.1964957(1-10)Online publication date: 7-Aug-2011
https://dl.acm.org/doi/10.1145/1964921.1964957
He SWong HWong U(2011)An Efficient Adaptive Vortex Particle Method for Real-Time Smoke SimulationProceedings of the 2011 12th International Conference on Computer-Aided Design and Computer Graphics10.1109/CAD/Graphics.2011.69(317-324)Online publication date: 15-Sep-2011
https://dl.acm.org/doi/10.1109/CAD/Graphics.2011.69
Zhu BYang XFan Y(2010)Creating and Preserving Vortical Details in SPH FluidComputer Graphics Forum10.1111/j.1467-8659.2010.01809.x29:7(2207-2214)Online publication date: 18-Oct-2010
https://doi.org/10.1111/j.1467-8659.2010.01809.x

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents