Article

Flow-based video synthesis and editing

Authors:

Kiran S. Bhat,

Steven M. Seitz,

Jessica K. Hodgins,

Pradeep K. KhoslaAuthors Info & Claims

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Pages 360 - 363

https://doi.org/10.1145/1186562.1015729

Published: 01 August 2004 Publication History

Get Access

Abstract

This paper presents a novel algorithm for synthesizing and editing video of natural phenomena that exhibit continuous flow patterns. The algorithm analyzes the motion of textured particles in the input video along user-specified flow lines, and synthesizes seamless video of arbitrary length by enforcing temporal continuity along a second set of user-specified flow lines. The algorithm is simple to implement and use. We used this technique to edit video of water-falls, rivers, flames, and smoke.

Supplementary Material

MOV File (pps018.mov)

Download
12.30 KB

References

[1]

DORETTO, G., CHIUSO, A., SOATTO, S., AND WU, Y. 2003. Dynamic textures. International Journal of Computer Vision 51, 2, 91--109.

Digital Library

Google Scholar

[2]

KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics, SIGGRAPH 2003, 22, 3, 277--286.

Digital Library

Google Scholar

[3]

SCHÖDL, A., AND ESSA, I. A. 2002. Controlled animation of video sprites. In ACM SIGGRAPH Symposium on Computer Animation, 121--128.

Digital Library

Google Scholar

[4]

SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. 2000. Video textures. In Proceedings of ACM SIGGRAPH 2000, 489--498.

Digital Library

Google Scholar

[5]

TREUILLE, A., MCNAMARA, A., POPOVIĆ, Z., AND STAM, J. 2003. Keyframe control of smoke simulations. ACM Transactions on Graphics, SIGGRAPH 2003, 22, 3, 716--723.

Digital Library

Google Scholar

[6]

TRUCCO, E., AND VERRI, A. 1998. Introductory Techniques for 3-D Computer Vision. Prentice-Hall, Inc, New Jersey, ch. 7, 146--148.

Digital Library

Google Scholar

[7]

WANG, Y., AND ZHU, S.-C. 2002. A generative model for textured motion: Analysis and synthesis. In Proc. European Conference on Computer Vision (ECCV), 582--598.

Digital Library

Google Scholar

[8]

WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree structured vector quantization. In Proceedings of ACM SIGGRAPH 2000, 479--488.

Digital Library

Google Scholar

Cited By

View all

Le TYeh CLin YLee T(2023)Animating Still Natural Images Using WarpingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351189419:1(1-24)Online publication date: 5-Jan-2023
https://doi.org/10.1145/3511894
Hang TYang HLiu BFu JGeng XGuo B(2023)Language-Guided Face Animation by Recurrent StyleGAN-Based GeneratorIEEE Transactions on Multimedia10.1109/TMM.2023.324814325(9216-9227)Online publication date: 2023
https://doi.org/10.1109/TMM.2023.3248143
Lee YJang JChen YQiu EHuang J(2023)Shape-Aware Text-Driven Layered Video Editing2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01376(14317-14326)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01376
Show More Cited By

Index Terms

Flow-based video synthesis and editing
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        Motion capture
  2. Computer graphics
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Graphics input devices

Recommendations

Flow-based video synthesis and editing

This paper presents a novel algorithm for synthesizing and editing video of natural phenomena that exhibit continuous flow patterns. The algorithm analyzes the motion of textured particles in the input video along user-specified flow lines, and ...
Line-Drawing Video Stylization

We present a method to automatically convert videos and CG animations to stylized animated line drawings. Using a data-driven approach, the animated drawings can follow the sketching style of a specific artist. Given an input video, we first extract ...
Physically Based Video Editing

Convincing manipulation of objects in live action videos is a difficult and often tedious task. Skilled video editors achieve this with the help of modern professional tools, but complex motions might still lack physical realism since existing tools do ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

August 2004

684 pages

ISBN:9781450378239

DOI:10.1145/1186562

Editor:
Joe Marks
Mitsubishi Electric Research Laboratories (MERL)

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH04

Sponsor:

SIGGRAPH

SIGGRAPH04: Special Interest Group on Computer Graphics and Interactive Techniques

August 8 - 12, 2004

California, Los Angeles

Acceptance Rates

SIGGRAPH '04 Paper Acceptance Rate 83 of 478 submissions, 17%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
1,273
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Le TYeh CLin YLee T(2023)Animating Still Natural Images Using WarpingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/351189419:1(1-24)Online publication date: 5-Jan-2023
https://doi.org/10.1145/3511894
Hang TYang HLiu BFu JGeng XGuo B(2023)Language-Guided Face Animation by Recurrent StyleGAN-Based GeneratorIEEE Transactions on Multimedia10.1109/TMM.2023.324814325(9216-9227)Online publication date: 2023
https://doi.org/10.1109/TMM.2023.3248143
Lee YJang JChen YQiu EHuang J(2023)Shape-Aware Text-Driven Layered Video Editing2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01376(14317-14326)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01376
Haim NFeinstein BGranot NShocher ABagon SDekel TIrani M(2022)Diverse Generation from a Single Video Made PossibleComputer Vision – ECCV 202210.1007/978-3-031-19790-1_30(491-509)Online publication date: 24-Oct-2022
https://doi.org/10.1007/978-3-031-19790-1_30
Holynski ACurless BSeitz SSzeliski R(2021)Animating Pictures with Eulerian Motion Fields2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.00575(5806-5815)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.00575
Men YLian ZTang YXiao J(2019)DynTypo: Example-Based Dynamic Text Effects Transfer2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2019.00602(5863-5872)Online publication date: Jun-2019
https://doi.org/10.1109/CVPR.2019.00602
Ilisescu CKanaci HRomagnoli MCampbell NBrostow GMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Responsive Action-based Video SynthesisProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025880(6569-6580)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025880
Prashnani ENoorkami MVaquero DSen P(2017)A Phase-Based Approach for Animating Images Using Video ExamplesComputer Graphics Forum10.1111/cgf.1294036:6(303-311)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1111/cgf.12940
Zhao HLiu YZhang CZhao DXu F(2014)Generating Image Sequences of Augmented Road ScenariosProceedings of the 2014 International Conference on Virtual Reality and Visualization10.1109/ICVRV.2014.30(473-477)Online publication date: 30-Aug-2014
https://dl.acm.org/doi/10.1109/ICVRV.2014.30
Zhou BZuo QQi Y(2014)Editing Fluid Sequences Using Space Warping TechniqueProceedings of the 2014 International Conference on Virtual Reality and Visualization10.1109/ICVRV.2014.22(403-407)Online publication date: 30-Aug-2014
https://dl.acm.org/doi/10.1109/ICVRV.2014.22
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations