research-article

Physically guided liquid surface modeling from videos

Authors:

Greg TurkAuthors Info & Claims

SIGGRAPH '09: ACM SIGGRAPH 2009 papers

Article No.: 90, Pages 1 - 11

https://doi.org/10.1145/1576246.1531396

Published: 27 July 2009 Publication History

Abstract

We present an image-based reconstruction framework to model real water scenes captured by stereoscopic video. In contrast to many image-based modeling techniques that rely on user interaction to obtain high-quality 3D models, we instead apply automatically calculated physically-based constraints to refine the initial model. The combination of image-based reconstruction with physically-based simulation allows us to model complex and dynamic objects such as fluid. Using a depth map sequence as initial conditions, we use a physically based approach that automatically fills in missing regions, removes outliers, and refines the geometric shape so that the final 3D model is consistent to both the input video data and the laws of physics. Physically-guided modeling also makes interpolation or extrapolation in the space-time domain possible, and even allows the fusion of depth maps that were taken at different times or viewpoints. We demonstrated the effectiveness of our framework with a number of real scenes, all captured using only a single pair of cameras.

Supplementary Material

JPG File (tps062_09.jpg)

Download
19.54 KB

MP4 File (tps062_09.mp4)

Download
104.64 MB

References

[1]

Atcheson, B., Ihrke, I., Heidrich, W., Tevs, A., Bradley, D., Magnor, M., and Seidel, H.-P. 2008. Time-resolved 3d capture of non-stationary gas flows. In Proc. of ACM SIGGRAPH Asia 2008, vol. 27.

Digital Library

[2]

Bhat, K. S., Seitz, S. M., Hodgins, J. K., and Khosla, P. K. 2004. Flow-based video synthesis and editing. In Proc. of ACM SIGGRAPH 2004, 360--363.

Digital Library

[3]

Bradley, D., Popa, T., Sheffer, A., Heidrich, W., and Boubekeur, T. 2008. Markerless garment capture. In Proc. of ACM SIGGRAPH 2008, vol. 27.

Digital Library

[4]

Carlson, M., Mucha, P. J., Van Horn III, R. B., and Turk, G. 2002. Melting and flowing. In Proc. of SCA '02, 167--174.

Digital Library

[5]

de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. In Proc. of ACM SIGGRAPH '08, 1--10.

Digital Library

[6]

Egnal, G., and Wildes, R. P. 2002. Detecting binocular half-occlusions: Empirical comparisons of five approaches. IEEE Trans. Pattern Anal. Mach. Intell. 24, 8, 1127--1133.

Digital Library

[7]

Enright, D., Marschner, S., and Fedkiw, R. 2002. Animation and rendering of complex water surfaces. In Proc. of ACM SIGGRAPH '02, 736--744.

Digital Library

[8]

Fattal, R., and Lischinski, D. 2004. Target-driven smoke animation. In Proc. of ACM SIGGRAPH 2004.

Digital Library

[9]

Foster, N., and Fedkiw, R. 2001. Practical animation of liquids. In Proc. of SIGGRAPH '01, 23--30.

Digital Library

[10]

Foster, N., and Metaxas, D. 1996. Realistic animation of liquids. Graph. Models Image Process. 58, 5.

Digital Library

[11]

Grant, I. 1997. Particle image velocimetry: a review. In Proc. of the Institution of Mechanical Engineers, vol. 211, 55C76.

[12]

Hawkins, T., Einarsson, P., and Debevec, P. 2005. Acquisition of time-varying participating media. In Proc. of ACM SIGGRAPH 2005.

Digital Library

[13]

Hullin, M. B., Fuchs, M., Ihrke, I., Seidel, H.-P., and Lensch, H. P. A. 2008. Fluorescent immersion range scanning. In Proc. of ACM SIGGRAPH 2008.

Digital Library

[14]

Ihrke, I., Goldluecke, B., and Magnor, M. 2005. Reconstructing the geometry of flowing water. In ICCV '05, IEEE Computer Society, Washington, DC, USA, 1055--1060.

Digital Library

[15]

Kanade, T., Rander, P., Vedula, S., and Saito, H. 1999. Virtualized reality: Digitizing a 3d time-varying event as is and in real time. In Mixed Reality, Merging Real and Virtual Worlds. 41--57.

[16]

McNamara, A., Treuille, A., Popovic, Z., and Stam, J. 2004. Fluid control using the adjoint method. In Proc. of ACM SIGGRAPH 2004.

Digital Library

[17]

Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Eurographics Symposium on Geometry Processing.

Digital Library

[18]

Morris, N. J. W., and Kutulakos, K. N. 2005. Dynamic refraction stereo. In Proc. of International Conference on Computer Vision.

Digital Library

[19]

Morris, N. J. W., and Kutulakos, K. N. 2007. Reconstructing the surface of inhomogeneous transparent scenes by scatter trace photography. In Proc. of 11th Int. Conf. Computer Vision.

[20]

Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J., and Kang, S. B. 2006. Image-based plant modeling. In Proc. of ACM SIGGRAPH 2006.

Digital Library

[21]

Schneider, R., and Kobbelt, L. 2001. Geometric fairing of irregular meshes for freeform surface design. Computer aided geometric design 18, 359--379.

Digital Library

[22]

Sharf, A., Alcantara, D. A., Lewiner, T., Greif, C., and Sheffer, A. 2008. Space-time surface reconstruction using incompressible flow. In Proc. of ACM SIGGRAPH Asia 2008, vol. 27, 1--10.

Digital Library

[23]

Shi, J., and Tomasi, C. 1994. Good features to track. In Proc. of CVPR 1994, 593--600.

[24]

Simon, S. V., Baker, S., Seitz, S., and Kanade, T. 2000. Shape and motion carving in 6d. In Computer Vision and Pattern Recognition.

[25]

Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3d architectural modeling from unordered photo collections. Proc. of SIGGRAPH Asia 2008 27.

Digital Library

[26]

Stam, J. 1999. Stable fluids. In Proc. of ACM SIGGRAPH '99, 121--128.

Digital Library

[27]

Staniforth, A., and C&#244;t&#233;, J. 1991. Semi-lagrangian integration schemes for atmospheric models. Monthly Weather Review 119, 9, 2206.

[28]

Sun, J., Zheng, N.-N., and Shum, H.-Y. 2003. Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25, 7, 787.

Digital Library

[29]

Tan, P., Zeng, G., Wang, J., Kang, S. B., and Quan, L. 2007. Image-based tree modeling. In Proc. of ACM SIGGRAPH 2007.

Digital Library

[30]

Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Eurographics Symposium on Geometry Processing.

Digital Library

[31]

Wei, Y., Ofek, E., Quan, L., and Shum, H.-Y. 2005. Modeling hair from multiple views. In Proc. of ACM SIGGRAPH 2005.

Digital Library

[32]

White, R., Crane, K., and Forsyth, D. 2007. Capturing and animating occluded cloth. In Proc. of ACM SIGGRAPH 2007.

Digital Library

[33]

Xiao, J., Fang, T., Tan, P., Zhao, P., and Quan, L. 2008. Image-based facade modeling. Proc. of SIGGRAPH Asia 2008 27.

Digital Library

[34]

Yang, Q., Yang, R., Davis, J., and Nister, D. 2007. Spatial-depth super resolution for range images. In Proc. of CVPR 2007, vol. 0, 1--8.

[35]

Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2004. High-quality video view interpolation using a layered representation. In Proc. of ACM SIGGRAPH '04, 600--608.

Digital Library

[36]

Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., and Szeliski, R. 2004. High-quality video view interpolation using a layered representation. ACM Transactions on Graphics, 23, 3, 600--608.

Digital Library

Cited By

Chu KHuang JTakana HKitamura Y(2023)Real-Time Reconstruction of Fluid Flow under Unknown DisturbanceACM Transactions on Graphics10.1145/362401143:1(1-14)Online publication date: 17-Oct-2023
https://dl.acm.org/doi/10.1145/3624011
Zhang JSu YHu LShang Y(2023)The 3D Reconstruction of Disordered Incremental Sparse Point Clouds for Ship Traveling Wave of CFD Numerical Simulation2023 8th International Conference on Signal and Image Processing (ICSIP)10.1109/ICSIP57908.2023.10270926(380-384)Online publication date: 8-Jul-2023
https://doi.org/10.1109/ICSIP57908.2023.10270926
Pan ZManocha D(2017)Feedback motion planning for liquid pouring using supervised learning2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2017.8202300(1252-1259)Online publication date: Sep-2017
https://doi.org/10.1109/IROS.2017.8202300
Show More Cited By

Index Terms

Physically guided liquid surface modeling from videos
1. Computing methodologies
  1. Computer graphics
    1. Animation
      1. Physical simulation
    2. Shape modeling
2. Mathematics of computing
  1. Continuous mathematics
    1. Topology
      1. Geometric topology

Recommendations

Physically guided liquid surface modeling from videos

We present an image-based reconstruction framework to model real water scenes captured by stereoscopic video. In contrast to many image-based modeling techniques that rely on user interaction to obtain high-quality 3D models, we instead apply ...
A physically-based BSDF for modeling the appearance of paper
EGSR '14: Proceedings of the 25th Eurographics Symposium on Rendering

We present a novel appearance model for paper. Based on our appearance measurements for matte and glossy paper, we find that paper exhibits a combination of subsurface scattering, specular reflection, retroreflection, and surface sheen. Classic ...
MVE-An image-based reconstruction environment

We present an image-based reconstruction system, the Multi-View Environment. MVE is an end-to-end multi-view geometry reconstruction software which takes photos of a scene as input and produces a textured surface mesh as result. The system covers a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '09: ACM SIGGRAPH 2009 papers

July 2009

795 pages

ISBN:9781605587264

DOI:10.1145/1576246

Conference Chair:
Thomas Funkhouser,
Editor:
Hugues Hoppe
ACM Transactions on Graphics

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SIGGRAPH09

Sponsor:

SIGGRAPH

SIGGRAPH09: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 3 - 7, 2009

Louisiana, New Orleans

Acceptance Rates

SIGGRAPH '09 Paper Acceptance Rate 78 of 439 submissions, 18%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
1,112
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chu KHuang JTakana HKitamura Y(2023)Real-Time Reconstruction of Fluid Flow under Unknown DisturbanceACM Transactions on Graphics10.1145/362401143:1(1-14)Online publication date: 17-Oct-2023
https://dl.acm.org/doi/10.1145/3624011
Zhang JSu YHu LShang Y(2023)The 3D Reconstruction of Disordered Incremental Sparse Point Clouds for Ship Traveling Wave of CFD Numerical Simulation2023 8th International Conference on Signal and Image Processing (ICSIP)10.1109/ICSIP57908.2023.10270926(380-384)Online publication date: 8-Jul-2023
https://doi.org/10.1109/ICSIP57908.2023.10270926
Pan ZManocha D(2017)Feedback motion planning for liquid pouring using supervised learning2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS.2017.8202300(1252-1259)Online publication date: Sep-2017
https://doi.org/10.1109/IROS.2017.8202300
Quan HWang CSong Y(2017)Fluid re-simulation based on physically driven model from videoThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1154-333:1(85-98)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1007/s00371-015-1154-3
Monszpart AThuerey NMitra N(2016)SMASHACM Transactions on Graphics10.1145/2980179.298242135:6(1-14)Online publication date: 5-Dec-2016
https://dl.acm.org/doi/10.1145/2980179.2982421
Li CPickup DSaunders TCosker DMarshall DHall PWillis P(2013)Water Surface Modeling from a Single Viewpoint VideoIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.30219:7(1242-1251)Online publication date: 1-Jul-2013
https://dl.acm.org/doi/10.1109/TVCG.2012.302
Zhang QTong JWang HPan ZYang R(2012)Simulation Guided Hair Dynamics Modeling from VideoComputer Graphics Forum10.1111/j.1467-8659.2012.03192.x31:7pt1(2003-2010)Online publication date: 1-Sep-2012
https://dl.acm.org/doi/10.1111/j.1467-8659.2012.03192.x
Li CShaw MPickup DCosker DWillis PHall P(2011)Realtime Video Based Water Surface ApproximationProceedings of the 2011 Conference for Visual Media Production10.1109/CVMP.2011.19(109-117)Online publication date: 16-Nov-2011
https://dl.acm.org/doi/10.1109/CVMP.2011.19
Pickup DLi CCosker DHall PWillis P(2011)Reconstructing Mass-Conserved Water Surfaces Using Shape from Shading and Optical FlowComputer Vision – ACCV 201010.1007/978-3-642-19282-1_16(189-201)Online publication date: 2011
https://doi.org/10.1007/978-3-642-19282-1_16
Pickup DLi CCosker DHall PWillis P(2010)Reconstructing mass-conserved water surfaces using shape from shading and optical flowProceedings of the 10th Asian conference on Computer vision - Volume Part IV10.5555/1966111.1966128(189-201)Online publication date: 8-Nov-2010
https://dl.acm.org/doi/10.5555/1966111.1966128
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents