research-article

Learning contact corrections for handle-based subspace dynamics

Authors:

Cristian Romero,

Miguel OtaduyAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 40, Issue 4

Article No.: 131, Pages 1 - 12

https://doi.org/10.1145/3450626.3459875

Published: 19 July 2021 Publication History

Abstract

This paper introduces a novel subspace method for the simulation of dynamic deformations. The method augments existing linear handle-based subspace formulations with nonlinear learning-based corrections parameterized by the same subspace. Together, they produce a compact nonlinear model that combines the fast dynamics and overall contact-based interaction of subspace methods, with the highly detailed deformations of learning-based methods. We propose a formulation of the model with nonlinear corrections applied on the local undeformed setting, and decoupling internal and external contact-driven corrections. We define a simple mapping of these corrections to the global setting, an efficient implementation for dynamic simulation, and a training pipeline to generate examples that efficiently cover the interaction space. Altogether, the method achieves unprecedented combination of speed and contact-driven deformation detail.

Supplementary Material

VTT File (3450626.3459875.vtt)

Download
24.35 KB

MP4 File (a131-romero.mp4)

Download
274.42 MB

MP4 File (3450626.3459875.mp4)

Presentation.

Download
245.24 MB

References

[1]

Steven S. An, Theodore Kim, and Doug L. James. 2008. Optimizing Cubature for Efficient Integration of Subspace Deformations. ACM Trans. Graph. 27, 5, Article 165 (2008).

Digital Library

[2]

Stephen W. Bailey, Dave Otte, Paul Dilorenzo, and James F. O'Brien. 2018. Fast and Deep Deformation Approximations. ACM Trans. Graph. 37, 4, Article 119 (2018).

Digital Library

[3]

Jernej Barbič and Doug L. James. 2005. Real-Time Subspace Integration for St. Venant-Kirchhoff Deformable Models. ACM Trans. Graph. 24, 3 (July 2005), 982--990.

Digital Library

[4]

Peter Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, and Koray kavukcuoglu. 2016. Interaction Networks for Learning about Objects, Relations and Physics. In Proceedings of the 30th International Conference on Neural Information Processing Systems. 4509--4517.

[5]

Bernd Bickel, Manuel Lang, Mario Botsch, Miguel A. Otaduy, and Markus Gross. 2008. Pose-Space Animation and Transfer of Facial Details. In Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 57--66.

Digital Library

[6]

Christopher Brandt, Elmar Eisemann, and Klaus Hildebrandt. 2018. Hyper-Reduced Projective Dynamics. ACM Trans. Graph. 37, 4, Article 80 (2018).

Digital Library

[7]

Dan Casas and Miguel A. Otaduy. 2018. Learning Nonlinear Soft-Tissue Dynamics for Interactive Avatars. Proc. ACM Comput. Graph. Interact. Tech. 1, 1, Article 10 (July 2018), 15 pages.

[8]

Michael B. Chang, Tomer Ullman, Antonio Torralba, and Joshua B. Tenenbaum. 2017. A Compositional Object-Based Approach to Learning Physical Dynamics. In Proceedings of the International Conference on Learning Representations.

[9]

Jiong Chen, Hujun Bao, Tianyu Wang, Mathieu Desbrun, and Jin Huang. 2018. Numerical Coarsening Using Discontinuous Shape Functions. ACM Trans. Graph. 37, 4, Article 120 (2018).

Digital Library

[10]

Nuttapong Chentanez, Miles Macklin, Matthias Müller, Stefan Jeschke, and Tae-Yong Kim. 2020. Cloth and Skin Deformation with a Triangle Mesh Based Convolutional Neural Network. Computer Graphics Forum 39, 8 (2020), 123--134.

Digital Library

[11]

Edilson de Aguiar, Leonid Sigal, Adrien Treuille, and Jessica K. Hodgins. 2010. Stable Spaces for Real-Time Clothing. ACM Trans. Graph. 29, 4 (2010).

Digital Library

[12]

Ye Fan, Joshua Litven, David I. W. Levin, and Dinesh K. Pai. 2013. Eulerian-on-lagrangian Simulation. ACM Trans. Graph. 32, 3 (2013).

Digital Library

[13]

Lawson Fulton, Vismay Modi, David Duvenaud, David I. W. Levin, and Alec Jacobson. 2019. Latent-space Dynamics for Reduced Deformable Simulation. Computer Graphics Forum 38, 2 (2019), 379--391.

[14]

Theodore F Gast, Craig Schroeder, Alexey Stomakhin, Chenfanfu Jiang, and Joseph M Teran. 2015. Optimization integrator for large time steps. IEEE Transactions on Visualization and Computer Graphics (TVCG) 21, 10 (2015), 1103--1115.

Digital Library

[15]

Benjamin Gilles, Guillaume Bousquet, Francois Faure, and Dinesh K. Pai. 2011. Frame-Based Elastic Models. ACM Trans. Graph. 30, 2 (2011).

Digital Library

[16]

Samuel Greydanus, Misko Dzamba, and Jason Yosinski. 2019. Hamiltonian Neural Networks. In Advances in Neural Information Processing Systems, Vol. 32. 15379--15389.

[17]

Fabian Hahn, Sebastian Martin, Bernhard Thomaszewski, Robert Sumner, Stelian Coros, and Markus Gross. 2012. Rig-Space Physics. ACM Trans. Graph. 31, 4, Article 72 (July 2012), 8 pages.

Digital Library

[18]

Fabian Hahn, Bernhard Thomaszewski, Stelian Coros, Robert W. Sumner, Forrester Cole, Mark Meyer, Tony DeRose, and Markus Gross. 2014. Subspace Clothing Simulation Using Adaptive Bases. ACM Trans. Graph. 33, 4 (2014).

Digital Library

[19]

Fabian Hahn, Bernhard Thomaszewski, Stelian Coros, Robert W. Sumner, and Markus Gross. 2013. Efficient Simulation of Secondary Motion in Rig-Space. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 165--171.

Digital Library

[20]

David Harmon and Denis Zorin. 2013. Subspace Integration with Local Deformations. ACM Trans. Graph. 32, 4, Article 107 (July 2013), 10 pages.

Digital Library

[21]

Kris K. Hauser, Chen Shen, and James F. O'Brien. 2003. Interactive Deformation Using Modal Analysis with Constraints. In Proceedings of the Graphics Interface. 247--256.

[22]

Daniel Holden, Bang Chi Duong, Sayantan Datta, and Derek Nowrouzezahrai. 2019. Subspace Neural Physics: Fast Data-Driven Interactive Simulation. In Proceedings of the 18th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation.

Digital Library

[23]

G. Irving, J. Teran, and R. Fedkiw. 2004. Invertible Finite Elements for Robust Simulation of Large Deformation. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 131--140.

[24]

Ladislav Kavan, Dan Gerszewski, Adam W. Bargteil, and Peter-Pike Sloan. 2011. Physics-Inspired Upsampling for Cloth Simulation in Games. ACM Trans. Graph. 30, 4 (2011).

Digital Library

[25]

Lily Kharevych, Patrick Mullen, Houman Owhadi, and Mathieu Desbrun. 2009. Numerical Coarsening of Inhomogeneous Elastic Materials. ACM Trans. on Graphics 28, 3 (2009), 51:1--51:8.

Digital Library

[26]

Doyub Kim, Woojong Koh, Rahul Narain, Kayvon Fatahalian, Adrien Treuille, and James F. O'Brien. 2013. Near-Exhaustive Precomputation of Secondary Cloth Effects. ACM Trans. Graph. 32, 4 (2013).

Digital Library

[27]

Theodore Kim and Doug L. James. 2011. Physics-Based Character Skinning Using Multi-Domain Subspace Deformations. In Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 63--72.

[28]

Paul G. Kry, Doug L. James, and Dinesh K. Pai. 2002. EigenSkin: Real Time Large Deformation Character Skinning in Hardware. In Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 153--159.

[29]

P. Krysl, S. Lall, and J. E. Marsden. 2001. Dimensional model reduction in non-linear finite element dynamics of solids and structures. Internat. J. Numer. Methods Engrg. 51, 4 (2001), 479--504.

[30]

J. P. Lewis, Matt Cordner, and Nickson Fong. 2000. Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). ACM Press/Addison-Wesley Publishing Co., USA, 165--172.

Digital Library

[31]

Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B. Tenenbaum, and Antonio Torralba. 2019. Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids. In Proceedings of the International Conference on Learning Representations.

[32]

Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-person Linear Model. ACM Trans. Graph. 34, 6, Article 248 (Oct. 2015), 16 pages.

Digital Library

[33]

R. Luo, T. Shao, H. Wang, W. Xu, X. Chen, K. Zhou, and Y. Yang. 2020. NNWarp: Neural Network-Based Nonlinear Deformation. IEEE Transactions on Visualization and Computer Graphics 26, 4 (2020), 1745--1759.

[34]

Richard Malgat, Benjamin Gilles, David I. W. Levin, Matthieu Nesme, and François Faure. 2015. Multifarious Hierarchies of Mechanical Models for Artist Assigned Levels-of-detail. In Proceedings of the 14th ACM SIGGRAPH / Eurographics Symposium on Computer Animation. 27--36.

Digital Library

[35]

Sebastian Martin, Bernhard Thomaszewski, Eitan Grinspun, and Markus Gross. 2011. Example-Based Elastic Materials. ACM Trans. Graph. 30, 4, Article 72 (2011).

Digital Library

[36]

Matthias Müller and Markus Gross. 2004. Interactive Virtual Materials. In Proceedings of Graphics Interface. 239--246.

[37]

M. Müller, R. Keiser, A. Nealen, M. Pauly, M. Gross, and M. Alexa. 2004. Point Based Animation of Elastic, Plastic and Melting Objects. In Proceedings of the 2004 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 141--151.

[38]

Zherong Pan, Hujun Bao, and Jin Huang. 2015. Subspace Dynamic Simulation Using Rotation-Strain Coordinates. ACM Trans. Graph. 34, 6, Article 242 (Oct. 2015), 12 pages.

Digital Library

[39]

Chaitanya Patel, Zhouyingcheng Liao, and Gerard Pons-Moll. 2020. TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE.

[40]

Alex Pentland and John Williams. 1989. Good Vibrations: Modal Dynamics for Graphics and Animation. Computer Graphics 23, 3 (1989), 215--222.

Digital Library

[41]

Gerard Pons-Moll, Javier Romero, Naureen Mahmood, and Michael J. Black. 2015. Dyna: A Model of Dynamic Human Shape in Motion. ACM Trans. Graph. 34, 4, Article 120 (July 2015), 14 pages.

Digital Library

[42]

Alvaro Sanchez-Gonzalez, Nicolas Heess, Jost Tobias Springenberg, Josh Merel, Martin A. Riedmiller, Raia Hadsell, and Peter Battaglia. 2018. Graph Networks as Learnable Physics Engines for Inference and Control. In ICML. 4467--4476.

[43]

Igor Santesteban, Elena Garces, Miguel A. Otaduy, and Dan Casas. 2020. SoftSMPL: Data-driven Modeling of Nonlinear Soft-tissue Dynamics for Parametric Humans. Computer Graphics Forum 39, 2 (2020), 65--75.

[44]

Igor Santesteban, Miguel A. Otaduy, and Dan Casas. 2019. Learning-Based Animation of Clothing for Virtual Try-On. Computer Graphics Forum 38, 2 (2019), 355--366.

[45]

Christian Schumacher, Bernd Bickel, Jan Rys, Steve Marschner, Chiara Daraio, and Markus Gross. 2015. Microstructures to Control Elasticity in 3D Printing. ACM Trans. Graph. 34, 4 (2015), 136:1--136:13.

Digital Library

[46]

Breannan Smith, Fernando De Goes, and Theodore Kim. 2018. Stable Neo-Hookean Flesh Simulation. ACM Trans. Graph. 37, 2, Article 12 (March 2018), 15 pages.

Digital Library

[47]

Steven L. Song, Weiqi Shi, and Michael Reed. 2020. Accurate Face Rig Approximation with Deep Differential Subspace Reconstruction. ACM Trans. Graph. 39, 4 (2020).

Digital Library

[48]

Javier Tapia, Cristian Romero, Jesús Pérez, and Miguel A. Otaduy. 2021. Parametric Skeletons with Reduced Soft-Tissue Deformations. Computer Graphics Forum (2021).

[49]

Camillo J. Taylor and David J. Kriegman. 1994. Minimization on the Lie Group SO(3) and Related Manifolds. Technical Report. Yale University.

[50]

Yun Teng, Mark Meyer, Tony DeRose, and Theodore Kim. 2015. Subspace Condensation: Full Space Adaptivity for Subspace Deformations. ACM Trans. Graph. 34, 4, Article 76 (July 2015), 9 pages.

Digital Library

[51]

Yun Teng, Miguel A. Otaduy, and Theodore Kim. 2014. Simulating Articulated Subspace Self-Contact. ACM Trans. Graph. 33, 4 (2014).

Digital Library

[52]

Rosell Torres, Alejandro Rodríguez, José M. Espadero, and Miguel A. Otaduy. 2016. High-resolution Interaction with Corotational Coarsening Models. ACM Trans. Graph. 35, 6 (2016), 211:1--211:11.

Digital Library

[53]

Mickeal Verschoor, Dan Casas, and Miguel A. Otaduy. 2020. Tactile Rendering Based on Skin Stress Optimization. ACM Trans. Graph. 39, 4, Article 90 (2020).

Digital Library

[54]

Christoph von Tycowicz, Christian Schulz, Hans-Peter Seidel, and Klaus Hildebrandt. 2013. An Efficient Construction of Reduced Deformable Objects. ACM Trans. Graph. 32, 6, Article 213 (2013).

Digital Library

[55]

Huamin Wang, Florian Hecht, Ravi Ramamoorthi, and James F. O'Brien. 2010. Example-Based Wrinkle Synthesis for Clothing Animation. ACM Trans. Graph. 29, 4, Article 107 (July 2010).

Digital Library

[56]

Robert Y. Wang, Kari Pulli, and Jovan Popović. 2007. Real-Time Enveloping with Rotational Regression. In ACM SIGGRAPH 2007 Papers (San Diego, California) (SIGGRAPH '07). Association for Computing Machinery, New York, NY, USA.

[57]

Yu Wang, Alec Jacobson, Jernej Barbič, and Ladislav Kavan. 2015. Linear Subspace Design for Real-Time Shape Deformation. ACM Trans. Graph. 34, 4, Article 57 (2015).

Digital Library

[58]

S. Wiewel, M. Becher, and N. Thuerey. 2019. Latent Space Physics: Towards Learning the Temporal Evolution of Fluid Flow. Computer Graphics Forum 38, 2 (2019), 71--82.

[59]

Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T Freeman, and Joshua B Tenenbaum. 2016. Learning a probabilistic latent space of object shapes via 3D generative-adversarial modeling. In Proceedings of the 30th International Conference on Neural Information Processing Systems. 82--90.

Digital Library

[60]

Hongyi Xu and Jernej Barbič. 2016. Pose-Space Subspace Dynamics. ACM Trans. Graph. 35, 4, Article 35 (July 2016), 14 pages.

Digital Library

[61]

Hongyi Xu, Funshing Sin, Yufeng Zhu, and Jernej Barbič. 2015. Nonlinear Material Design Using Principal Stretches. ACM Trans. Graph. 34, 4, Article 75 (2015).

Digital Library

[62]

J. S. Zurdo, J. P. Brito, and M. A. Otaduy. 2013. Animating Wrinkles by Example on Non-Skinned Cloth. IEEE Transactions on Visualization & Computer Graphics 19, 01 (2013), 149--158.

Digital Library

Cited By

Becker QKusupati USuzuki SPauly M(2024)Computational Design of a Kit of Parts for Bending Active StructuresACM Transactions on Graphics10.1145/368796643:6(1-16)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687966
Gomez-Nogales GPrieto-Martin MRomero CComino-Trinidad MRamon-Prieto POlivier AHoyet LOtaduy MPettre JCasas D(2024)Resolving Collisions in Dense 3D Crowd AnimationsACM Transactions on Graphics10.1145/368726643:5(1-14)Online publication date: 6-Sep-2024
https://doi.org/10.1145/3687266
Charrondière RNeukirch SBertails-Descoubes F(2024)MERCI: Mixed Curvature-Based Elements for Computing Equilibria of Thin Elastic RibbonsACM Transactions on Graphics10.1145/367450243:5(1-26)Online publication date: 9-Aug-2024
https://dl.acm.org/doi/10.1145/3674502
Show More Cited By

Index Terms

Learning contact corrections for handle-based subspace dynamics
1. Computing methodologies
  1. Computer graphics
    1. Animation
      1. Physical simulation

Recommendations

Disturbance Grassmann Kernels for Subspace-Based Learning
KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining

In this paper, we focus on subspace-based learning problems, where data elements are linear subspaces instead of vectors. To handle this kind of data, Grassmann kernels were proposed to measure the space structure and used with classifiers, e.g., ...
Data-driven subspace enrichment for elastic deformations with collisions

We propose an efficient data-driven enrichment approach to adaptively enhance the expressivity of subspaces for elastic deformations with novel collisions. In general, subspace integration method (also known as model reduction) for elastic deformations ...
Subspace-based subspace sum graph on vector spaces
Abstract
Suppose that $V$ is a n-dimensional vector space and $W$ is its fixed k-dimensional subspace such that $n - k \geq 1 .$ In the present article, we initiate the study of a new graph structure “subspace-based subspace sum graph” $G_{W} (V),$ where the vertex set $V (G_{W} (V)...$ $_{}$ $_{}$ $_{}$ $_{}$ $_{}_{}$ $_{}$ $_{_{}}$ $_{_{}}$ $_{}$ $_{}$ $_{}$ $_{}$ $_{}$

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 40, Issue 4

August 2021

2170 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3450626

Editor:
Sylvain Paris
Adobe Inc.

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2021

Published in TOG Volume 40, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
412
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)7

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Becker QKusupati USuzuki SPauly M(2024)Computational Design of a Kit of Parts for Bending Active StructuresACM Transactions on Graphics10.1145/368796643:6(1-16)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687966
Gomez-Nogales GPrieto-Martin MRomero CComino-Trinidad MRamon-Prieto POlivier AHoyet LOtaduy MPettre JCasas D(2024)Resolving Collisions in Dense 3D Crowd AnimationsACM Transactions on Graphics10.1145/368726643:5(1-14)Online publication date: 6-Sep-2024
https://doi.org/10.1145/3687266
Charrondière RNeukirch SBertails-Descoubes F(2024)MERCI: Mixed Curvature-Based Elements for Computing Equilibria of Thin Elastic RibbonsACM Transactions on Graphics10.1145/367450243:5(1-26)Online publication date: 9-Aug-2024
https://dl.acm.org/doi/10.1145/3674502
Grigorev ABecherini GBlack MHilliges OThomaszewski B(2024)ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment SimulationsACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657408(1-10)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657408
Huang WXu PLiu Z(2024)Dynamic Modeling of a Sliding Ring on an Elastic Rod With Incremental Potential FormulationJournal of Applied Mechanics10.1115/1.406562591:8Online publication date: 6-Jun-2024
https://doi.org/10.1115/1.4065625
Saleh MSommersperger MNavab NTombari F(2024)Physics-Encoded Graph Neural Networks for Deformation Prediction under Contact2024 IEEE International Conference on Robotics and Automation (ICRA)10.1109/ICRA57147.2024.10610366(17160-17166)Online publication date: 13-May-2024
https://doi.org/10.1109/ICRA57147.2024.10610366
Wang JDu YCoros SThomaszewski B(2024)Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.02185(23158-23167)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.02185
Xu HWu YTang XZhang JZhang YZhang ZLi CJin X(2024)FusionDeformer: text-guided mesh deformation using diffusion modelsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03463-740:7(4701-4712)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s00371-024-03463-7
Muralikrishnan SDutt NChaudhuri SAigerman NKim VFisher MMitra N(2024)Temporal Residual Jacobians for Rig-Free Motion TransferComputer Vision – ECCV 202410.1007/978-3-031-73636-0_6(93-109)Online publication date: 5-Nov-2024
https://doi.org/10.1007/978-3-031-73636-0_6
Wang TLiu S(2024)Multi‐scale edge aggregation mesh‐graph‐network for character secondary motionComputer Animation and Virtual Worlds10.1002/cav.224135:3Online publication date: 17-May-2024
https://doi.org/10.1002/cav.2241
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents