research-article

Open access

Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothing

Authors:

Timur Bagautdinov,

Shunsuke Saito,

Breannan Smith,

Takaaki Shiratori,

Jessica Hodgins,

Chenglei WuAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 41, Issue 6

Article No.: 222, Pages 1 - 15

https://doi.org/10.1145/3550454.3555456

Published: 30 November 2022 Publication History

Abstract

Despite recent progress in developing animatable full-body avatars, realistic modeling of clothing - one of the core aspects of human self-expression - remains an open challenge. State-of-the-art physical simulation methods can generate realistically behaving clothing geometry at interactive rates. Modeling photorealistic appearance, however, usually requires physically-based rendering which is too expensive for interactive applications. On the other hand, data-driven deep appearance models are capable of efficiently producing realistic appearance, but struggle at synthesizing geometry of highly dynamic clothing and handling challenging body-clothing configurations. To this end, we introduce pose-driven avatars with explicit modeling of clothing that exhibit both photorealistic appearance learned from real-world data and realistic clothing dynamics. The key idea is to introduce a neural clothing appearance model that operates on top of explicit geometry: at training time we use high-fidelity tracking, whereas at animation time we rely on physically simulated geometry. Our core contribution is a physically-inspired appearance network, capable of generating photorealistic appearance with view-dependent and dynamic shadowing effects even for unseen body-clothing configurations. We conduct a thorough evaluation of our model and demonstrate diverse animation results on several subjects and different types of clothing. Unlike previous work on photorealistic full-body avatars, our approach can produce much richer dynamics and more realistic deformations even for many examples of loose clothing. We also demonstrate that our formulation naturally allows clothing to be used with avatars of different people while staying fully animatable, thus enabling, for the first time, photorealistic avatars with novel clothing.

Supplemental Material

MP4 File

presentation

Download
523.31 MB

References

[1]

Thiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, and Marcus Magnor. 2019. Tex2shape: Detailed full human body geometry from a single image. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[2]

Timur Bagautdinov, Chenglei Wu, Tomas Simon, Fabian Prada, Takaaki Shiratori, Shih-En Wei, Weipeng Xu, Yaser Sheikh, and Jason Saragih. 2021. Driving-signal aware full-body avatars. ACM Transactions on Graphics (TOG) 40, 4 (2021).

Digital Library

[3]

David Baraff and Andrew Witkin. 1998. Large steps in cloth simulation. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings.

[4]

Hugo Bertiche, Meysam Madadi, and Sergio Escalera. 2021a. PBNS: physically based neural simulation for unsupervised garment pose space deformation. ACM Transactions on Graphics (TOG) 40, 6 (2021).

Digital Library

[5]

Hugo Bertiche, Meysam Madadi, Emilio Tylson, and Sergio Escalera. 2021b. DeePSD: Automatic deep skinning and pose space deformation for 3D garment animation. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[6]

Bharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, and Gerard Pons-Moll. 2019. Multi-garment net: Learning to dress 3d people from images. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[7]

Sai Bi, Stephen Lombardi, Shunsuke Saito, Tomas Simon, Shih-En Wei, Kevyn Mcphail, Ravi Ramamoorthi, Yaser Sheikh, and Jason Saragih. 2021. Deep relightable appearance models for animatable faces. ACM Transactions on Graphics (TOG) 40, 4 (2021).

Digital Library

[8]

Federica Bogo, Javier Romero, Gerard Pons-Moll, and Michael J Black. 2017. Dynamic FAUST: Registering human bodies in motion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[9]

Sofien Bouaziz, Sebastian Martin, Tiantian Liu, Ladislav Kavan, and Mark Pauly. 2014. Projective dynamics: Fusing constraint projections for fast simulation. ACM Transactions on Graphics (TOG) 33, 4 (2014).

Digital Library

[10]

Derek Bradley, Tiberiu Popa, Alla Sheffer, Wolfgang Heidrich, and Tamy Boubekeur. 2008. Markerless garment capture. ACM Transactions on Graphics (TOG) 27, 3 (2008).

Digital Library

[11]

Robert Bridson, Ronald Fedkiw, and John Anderson. 2002. Robust treatment of collisions, contact and friction for cloth animation. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings.

[12]

Andrei Burov, Matthias Nießner, and Justus Thies. 2021. Dynamic surface function networks for clothed human bodies. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[13]

Joel Carranza, Christian Theobalt, Marcus A Magnor, and Hans-Peter Seidel. 2003. Free-viewpoint video of human actors. ACM Transactions on Graphics (TOG) 22, 3 (2003).

Digital Library

[14]

Carlos Castillo, Jorge López-Moreno, and Carlos Aliaga. 2019. Recent advances in fabric appearance reproduction. Computers & Graphics 84 (2019).

[15]

Charles-Félix Chabert, Per Einarsson, Andrew Jones, Bruce Lamond, Wan-Chun Ma, Sebastian Sylwan, Tim Hawkins, and Paul Debevec. 2006. Relighting human locomotion with flowed reflectance fields. In Eurographics Symposium on Rendering.

Digital Library

[16]

Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros. 2019. Everybody dance now. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[17]

Xin Chen, Anqi Pang, Wei Yang, Peihao Wang, Lan Xu, and Jingyi Yu. 2021. TightCap: 3D Human Shape Capture with Clothing Tightness Field. ACM Transactions on Graphics (TOG) 41, 1 (2021).

[18]

Xiaowu Chen, Bin Zhou, Fei-Xiang Lu, Lin Wang, Lang Bi, and Ping Tan. 2015. Garment modeling with a depth camera. ACM Transactions on Graphics (TOG) 34, 6 (2015).

Digital Library

[19]

Nuttapong Chentanez, Miles Macklin, Matthias Müller, Stefan Jeschke, and Tae-Yong Kim. 2020. Cloth and skin deformation with a triangle mesh based convolutional neural network. In Computer Graphics Forum, Vol. 39.

Digital Library

[20]

Enric Corona, Albert Pumarola, Guillem Alenya, Gerard Pons-Moll, and Francesc Moreno-Noguer. 2021. SMPLicit: Topology-aware generative model for clothed people. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]

Katja Daubert, Hendrik Lensch, Wolfgang Heidrich, and Hans-Peter Seidel. 2001. Efficient cloth modeling and rendering. In Eurographics Workshop on Rendering Techniques.

[22]

Edilson de Aguiar, Carsten Stoll, Christian Theobalt, Naveed Ahmed, Hans-Peter Seidel, and Sebastian Thrun. 2008. Performance capture from sparse multi-view video. ACM Transactions on Graphics (TOG) 27, 3 (2008).

Digital Library

[23]

Martin Eisemann, Bert De Decker, Marcus Magnor, Philippe Bekaert, Edilson De Aguiar, Naveed Ahmed, Christian Theobalt, and Anita Sellent. 2008. Floating textures. In Computer Graphics Forum, Vol. 27.

[24]

Artur Grigorev, Karim Iskakov, Anastasia Ianina, Renat Bashirov, Ilya Zakharkin, Alexander Vakhitov, and Victor Lempitsky. 2021. Stylepeople: A generative model of fullbody human avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]

Erhan Gundogdu, Victor Constantin, Amrollah Seifoddini, Minh Dang, Mathieu Salzmann, and Pascal Fua. 2019. Garnet: A two-stream network for fast and accurate 3d cloth draping. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[26]

Jingfan Guo, Jie Li, Rahul Narain, and Hyun Soo Park. 2021. Inverse Simulation: Reconstructing Dynamic Geometry of Clothed Humans via Optimal Control. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]

Marc Habermann, Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, and Christian Theobalt. 2021a. Real-time deep dynamic characters. ACM Transactions on Graphics (TOG) 40, 4 (2021).

Digital Library

[28]

Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, and Christian Theobalt. 2019. Livecap: Real-time human performance capture from monocular video. ACM Transactions On Graphics (TOG) 38, 2 (2019).

Digital Library

[29]

Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, and Christian Theobalt. 2021b. A Deeper Look into DeepCap. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).

Digital Library

[30]

Marc Habermann, Weipeng Xu, Michael Zollhofer, Gerard Pons-Moll, and Christian Theobalt. 2020. Deepcap: Monocular human performance capture using weak supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]

Oshri Halimi, Tuur Stuyck, Donglai Xiang, Timur Bagautdinov, He Wen, Ron Kimmel, Takaaki Shiratori, Chenglei Wu, Yaser Sheikh, and Fabian Prada. 2022. Pattern-Based Cloth Registration and Sparse-ViewAnimation. ACM Transactions on Graphics (TOG) 41, 6 (2022).

Digital Library

[32]

Daniel Holden, Bang Chi Duong, Sayantan Datta, and Derek Nowrouzezahrai. 2019. Subspace neural physics: Fast data-driven interactive simulation. In Proceedings of the 18th annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation.

Digital Library

[33]

Fangzhou Hong, Liang Pan, Zhongang Cai, and Ziwei Liu. 2021. Garment4D: Garment Reconstruction from Point Cloud Sequences. Advances in Neural Information Processing Systems 34 (2021).

[34]

Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, and Tony Tung. 2020. Arch: Animatable reconstruction of clothed humans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]

Alec Jacobson, Elif Tosun, Olga Sorkine, and Denis Zorin. 2010. Mixed finite elements for variational surface modeling. In Computer Graphics Forum, Vol. 29.

[36]

Arjun Jain, Thorsten Thormählen, Hans-Peter Seidel, and Christian Theobalt. 2010. Moviereshape: Tracking and reshaping of humans in videos. ACM Transactions on Graphics (TOG) 29, 6 (2010).

Digital Library

[37]

Ning Jin, Yilin Zhu, Zhenglin Geng, and Ronald Fedkiw. 2020. A Pixel-Based Framework for Data-Driven Clothing. In Computer Graphics Forum, Vol. 39.

Digital Library

[38]

James T Kajiya. 1986. The rendering equation. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings.

[39]

Doyub Kim, Woojong Koh, Rahul Narain, Kayvon Fatahalian, Adrien Treuille, and James F O'Brien. 2013. Near-exhaustive precomputation of secondary cloth effects. ACM Transactions on Graphics (TOG) 32, 4 (2013).

Digital Library

[40]

Youngjoong Kwon, Dahun Kim, Duygu Ceylan, and Henry Fuchs. 2021. Neural human performer: Learning generalizable radiance fields for human performance rendering. Advances in Neural Information Processing Systems 34 (2021).

[41]

Jie Li, Gilles Daviet, Rahul Narain, Florence Bertails-Descoubes, Matthew Overby, George E Brown, and Laurence Boissieux. 2018. An implicit frictional contact solver for adaptive cloth simulation. ACM Transactions on Graphics (TOG) 37, 4 (2018).

Digital Library

[42]

Minchen Li, Danny M Kaufman, and Chenfanfu Jiang. 2021b. Codimensional incremental potential contact. ACM Transactions on Graphics (TOG) 40, 4 (2021).

Digital Library

[43]

Ruilong Li, Yuliang Xiu, Shunsuke Saito, Zeng Huang, Kyle Olszewski, and Hao Li. 2020. Monocular real-time volumetric performance capture. In European Conference on Computer Vision.

Digital Library

[44]

Yifei Li, Tao Du, Kui Wu, Jie Xu, and Wojciech Matusik. 2022. DiffCloth: Differentiable cloth simulation with dry frictional contact. ACM Transactions on Graphics (TOG) (2022).

[45]

Yue Li, Marc Habermann, Bernhard Thomaszewski, Stelian Coros, Thabo Beeler, and Christian Theobalt. 2021a. Deep physics-aware inference of cloth deformation for monocular human performance capture. In 2021 International Conference on 3D Vision (3DV). IEEE.

[46]

Junbang Liang, Ming Lin, and Vladlen Koltun. 2019. Differentiable cloth simulation for inverse problems. Advances in Neural Information Processing Systems 32 (2019).

[47]

Lingjie Liu, Marc Habermann, Viktor Rudnev, Kripasindhu Sarkar, Jiatao Gu, and Christian Theobalt. 2021. Neural actor: Neural free-view synthesis of human actors with pose control. ACM Transactions on Graphics (TOG) 40, 6 (2021).

Digital Library

[48]

Mickaël Ly, Jean Jouve, Laurence Boissieux, and Florence Bertails-Descoubes. 2020. Projective dynamics with dry frictional contact. ACM Transactions on Graphics (TOG) 39, 4 (2020).

Digital Library

[49]

Qianli Ma, Shunsuke Saito, Jinlong Yang, Siyu Tang, and Michael J Black. 2021a. SCALE: Modeling clothed humans with a surface codec of articulated local elements. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[50]

Qianli Ma, Jinlong Yang, Anurag Ranjan, Sergi Pujades, Gerard Pons-Moll, Siyu Tang, and Michael J Black. 2020. Learning to dress 3d people in generative clothing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[51]

Qianli Ma, Jinlong Yang, Siyu Tang, and Michael J Black. 2021b. The power of points for modeling humans in clothing. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[52]

Miles Macklin, Matthias Müller, and Nuttapong Chentanez. 2016. XPBD: position-based simulation of compliant constrained dynamics. In Proceedings of the 9th International Conference on Motion in Games.

Digital Library

[53]

Eder Miguel, Derek Bradley, Bernhard Thomaszewski, Bernd Bickel, Wojciech Matusik, Miguel A Otaduy, and Steve Marschner. 2012. Data-driven estimation of cloth simulation models. In Computer Graphics Forum, Vol. 31.

[54]

Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2020. Nerf: Representing scenes as neural radiance fields for view synthesis. In European Conference on Computer Vision.

Digital Library

[55]

Matthias Müller, Bruno Heidelberger, Marcus Hennix, and John Ratcliff. 2007. Position based dynamics. Journal of Visual Communication and Image Representation 18, 2 (2007), 109--118.

Digital Library

[56]

Atsuhiro Noguchi, Xiao Sun, Stephen Lin, and Tatsuya Harada. 2021. Neural articulated radiance field. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[57]

Jaesik Park, Qian-Yi Zhou, and Vladlen Koltun. 2017. Colored point cloud registration revisited. In Proceedings of the IEEE International Conference on Computer Vision.

[58]

Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019).

[59]

Chaitanya Patel, Zhouyingcheng Liao, and Gerard Pons-Moll. 2020. Tailornet: Predicting clothing in 3d as a function of human pose, shape and garment style. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[60]

Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Xiaowei Zhou, and Hujun Bao. 2021a. Animatable neural radiance fields for modeling dynamic human bodies. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[61]

Sida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang, Qing Shuai, Hujun Bao, and Xiaowei Zhou. 2021b. Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[62]

Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter Battaglia. 2021. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations.

[63]

Gerard Pons-Moll, Sergi Pujades, Sonny Hu, and Michael J Black. 2017. ClothCap: Seamless 4D clothing capture and retargeting. ACM Transactions on Graphics (ToG) 36, 4 (2017).

Digital Library

[64]

Sergey Prokudin, Michael J Black, and Javier Romero. 2021. Smplpix: Neural avatars from 3d human models. In Proceedings of the IEEE/CVF Winter Conference on Applications ofComputer Vision.

[65]

Amit Raj, Julian Tanke, James Hays, Minh Vo, Carsten Stoll, and Christoph Lassner. 2021. Anr: Articulated neural rendering for virtual avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[66]

Edoardo Remelli, Timur Bagautdinov, Shunsuke Saito, Chenglei Wu, Tomas Simon, Shih-En Wei, Kaiwen Guo, Zhe Cao, Fabian Prada, Jason Saragih, et al. 2022. Drivable Volumetric Avatars using Texel-Aligned Features. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings.

Digital Library

[67]

Jerome Revaud, Philippe Weinzaepfel, Zaid Harchaoui, and Cordelia Schmid. 2016. Deepmatching: Hierarchical deformable dense matching. International Journal of Computer Vision 120, 3 (2016).

Digital Library

[68]

Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234--241.

[69]

Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, and Hao Li. 2019. Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[70]

Shunsuke Saito, Tomas Simon, Jason Saragih, and Hanbyul Joo. 2020. Pifuhd: Multilevel pixel-aligned implicit function for high-resolution 3d human digitization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[71]

Shunsuke Saito, Jinlong Yang, Qianli Ma, and Michael J Black. 2021. SCANimate: Weakly supervised learning of skinned clothed avatar networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[72]

Igor Santesteban, Miguel A Otaduy, and Dan Casas. 2019. Learning-based animation of clothing for virtual try-on. In Computer Graphics Forum, Vol. 38.

[73]

Igor Santesteban, Miguel A Otaduy, and Dan Casas. 2022. SNUG: Self-Supervised Neural Dynamic Garments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[74]

Igor Santesteban, Nils Thuerey, Miguel A Otaduy, and Dan Casas. 2021. Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[75]

Aliaksandra Shysheya, Egor Zakharov, Kara-Ali Aliev, Renat Bashirov, Egor Burkov, Karim Iskakov, Aleksei Ivakhnenko, Yury Malkov, Igor Pasechnik, Dmitry Ulyanov, et al. 2019. Textured neural avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[76]

Jonathan Starck and Adrian Hilton. 2007. Surface capture for performance-based animation. IEEE Computer Graphics and Applications 27, 3 (2007).

Digital Library

[77]

Carsten Stoll, Juergen Gall, Edilson De Aguiar, Sebastian Thrun, and Christian Theobalt. 2010. Video-based reconstruction of animatable human characters. ACM Transactions on Graphics (TOG) 29, 6 (2010).

Digital Library

[78]

Tuur Stuyck. 2018. Cloth Simulation for Computer Graphics. Synthesis Lectures on Visual Computing: Computer Graphics, Animation, Computational Photography, and Imaging 10, 3 (2018), 1--121.

[79]

Shih-Yang Su, Frank Yu, Michael Zollhöfer, and Helge Rhodin. 2021. A-nerf: Articulated neural radiance fields for learning human shape, appearance, and pose. Advances in Neural Information Processing Systems 34 (2021).

[80]

Justus Thies, Michael Zollhöfer, and Matthias Nießner. 2019. Deferred neural rendering: Image synthesis using neural textures. ACM Transactions on Graphics (TOG) 38, 4 (2019).

Digital Library

[81]

Garvita Tiwari, Bharat Lal Bhatnagar, Tony Tung, and Gerard Pons-Moll. 2020. Sizer: A dataset and model for parsing 3d clothing and learning size sensitive 3d clothing. In European Conference on Computer Vision.

Digital Library

[82]

Raquel Vidaurre, Igor Santesteban, Elena Garces, and Dan Casas. 2020. Fully Convolutional Graph Neural Networks for Parametric Virtual Try-On. In Computer Graphics Forum, Vol. 39.

Digital Library

[83]

Marco Volino, Dan Casas, John P Collomosse, and Adrian Hilton. 2014. Optimal representation of multi-view video. In Proceedings of British Machine Vision Conference.

[84]

Huamin Wang, Florian Hecht, Ravi Ramamoorthi, and James F O'Brien. 2010. Example-based wrinkle synthesis for clothing animation. ACM Transactions on Graphics (TOG) 29, 4 (2010).

Digital Library

[85]

Ting-Chun Wang, Ming-Yu Liu, Jun-Yan Zhu, Guilin Liu, Andrew Tao, Jan Kautz, and Bryan Catanzaro. 2018. Video-to-Video Synthesis. Advances in Neural Information Processing Systems 31 (2018).

[86]

Ryan White, Keenan Crane, and David A Forsyth. 2007. Capturing and animating occluded cloth. ACM Transactions on Graphics (TOG) 26, 3 (2007).

Digital Library

[87]

Kui Wu and Cem Yuksel. 2017. Real-time cloth rendering with fiber-level detail. IEEE Transactions on Visualization and Computer Graphics 25, 2 (2017).

[88]

Donglai Xiang, Fabian Prada, Timur Bagautdinov, Weipeng Xu, Yuan Dong, He Wen, Jessica Hodgins, and Chenglei Wu. 2021. Modeling clothing as a separate layer for an animatable human avatar. ACM Transactions on Graphics (TOG) 40, 6 (2021).

Digital Library

[89]

Donglai Xiang, Fabian Prada, Chenglei Wu, and Jessica Hodgins. 2020. Monoclothcap: Towards temporally coherent clothing capture from monocular rgb video. In 2020 International Conference on 3D Vision (3DV). IEEE.

[90]

Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, and Michael J Black. 2022. Icon: Implicit clothed humans obtained from normals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[91]

Hongyi Xu, Thiemo Alldieck, and Cristian Sminchisescu. 2021. H-nerf: Neural radiance fields for rendering and temporal reconstruction of humans in motion. Advances in Neural Information Processing Systems 34 (2021).

[92]

Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, and Christian Theobalt. 2018. Monoperfcap: Human performance capture from monocular video. ACM Transactions on Graphics (ToG) 37, 2 (2018).

Digital Library

[93]

Ying-Qing Xu, Yanyun Chen, Stephen Lin, Hua Zhong, Enhua Wu, Baining Guo, and Heung-Yeung Shum. 2001. Photorealistic rendering of knitwear using the lumislice. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings.

[94]

Shan Yang, Junbang Liang, and Ming C Lin. 2017. Learning-based cloth material recovery from video. In Proceedings of the IEEE International Conference on Computer Vision.

[95]

Shan Yang, Zherong Pan, Tanya Amert, Ke Wang, Licheng Yu, Tamara Berg, and Ming C Lin. 2018. Physics-inspired garment recovery from a single-view image. ACM Transactions on Graphics (TOG) 37, 5 (2018).

Digital Library

[96]

Takami Yasuda, Shigeki Yokoi, and Jun-ichiro Toriwaki. 1992. A shading model for cloth objects. IEEE Computer Graphics and Applications 12, 6 (1992).

Digital Library

[97]

Tao Yu, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Qionghai Dai, Hao Li, Gerard Pons-Moll, and Yebin Liu. 2018. Doublefusion: Real-time capture of human performances with inner body shapes from a single depth sensor. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[98]

Tao Yu, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Qionghai Dai, Gerard Pons-Moll, and Yebin Liu. 2019. Simulcap: Single-view human performance capture with cloth simulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[99]

Chao Zhang, Sergi Pujades, Michael J Black, and Gerard Pons-Moll. 2017. Detailed, accurate, human shape estimation from clothed 3D scan sequences. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.

[100]

Meng Zhang, Duygu Ceylan, Tuanfeng Y. Wang, and Niloy J. Mitra. 2021a. Dynamic Neural Garments. ACM Transactions on Graphics (TOG) 40, 6 (2021).

Digital Library

[101]

Meng Zhang, Tuanfeng Wang, Duygu Ceylan, and Niloy J Mitra. 2021b. Deep detail enhancement for any garment. In Computer Graphics Forum, Vol. 40.

[102]

Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, and Yebin Liu. 2022. Structured local radiance fields for human avatar modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[103]

Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, and Yebin Liu. 2019. Deephuman: 3d human reconstruction from a single image. In Proceedings of the IEEE/CVF International Conference on Computer Vision.

[104]

Tiancheng Zhi, Christoph Lassner, Tony Tung, Carsten Stoll, Srinivasa G Narasimhan, and Minh Vo. 2020. Texmesh: Reconstructing detailed human texture and geometry from rgb-d video. In European Conference on Computer Vision.

Digital Library

Cited By

Chi CXue JZeng XJiang XZhou W(2025)Research status and application scenarios of 3D human body modelling methods in the garment ergonomics: a systematic reviewErgonomics10.1080/00140139.2025.2459877(1-22)Online publication date: 5-Feb-2025
https://doi.org/10.1080/00140139.2025.2459877
Lăzăroiu GGedeon TSzpilko DHalicka K(2024)Digital Twin-Based Alternate Ego Modeling and Simulation: Eva Herzigová as a 3D MetaHuman AvatarEngineering Management in Production and Services10.2478/emj-2024-002016:3(1-14)Online publication date: 1-Oct-2024
https://doi.org/10.2478/emj-2024-0020
Luo CLuo FWang YZhao EXiao CWooldridge MDy JNatarajan S(2024)DLCA-reconProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i4.28189(3963-3971)Online publication date: 20-Feb-2024
https://dl.acm.org/doi/10.1609/aaai.v38i4.28189
Show More Cited By

Index Terms

Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothing
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics

Recommendations

FLARE: Fast Learning of Animatable and Relightable Mesh Avatars

Our goal is to efficiently learn personalized animatable 3D head avatars from videos that are geometrically accurate, realistic, relightable, and compatible with current rendering systems. While 3D meshes enable efficient processing and are highly ...
Deep Reflectance Volumes: Relightable Reconstructions from Multi-view Photometric Images
Computer Vision – ECCV 2020
Abstract
We present a deep learning approach to reconstruct scene appearance from unstructured images captured under collocated point lighting. At the heart of Deep Reflectance Volumes is a novel volumetric scene representation consisting of opacity, ...
Animating human dressing

Dressing is one of the most common activities in human society. Perfecting the skill of dressing can take an average child three to four years of daily practice. The challenge is primarily due to the combined difficulty of coordinating different body ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 41, Issue 6

December 2022

1428 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3550454

Issue’s Table of Contents

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2022

Published in TOG Volume 41, Issue 6

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
1,843
Total Downloads

Downloads (Last 12 months)717
Downloads (Last 6 weeks)71

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chi CXue JZeng XJiang XZhou W(2025)Research status and application scenarios of 3D human body modelling methods in the garment ergonomics: a systematic reviewErgonomics10.1080/00140139.2025.2459877(1-22)Online publication date: 5-Feb-2025
https://doi.org/10.1080/00140139.2025.2459877
Lăzăroiu GGedeon TSzpilko DHalicka K(2024)Digital Twin-Based Alternate Ego Modeling and Simulation: Eva Herzigová as a 3D MetaHuman AvatarEngineering Management in Production and Services10.2478/emj-2024-002016:3(1-14)Online publication date: 1-Oct-2024
https://doi.org/10.2478/emj-2024-0020
Luo CLuo FWang YZhao EXiao CWooldridge MDy JNatarajan S(2024)DLCA-reconProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i4.28189(3963-3971)Online publication date: 20-Feb-2024
https://dl.acm.org/doi/10.1609/aaai.v38i4.28189
Jiang YShen ZHong YGuo CWu YZhang YYu JXu L(2024)Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric VideosACM Transactions on Graphics10.1145/368792643:6(1-15)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687926
Lin SLi ZSu ZZheng ZZhang HLiu Y(2024)LayGA: Layered Gaussian Avatars for Animatable Clothing TransferACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657501(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657501
Bashirov RLarionov AUstinova ESidorenko MSvitov DZakharkin ILempitsky V(2024)MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00351(3533-3543)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00351
Jiang YShen ZWang PSu ZHong YZhang YYu JXu L(2024)HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01866(19734-19745)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01866
Li ZZheng ZWang LLiu Y(2024)Animatable Gaussians: Learning Pose-Dependent Gaussian Maps for High-Fidelity Human Avatar Modeling2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01864(19711-19722)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01864
Moon GWeipeng XJoshi RChenglei WShiratori T(2024)Authentic Hand Avatar from a Phone Scan via Universal Hand Model2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00198(2029-2038)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00198
Shetty AHabermann MSun GLuvizon DGolyanik VTheobalt C(2024)Holoported Characters: Real-Time Free-Viewpoint Rendering of Humans from Sparse RGB Cameras2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00121(1206-1215)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00121
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents