Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Learning a shared shape space for multimodal garment design

Published: 04 December 2018 Publication History

Abstract

Designing real and virtual garments is becoming extremely demanding with rapidly changing fashion trends and increasing need for synthesizing realisticly dressed digital humans for various applications. This necessitates creating simple and effective workflows to facilitate authoring sewing patterns customized to garment and target body shapes to achieve desired looks. Traditional workflow involves a trial-and-error procedure wherein a mannequin is draped to judge the resultant folds and the sewing pattern iteratively adjusted until the desired look is achieved. This requires time and experience. Instead, we present a data-driven approach wherein the user directly indicates desired fold patterns simply by sketching while our system estimates corresponding garment and body shape parameters at interactive rates. The recovered parameters can then be further edited and the updated draped garment previewed. Technically, we achieve this via a novel shared shape space that allows the user to seamlessly specify desired characteristics across multimodal input without requiring to run garment simulation at design time. We evaluate our approach qualitatively via a user study and quantitatively against test datasets, and demonstrate how our system can generate a rich quality of on-body garments targeted for a range of body shapes while achieving desired fold characteristics. Code and data are available at our project webpage.

Supplementary Material

ZIP File (a203-wang.zip)
Supplemental files.
MP4 File (a203-wang.mp4)

References

[1]
2018. Marvelous Designer. https://www.marvelousdesigner.com. (2018). Accessed: 2018-03-30.
[2]
2018. NVIDIA Flex. https://developer.nvidia.com/flex. (2018). Accessed: 2018-03-30.
[3]
2018. Optitext Fashion Design Software. https://optitex.com/. (2018). Accessed: 2018-03-30.
[4]
2018. torchvision. https://pytorch.org/docs/master/torchvision/. (2018). Accessed: 2018-03-30.
[5]
Aric Bartle, Alla Sheffer, Vladimir G. Kim, Danny M. Kaufman, Nicholas Vining, and Floraine Berthouzoz. 2016. Physics-driven Pattern Adjustment for Direct 3D Garment Editing. ACM SIGGRAPH 35, 4, Article 50 (July 2016), 11 pages.
[6]
Floraine Berthouzoz, Akash Garg, Danny M. Kaufman, Eitan Grinspun, and Maneesh Agrawala. 2013. Parsing Sewing Patterns into 3D Garments. ACM SIGGRAPH 32, 4, Article 85 (July 2013), 12 pages.
[7]
Derek Bradley, Tiberiu Popa, Alla Sheffer, Wolfgang Heidrich, and Tamy Boubekeur. 2008. Markerless Garment Capture. ACM SIGGRAPH 27, 3, Article 99 (Aug. 2008), 9 pages.
[8]
Remi Brouet, Alla Sheffer, Laurence Boissieux, and Marie-Paule Cani. 2012. Design Preserving Garment Transfer. ACM TOG 31, 4, Article 36 (July 2012), 11 pages.
[9]
Xiaowu Chen, Bin Zhou, Feixiang Lu, Lin Wang, Lang Bi, and Ping Tan. 2015. Garment Modeling with a Depth Camera. ACM SIGGRAPH Asia 34, 6, Article 203 (Oct. 2015), 12 pages.
[10]
R. Daněřek, E. Dibra, C. Öztireli, R. Ziegler, and M. Gross. 2017. DeepGarment: 3D Garment Shape Estimation from a Single Image. CGF Eurographics 36, 2 (May 2017), 269--280.
[11]
Doug DeCarlo, Adam Finkelstein, Szymon Rusinkiewicz, and Anthony Santella. 2003. Suggestive Contours for Conveying Shape. ACM Transactions on Graphics (Proc. SIGGRAPH) 22, 3 (July 2003), 848--855.
[12]
Philippe Decaudin, Dan Julius, Jamie Wither, Laurence Boissieux, Alla Sheffer, and Marie-Paule Cani. 2006. Virtual Garments: A Fully Geometric Approach for Clothing Design. CGF (2006).
[13]
P. Guan, L. Reiss, D. Hirshberg, A. Weiss, and M. J. Black. 2012. DRAPE: DRessing Any PErson. ACM SIGGRAPH 31, 4 (July 2012), 35:1--35:10.
[14]
Xiaoguang Han, Chang Gao, and Yizhou Yu. 2017. DeepSketch2Face: a deep learning based sketching system for 3D face and caricature modeling. ACM Transactions on Graphics (TOG) 36, 4 (2017), 126.
[15]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[16]
Charles Hecklinger. 1891. The Keystone System: A Text-Book on Cutting and Designing Ladies Garments. The West Publishing Co., New York.
[17]
Gao Huang, Zhuang Liu, Laurens van der Maaten, and Kilian Q Weinberger. 2017. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
[18]
Moon-Hwan Jeong, Dong-Hoon Han, and Hyeong-Seok Ko. 2015. Garment Capture from a Photograph. Comput. Animat. Virtual Worlds 26, 3--4 (May 2015), 291--300.
[19]
Amaury Jung, Stefanie Hahmann, Damien Rohmer, Antoine Begault, Laurence Boissieux, and Marie-Paule Cani. 2015. Sketching Folds: Developable Surfaces from Non-Planar Silhouettes. ACM TOG 34, 5, Article 155 (Nov. 2015), 12 pages.
[20]
Tsz-Ho Kwok, Yan-Qiu Zhang, Charlie CL Wang, Yong-Jin Liu, and Kai Tang. 2016. Styling evolution for tight-fitting garments. IEEE transactions on visualization and computer graphics 22, 5 (2016), 1580--1591.
[21]
Christoph Lassner, Javier Romero, Martin Kiefel, Federica Bogo, Michael J. Black, and Peter V. Gehler. 2017. Unite the People: Closing the Loop Between 3D and 2D Human Representations. In IEEE CVPR. http://up.is.tuebingen.mpg.de
[22]
Changjian Li, Hao Pan, Yang Liu, Xin Tong, Alla Sheffer, and Wenping Wang. 2017. BendSketch: Modeling Freeform Surfaces Through 2D Sketching. ACM TOG 36, 4, Article 125 (July 2017), 14 pages.
[23]
Minchen Li, Alla Sheffer, Eitan Grinspun, and Nicholas Vining. 2018. FoldSketch: Enriching Garments with Physically Reproducible Folds. ACM TOG 37, 4 (2018).
[24]
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM SIGGRAPH Asia 34, 6 (Oct. 2015), 248:1--248:16.
[25]
Yuwei Meng, Charlie CL Wang, and Xiaogang Jin. 2012. Flexible shape control for automatic resizing of apparel products. CAD 44, 1 (2012), 68--76.
[26]
A. Neophytou and A. Hilton. 2014. A Layered Model of Human Body and Garment Deformation. In Int. Conf. on 3D Vision, Vol. 1. 171--178.
[27]
Gerard Pons-Moll, Sergi Pujades, Sonny Hu, and Michael Black. 2017. ClothCap: Seamless 4D Clothing Capture and Retargeting. ACM SIGGRAPH 36, 4 (2017).
[28]
Tiberiu Popa, Qingnan Zhou, Derek Bradley, Vladislav Kraevoy, Hongbo Fu, Alla Sheffer, and Wolfgang Heidrich. 2009. Wrinkling Captured Garments Using Space-Time Data-Driven Deformation. CGF Eurographics 28, 2 (2009), 427--435.
[29]
D. Pritchard and W. Heidrich. 2003. Cloth Motion Capture. CGF Eurographics 22, 3 (2003), 263--271.
[30]
C. Robson, R. Maharik, A. Sheffer, and N. Carr. 2011. Context-Aware Garment Modeling from Sketches. Computers and Graphics (Proc. SMI 2011) (2011), 604--613.
[31]
Damien Rohmer, Marie-Paule Cani, Stefanie Hahmann, and Boris Thibert. 2011. Folded Paper Geometry from 2D Pattern and 3D Contour. In Eurographics 2011 (short paper), Sylvain Lefebvre Nick Avis (Ed.). 21--24. https://hal.inria.fr/inria-00567408
[32]
Volker Scholz, Timo Stich, Michael Keckeisen, Markus Wacker, and Marcus Magnor. 2005. Garment Motion Capture Using Color-Coded Patterns. CGF Eurographics 24, 3 (2005), 439--447.
[33]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[34]
Emmanuel Turquin, Marie-Paule Cani, and John F. Hughes. 2004. Sketching Garments for Virtual Characters .. In EG SBIM. 175--182.
[35]
Nobuyuki Umetani. 2017. Exploring generative 3D shapes using autoencoder networks. In SIGGRAPH Asia 2017 Technical Briefs. ACM, 24.
[36]
Nobuyuki Umetani, Danny M. Kaufman, Takeo Igarashi, and Eitan Grinspun. 2011. Sensitive Couture for Interactive Garment Modeling and Editing. ACM TOG 30, 4, Article 90 (July 2011), 12 pages.
[37]
L.J.P. van der Maaten and G.E. Hinton. 2008. Visualizing High-Dimensional Data Using t-SNE. Journal of Machine Learning Research (2008).
[38]
Huamin Wang. 2018. Rule-free sewing pattern adjustment with precision and efficiency. ACM Transactions on Graphics (TOG) 37, 4 (2018), 53.
[39]
Huamin Wang, Florian Hecht, Ravi Ramamoorthi, and James F. O'Brien. 2010. Example-based Wrinkle Synthesis for Clothing Animation. ACM Trans. Graph. 29, 4, Article 107 (July 2010), 8 pages.
[40]
Ryan White, Keenan Crane, and D. A. Forsyth. 2007. Capturing and Animating Occluded Cloth. ACM SIGGRAPH 26, 3, Article 34 (July 2007).
[41]
Weiwei Xu, Nobuyuki Umentani, Qianwen Chao, Jie Mao, Xiaogang Jin, and Xin Tong. 2014. Sensitivity-optimized Rigging for Example-based Real-time Clothing Synthesis. ACM TOG 33, 4, Article 107 (July 2014), 11 pages.
[42]
Shan Yang, Tanya Ambert, Zherong Pan, Ke Wang, Licheng Yu, Tamara Berg, and Ming C. Lin. 2016. Detailed Garment Recovery from a Single-View Image. CoRR (2016).
[43]
Bin Zhou, Xiaowu Chen, Qiang Fu, Kan Guo, and Ping Tan. 2013. Garment Modeling from a Single Image. CGF 32, 7 (2013).

Cited By

View all
  • (2024)Digitally Creating Garmentsデジタルで衣服をつくるJournal of Japan Society of Kansei Engineering10.5057/kansei.22.1_322:1(3-10)Online publication date: 31-Mar-2024
  • (2024)Knowledge Graph Oriented Apparel Digital Design and PracticeApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-20039:1Online publication date: 5-Aug-2024
  • (2024)DressCode: Autoregressively Sewing and Generating Garments from Text GuidanceACM Transactions on Graphics10.1145/365814743:4(1-13)Online publication date: 19-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 37, Issue 6
December 2018
1401 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3272127
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 December 2018
Published in TOG Volume 37, Issue 6

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. garment design
  2. interactive design
  3. latent representation
  4. multimodal input
  5. shared shape space

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Digitally Creating Garmentsデジタルで衣服をつくるJournal of Japan Society of Kansei Engineering10.5057/kansei.22.1_322:1(3-10)Online publication date: 31-Mar-2024
  • (2024)Knowledge Graph Oriented Apparel Digital Design and PracticeApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-20039:1Online publication date: 5-Aug-2024
  • (2024)DressCode: Autoregressively Sewing and Generating Garments from Text GuidanceACM Transactions on Graphics10.1145/365814743:4(1-13)Online publication date: 19-Jul-2024
  • (2024)Efficient Deformation Learning of Varied Garments with a Structure-Preserving Multilevel FrameworkProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/36512867:1(1-19)Online publication date: 13-May-2024
  • (2024)Digital Garment AlterationComputer Graphics Forum10.1111/cgf.1524843:7Online publication date: 7-Nov-2024
  • (2024)Neural Garment Dynamics via Manifold‐Aware TransformersComputer Graphics Forum10.1111/cgf.1502843:2Online publication date: 30-Apr-2024
  • (2024)Panelformer: Sewing Pattern Reconstruction from 2D Garment Images2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00051(443-452)Online publication date: 3-Jan-2024
  • (2024)LayerNet: High-Resolution Semantic 3D Reconstruction of Clothed PeopleIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.333267746:2(1257-1272)Online publication date: 1-Feb-2024
  • (2024)Doodle Your 3D: from Abstract Freehand Sketches to Precise 3D Shapes2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00935(9795-9805)Online publication date: 16-Jun-2024
  • (2024)Cloth2Tex: A Customized Cloth Texture Generation Pipeline for 3D Virtual Try-On2024 International Conference on 3D Vision (3DV)10.1109/3DV62453.2024.00021(602-611)Online publication date: 18-Mar-2024
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media