Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Deformable model for estimating clothed and naked human shapes from a single image

Published: 01 November 2013 Publication History

Abstract

Estimation of human shape from images has numerous applications ranging from graphics to surveillance. A single image provides insufficient constraints (e.g. clothing), making human shape estimation more challenging. We propose a method to simultaneously estimate a person's clothed and naked shapes from a single image of that person wearing clothing. The key component of our method is a deformable model of clothed human shape. We learn our deformable model, which spans variations in pose, body, and clothes, from a training dataset. These variations are derived by the non-rigid surface deformation, and encoded in various low-dimension parameters. Our deformable model can be used to produce clothed 3D meshes for different people in different poses, which neither appears in the training dataset. Afterward, given an input image, our deformable model is initialized with a few user-specified 2D joints and contours of the person. We optimize the parameters of the deformable model by pose fitting and body fitting in an iterative way. Then the clothed and naked 3D shapes of the person can be obtained simultaneously. We illustrate our method for texture mapping and animation. The experimental results on real images demonstrate the effectiveness of our method.

References

[1]
Allen, B., Curless, B., Popović, Z.: The space of human body shapes: reconstruction and parameterization from range scans. In: SIGGRAPH, pp. 587---594 (2003)
[2]
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: Scape: shape completion and animation of people. ACM Trans. Graph. 24(3), 408---416 (2005)
[3]
Balan, A.O., Sigal, L., Black, M.J., Davis, J.E., Haussecker, H.W.: Detailed human shape and pose from images. In: Proc. of CVPR, pp. 1---8 (2007)
[4]
Baran, I., Popović, J.: Automatic rigging and animation of 3d characters. ACM Transactions on Graphics 26(3) (2007)
[5]
Bă¿lan, A.O., Black, M.J.: The naked truth: estimating body shape under clothing. In: Proc. of ECCV, pp. 15---29 (2008)
[6]
Chai, M., Wang, L., Weng, Y., Yu, Y., Guo, B., Zhou, K.: Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31(4), 116:1---116:8 (2012)
[7]
Chen, T., Tan, P., Ma, L., Cheng, M., Shamir, A., Hu, S.: Poseshop: human image database construction and personalized content synthesis. In: IEEE Trans Vis Comput Graph (2012)
[8]
Chen, X., Li, Q., Song, Y., Jin, X., Zhao, Q.: Supervised geodesic propagation for semantic label transfer. In: Proc. of ECCV, pp. 554---566 (2012)
[9]
Chen, Y., Kim, T.K., Cipolla, R.: Inferring 3d shapes and deformations from single views. In: Proc. of ECCV, pp. 300---313 (2010)
[10]
Ghahramani, Z., Hinton, G.E.: The em algorithm for mixtures of factor analyzers. Technical Report CRG-TR-96-1 (1997)
[11]
Grochow, K., Martin, S.L., Hertzmann, A., Popović, Z.: Style-based inverse kinematics. In: SIGGRAPH, pp. 522---531 (2004)
[12]
Guan, P., Weiss, A., Bă¿lan, A.O., Black, M.J.: Estimating human shape and pose from a single image. In: Proc. of ICCV (2009)
[13]
Guo, Y., Chen, X., Zhou, B., Zhao, Q.: Clothed and naked human shapes estimation from a single image. In: Computational Visual Media, pp. 1---8 (2012)
[14]
Hasler, N., Ackermann, H., Rosenhahn, B., Thormählen, T., Seidel, H.P.: Multilinear pose and body shape estimation of dressed subjects from image sets. In: Proc. of CVPR, pp. 1823---1830 (2010)
[15]
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.P.: A statistical model of human pose and body shape. In: CGF (Proc. EG2008), vol. 2 (2009)
[16]
Huang, T., Tian, Y., Li, J., Yu, H.: Salient region detection and segmentation for general object recognition and image understanding. In: Science China Information Sciences, pp. 2461---2470 (2011)
[17]
Kraevoy, V., Sheffer, A., van de Panne, M.: Modeling from contour drawings. In: Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling, SBIM, pp. 37---44 (2009)
[18]
Lourakis, M.: levmar: Levenberg---Marquardt algorithms in C/C++ (2009). http://www.ics.forth.gr/~lourakis/levmar
[19]
Ma, Y., Košecká, J., Soatto, S., Sastry, S.: An Invitation to 3d Vision. Springer, Berlin
[20]
Rose, C.F., Sloan, P.P., Cohen, J., Cohen, M.F.: Artist-directed inverse-kinematics using radial basis function interpolation. Comput. Graph. Forum 20(3), 239---250 (2001)
[21]
Rother, C., Kolmogorov, V., Blake, A.: "grabcut": interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309---314 (2004)
[22]
Sigal, L., Balan, A.O., Black, M.J.: Combined discriminative and generative articulated pose and non-rigid shape estimation. In: Proc. of NIPS (2007)
[23]
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. 23(3), 399---405 (2004)
[24]
Teramoto, O., Park, I.K., Igarashi, T.: Interactive motion photography from a single image. Vis. Comput. 26(11), 1339---1348 (2010)
[25]
Wei, X., Chai, J.: Intuitive interactive human-character posing with millions of example poses. IEEE Comput. Graph. Appl. 31(4), 78---88 (2011)
[26]
Xu, K., Ma, L.Q., Ren, B., Wang, R., Hu, S.M.: Interactive hair rendering and appearance editing under environment lighting. In: ACM Transactions on Graphics, pp. 173 (2011)
[27]
Zhou, S., Fu, H., Liu, L., Cohen-Or, D., Han, X.: Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 126 (2010)

Cited By

View all
  • (2024)Semi-Supervised 3D Shape Segmentation via Self RefiningIEEE Transactions on Image Processing10.1109/TIP.2024.337420033(2044-2057)Online publication date: 12-Mar-2024
  • (2020)Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single ImagesComputer Vision – ECCV 202010.1007/978-3-030-58452-8_30(512-530)Online publication date: 23-Aug-2020
  • (2019)Single RGB-D Fitting: Total Human Modeling with an RGB-D ShotProceedings of the 25th ACM Symposium on Virtual Reality Software and Technology10.1145/3359996.3364252(1-11)Online publication date: 12-Nov-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image The Visual Computer: International Journal of Computer Graphics
The Visual Computer: International Journal of Computer Graphics  Volume 29, Issue 11
November 2013
131 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 November 2013

Author Tags

  1. Deformable model
  2. Human shape
  3. Shape estimation
  4. Shape-from-contour

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Semi-Supervised 3D Shape Segmentation via Self RefiningIEEE Transactions on Image Processing10.1109/TIP.2024.337420033(2044-2057)Online publication date: 12-Mar-2024
  • (2020)Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single ImagesComputer Vision – ECCV 202010.1007/978-3-030-58452-8_30(512-530)Online publication date: 23-Aug-2020
  • (2019)Single RGB-D Fitting: Total Human Modeling with an RGB-D ShotProceedings of the 25th ACM Symposium on Virtual Reality Software and Technology10.1145/3359996.3364252(1-11)Online publication date: 12-Nov-2019
  • (2019)LiveCapACM Transactions on Graphics10.1145/331197038:2(1-17)Online publication date: 13-Mar-2019
  • (2018)Physics-Inspired Garment Recovery from a Single-View ImageACM Transactions on Graphics10.1145/302647937:5(1-14)Online publication date: 19-Nov-2018
  • (2016)3D Body Shapes Estimation from Dressed-Human SilhouettesComputer Graphics Forum10.5555/3151666.315168235:7(147-156)Online publication date: 1-Oct-2016
  • (2016)Parametric Human Body Reconstruction Based on Sparse Key PointsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2015.251175122:11(2467-2479)Online publication date: 20-Sep-2016
  • (2016)Optimizing human model reconstruction from RGB-D images based on skin detectionVirtual Reality10.1007/s10055-016-0291-y20:3(159-172)Online publication date: 1-Sep-2016
  • (2015)3D Mesh Labeling via Deep Convolutional Neural NetworksACM Transactions on Graphics10.1145/283548735:1(1-12)Online publication date: 29-Dec-2015
  • (2014)Interactive Image-Guided Modeling of Extruded ShapesComputer Graphics Forum10.1111/cgf.1247833:7(101-110)Online publication date: 1-Oct-2014

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media