article

Reconstructing 3D human models with a Kinect

Authors:

Guodong Lu, and

Dongliang ZhangAuthors Info & Claims

Computer Animation and Virtual Worlds, Volume 27, Issue 1

Pages 72 - 85

https://doi.org/10.1002/cav.1632

Published: 01 January 2016 Publication History

Abstract

Three-dimensional human model reconstruction has wide applications due to the rapid development of computer vision. The appearance of cheap depth camera, such as Kinect, opens up new horizons for home-oriented 3D human reconstructions. However, the resolution of Kinect is relatively low, making it difficult to build accurate human models. In this paper, we improve the accuracy of human model reconstruction from two aspects. First, we improve the depth data quality by registering the depth images captured from multi-views with a single Kinect. The part-wise registration method and implicit-surface-based de-noising method are proposed. Second, we utilize a statistical human model to iteratively augment and complete the human body information by fitting the statistical human model to the registered depth image. Experimental results and several applications demonstrate the applicability and quality of our system, which can be potentially used in virtual try-on systems. Copyright © 2015 John Wiley & Sons, Ltd.

References

[1]

Kasap M, Magnenat-Thalmann N. Skeleton-aware size variations in digital mannequins. The Visual Computer 2011; Volume 27: pp.263-274.

Digital Library

[2]

Wang CCL, Wang Y, Chang TKK, Yuen MMF. Virtual human modeling from photographs for garment industry. Computer-Aided Design 2003; Volume 35: pp.577-589.

[3]

Liu YJ, Zhang DL, Yuen MMF. A survey on CAD methods in 3D garment design. Computers In Industry 2010; Volume 61 Issue 6: pp.576-593.

Digital Library

[4]

Gong WY, Liu YJ, Tang K, Wu T. Approximate Delaunay mesh reconstruction and quality estimation from point samples. Journal of Computational and Applied Mathematics 2015; Volume 274: pp.23-34.

[5]

Liu YJ, Yuen MMF. Optimized triangle mesh reconstruction from unstructured points. The Visual Computer 2003; Volume 19 Issue 1: pp.23-37.

[6]

Besl PJ, Mckay ND. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992; Volume 14: pp.239-256.

Digital Library

[7]

Chen Y, Medioni G. Object modeling by registration of multiple range images. Image and Vision Computing 1992; Volume 10: pp.145-155.

Digital Library

[8]

Masuda T. Generation of geometric model by registration and integration of multiple range images. In Proceedings of Third International Conference on 3-D Digital Imaging and Modeling, Quebec City, Que, Canada, 2001; pp.254-261.

[9]

Silva L, Bellon ORP, Boyer KL. Enhanced, robust genetic algorithms for multiview range image registration. In Proceedings of Fourth International Conference on 3-D Digital Imaging and Modeling, Banff, Alberta, Canada, 2003; pp.268-275.

[10]

OpenNI. http://www.openni.org/

[11]

Henry P, Krainin M, Herbst E, Ren XF, Fox D. RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments. International Journal of Robotics Research 2012; Volume 31: pp.647-663.

Digital Library

[12]

Newcombe RA, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison AJ, et al. KinectFusion: real-time dense surface mapping and tracking. In 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland, 2011; pp.127-136.

Digital Library

[13]

Izadi S, Kim D, Hilliges O, Molyneaux D, Newcombe R, Kohli P, et al. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, Santa Barbara, CA, United States, 2011: pp.559-568.

Digital Library

[14]

Tong J, Zhou J, Liu LG, Pan ZG, Yan H. Scanning 3D full human bodies using Kinects. IEEE Transactions on Visualization and Computer Graphics 2012; Volume 18: pp.643-650.

Digital Library

[15]

Weiss A, Hirshberg D, Black MJ. Home 3D body scans from noisy image and range data. In Proceedings of IEEE International Conference on Computer Vision, Barcelona, Spain, 2011; pp.1951-1958.

Digital Library

[16]

Anguelov D, Srinivasan P, Koller D, Thrun S, Rodgers J, Davis J. SCAPE: shape completion and animation of people. ACM Transactions on Graphics 2005; Volume 24: pp.408-416.

Digital Library

[17]

Zollhofer M, Martinek M, Greiner G, Stamminger M, Sussmuth J. Automatic reconstruction of personalized avatars from 3D face scans. Computer Animation and Virtual Worlds 2011; Volume 22: pp.195-202.

Digital Library

[18]

Weise T, Bouaziz S, Li H, Pauly M. Real time performance-based facial animation. ACM Transactions on Graphics 2011; Volume 30 Issue 4: pp.1-10.

Digital Library

[19]

Sorkine O, Cohen-Or D, Lipman Y, Alexa M, Rossl C, Seidel HP. Laplacian surface editing. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, Nice, France, 2004; pp.175-184.

Digital Library

[20]

Allen B, Curless B, Popovic Z. The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics 2003; Volume 22: pp.587-594.

Digital Library

[21]

Hasler N, Stoll C, Sunkel M, Rosenhahn B, Seidel HP. A statistical model of human pose and body shape. Computer Graphics Forum 2009; Volume 28: pp.337-346.

[22]

Chu CH, Tsai YT, Wang CCL, Kwok TH. Exemplar-based statistical model for semantic parametric design of human body. Computers in Industry 2010; Volume 61: pp.541-549.

Digital Library

[23]

Liu YJ, Yuen MMF, Xiong S. A feature-based approach for individualized human head modeling. The Visual Computer 2002; Volume 18 Issue 5-6: pp.368-381.

[24]

Cui Y, Chang W, Noll T, Stricker D. KinectAvatar: fully automatic body capture using a single Kinect. In Proceedings of the 11th International Conference on Computer Vision 2012; pp.133-147.

Digital Library

[25]

Hasler N, Stoll C, Rosenhahn B, Thormahlen T, Seidel HP. Estimating body shape of dressed humans. Computers and Graphics 2009; Volume 33: pp.211-216.

Digital Library

[26]

Li JT, Wang YS. Automatically constructing skeletons and parametric structures for polygonal human bodies. In Proceedings of Computer Graphics International 2007; pp.151-156.

[27]

Li JT, Lu GD. Skeleton driven animation based on implicit skinning. Computers and Graphics 2011; Volume 35: pp.945-954.

Digital Library

[28]

Zhang ZY. Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision 1994; Volume 13: pp.119-152.

Digital Library

[29]

Carr JC, Beatson RK, Cherrie JB, Mitchell TJ, Fright WR, McCallum BC, Evans TR. Reconstruction and re- presentation of 3D objects with radial basis functions. In Proceedings of the 28th Annual conference on Computer graphics and interactive techniques 2001; pp.67-76.

Digital Library

[30]

Sorkine O, Alexa M. As-rigid-as-possible surface modeling. In Proceedings of the fifth Eurographics Symposium on Geometry Processing, Barcelona, Spain, 2007; pp.109-116.

Digital Library

[31]

Li JT, Lu GD, Liu Z, Liu JZ, Wang XY. Feature curve-net-based three- dimensional garment customization. Textile Research Journal 2013; Volume 83: pp.519-531.

[32]

Li JT, Lu GD. Customizing 3D garments based on volumetric deformation. Computers In Industry 2011; Volume 62 Issue 7: pp.693-707.

Digital Library

Cited By

Guo ZZhang DLi J(2021)A Comfort Feedback Method for Remote FittingExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451729(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451729
Ryselis KPetkus TBlažauskas TMaskeliūnas RDamaševičius R(2020)Multiple Kinect based system to monitor and analyze key performance indicators of physical trainingHuman-centric Computing and Information Sciences10.1186/s13673-020-00256-410:1Online publication date: 14-Dec-2020
https://dl.acm.org/doi/10.1186/s13673-020-00256-4
Xu HLi JWeng JDeng HZhou CZhang DLu G(2018)The Design of a Deformable Robotic Mannequin2018 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO.2018.8665194(630-635)Online publication date: 12-Dec-2018
https://dl.acm.org/doi/10.1109/ROBIO.2018.8665194
Show More Cited By

Index Terms

Reconstructing 3D human models with a Kinect
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction

Index terms have been assigned to the content through auto-classification.

Recommendations

3D Human Postures Recognition Using Kinect
IHMSC '12: Proceedings of the 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 01

In many application cases, 2D human postures display haven't been able to meet people's requirements which is failure to show human motions comprehensive, image and vivid. However, 3D human Postures display could restore and show human motions well, ...
Read More
Reconstruction of 3D human body pose from stereo image sequences based on top-down learning

This paper presents a novel method for reconstructing a 3D human body pose from stereo image sequences based on a top-down learning method. However, it is inefficient to build a statistical model using all training data. Therefore, the training data is ...
Read More
Gait Recognition for Human Identification using Kinect
RACS '17: Proceedings of the International Conference on Research in Adaptive and Convergent Systems

Gait is a pattern of biometric movement for human identification. Unlike other biometrics such as fingerprint, iris, face, and voice recognition, human gait can be captured with unobtrusive method. In this paper, several measurements are proposed which ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Computer Animation and Virtual Worlds

Computer Animation and Virtual Worlds Volume 27, Issue 1

January 2016

85 pages

ISSN:1546-4261

Issue’s Table of Contents

Publisher

John Wiley and Sons Ltd.

United Kingdom

Publication History

Published: 01 January 2016

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Guo ZZhang DLi J(2021)A Comfort Feedback Method for Remote FittingExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3451729(1-6)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3451729
Ryselis KPetkus TBlažauskas TMaskeliūnas RDamaševičius R(2020)Multiple Kinect based system to monitor and analyze key performance indicators of physical trainingHuman-centric Computing and Information Sciences10.1186/s13673-020-00256-410:1Online publication date: 14-Dec-2020
https://dl.acm.org/doi/10.1186/s13673-020-00256-4
Xu HLi JWeng JDeng HZhou CZhang DLu G(2018)The Design of a Deformable Robotic Mannequin2018 IEEE International Conference on Robotics and Biomimetics (ROBIO)10.1109/ROBIO.2018.8665194(630-635)Online publication date: 12-Dec-2018
https://dl.acm.org/doi/10.1109/ROBIO.2018.8665194
Chen GLi JZeng JWang BLu G(2018)Optimizing human model reconstruction from RGB-D images based on skin detectionVirtual Reality10.1007/s10055-016-0291-y20:3(159-172)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1007/s10055-016-0291-y
Dai GYu LXu HHou ZFei S(2018)Federated Filter Algorithm with Positioning Technique Based on 3D SensorCircuits, Systems, and Signal Processing10.1007/s00034-017-0686-337:6(2613-2628)Online publication date: 1-Jun-2018
https://dl.acm.org/doi/10.1007/s00034-017-0686-3

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents