Article

Open access

SCAPE: shape completion and animation of people

Authors:

Dragomir Anguelov,

Praveen Srinivasan,

Sebastian Thrun,

James DavisAuthors Info & Claims

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Pages 408 - 416

https://doi.org/10.1145/1186822.1073207

Published: 01 July 2005 Publication History

Abstract

We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both articulated and non-rigid deformations. We learn a pose deformation model that derives the non-rigid surface deformation as a function of the pose of the articulated skeleton. We also learn a separate model of variation based on body shape. Our two models can be combined to produce 3D surface models with realistic muscle deformation for different people in different poses, when neither appear in the training set. We show how the model can be used for shape completion --- generating a complete surface mesh given a limited set of markers specifying the target shape. We present applications of shape completion to partial view completion and motion capture animation. In particular, our method is capable of constructing a high-quality animated surface model of a moving person, with realistic muscle deformation, using just a single static scan and a marker motion capture sequence of the person.

Supplementary Material

MP4 File (pps002.mp4)

Download
38.64 MB

References

[1]

Allen, B., Curless, B., and Popović, Z. 2002. Articulated body deformation from range scan data. ACM Transactions on Graphics, 21(3), 612--619.

Digital Library

[2]

Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Transactions on Graphics, 22(3), 587--594.

Digital Library

[3]

Anguelov, D., Koller, D., Pang, H., Srinivasan, P., and Thrun, S. 2004. Recovering articulated object models from 3D range data. In Proceedings of the 20th conference on Uncertainty in artificial intelligence, 18--26.

Digital Library

[4]

Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Pang, H., and Davis, J. 2005. The correlated correspondence algorithm for unsupervised registration of nonrigid surfaces. In Advances in Neural Information Processing Systems 17, 33--40.

[5]

Cheung, K. M., Baker, S., and Kanade, T. 2003. Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture. In Conference on Computer Vision and Pattern Recognition (CVPR), 77--84.

Digital Library

[6]

Curless, B., and Levoy, M. 1996. A volumetric method of building complex models from range images. Proceedings of SIGGRAPH 1996, 303--312.

Digital Library

[7]

Davis, J., Marschner, S., Garr, M., and Levoy, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Symposium on 3D Data Processing, Visualization, and Transmission.

[8]

Garland, M., and Heckbert, P. S. 1997. Surface simplification using quadric error metrics. In Proceedings of SIGGRAPH 97, 209-216.

Digital Library

[9]

Hähnel, D., Thrun, S., and Burgard, W. 2003. An extension of the ICP algorithm for modeling nonrigid objects with mobile robots. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).

Digital Library

[10]

Hilton, A., Starck, J., and Collins, G. 2002. From 3d shape capture to animated models. In First International Symposion on 3D Data Processing. Visualization and Transmission (3DVPT2002).

[11]

Kähler, K., Haber, J., Yamauchi, H., and Seidel, H.-P. 2002. Head shop: generating animated head models with anatomical structure. In ACM SIGGRAPH Symposium on Computer Animation, 55--64.

Digital Library

[12]

Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. Proceedings of ACM SIGGRAPH 2000, 165--172.

Digital Library

[13]

Liepa, P. 2003. Filling holes in meshes. In Proc. of the Eurographics/ACM SIGGRAPH symposium on Geometry processing, 200--205.

Digital Library

[14]

Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. 2004. An Invitation to 3D Vision. Springer Verlag.

[15]

Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Transactions on Graphics, 22(3), 562--568.

Digital Library

[16]

Noh, J., and Neumann, U. 2001. Expression cloning. Proceedings of ACM SIGGRAPH 2001, 277--288.

Digital Library

[17]

Popović, Z., Grochow, K., Martin, S. L., and Hertzmann, A. 2004. Style-based inverse kinematics. ACM Transactions on Graphics, 23(3), 522--531.

Digital Library

[18]

Sand, P., McMillan, L., and Popović, J. 2003. Continuous capture of skin deformation. ACM Transactions on Graphics, 22(3), 578--586.

Digital Library

[19]

Seo, H., and Magnenat-Thalmann, N. 2003. An automatic modeling of human bodies from sizing parameters. In ACM Symposium on Interactive 3D Graphics, 19--26.

Digital Library

[20]

Sloan, P.-P. J., Rose, C. F., and Cohen, M. F. 2001. Shape by example. In 2001 Symposium on Interactive 3D Graphics, 135--144.

Digital Library

[21]

Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. Proceedings of ACM SIGGRAPH 2004, 23(3), 399--405.

Digital Library

[22]

Szeliski, R., and Lavallee, S. 1996. Matching 3-d anatomical surfaces with non-rigid deformations using using octree-splines. International Journal of Computer Vision 18, 2, 171--186.

Digital Library

[23]

Vasilescu, M., and Terzopoulos, D. 2002. Multilinear analysis of image ensembles: Tensorfaces. In European Conference on Computer Vision (ECCV), 447--460.

Digital Library

[24]

Vlasic, D., Pfister, H., Brand, M., and Popović, J. 2004. Multilinear models for facial synthesis. In SIGGRAPH Research Sketch.

Digital Library

[25]

Wang, X. C., and Phillips, C. 2002. Multi-weight enveloping: least-squares approximation techniques for skin animation. In ACM SIGGRAPH Symposium on Computer Animation, 129--138.

Digital Library

Cited By

Gan SXu GZhuge SZhang GZhang X(2024)Geodesic-Based Maximal Cliques Search for Non-Rigid Human Point Cloud RegistrationSensors10.3390/s2421692424:21(6924)Online publication date: 29-Oct-2024
https://doi.org/10.3390/s24216924
Hu LWang HYang XXu HLiao Y(2024)AFSMWD: A Descriptor Flexibly Encoding Multiscale and Oriented Shape FeaturesMathematics10.3390/math1218294612:18(2946)Online publication date: 22-Sep-2024
https://doi.org/10.3390/math12182946
So JYoum SKim S(2024)A Human Body Simulation Using Semantic Segmentation and Image-Based Reconstruction Techniques for Personalized HealthcareApplied Sciences10.3390/app1416710714:16(7107)Online publication date: 13-Aug-2024
https://doi.org/10.3390/app14167107
Show More Cited By

Index Terms

SCAPE: shape completion and animation of people
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Hierarchical representations
  2. Computer graphics
    1. Animation
    2. Shape modeling

Recommendations

SCAPE: shape completion and animation of people

We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...
The space of human body shapes: reconstruction and parameterization from range scans

We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. ...
SCAPE: Shape Completion and Animation of People
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

We introduce the SCAPE method (Shape Completion and Animation for PEople)-a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

July 2005

826 pages

ISBN:9781450378253

DOI:10.1145/1186822

Editor:
Markus Gross
Eidgenössische Technische Hochschule Zürich

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Author Tags

Qualifiers

Article

Conference

SIGGRAPH05

Sponsor:

SIGGRAPH

SIGGRAPH05: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 31 - August 4, 2005

California, Los Angeles

Acceptance Rates

SIGGRAPH '05 Paper Acceptance Rate 98 of 461 submissions, 21%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

373
Total Citations
View Citations
5,213
Total Downloads

Downloads (Last 12 months)543
Downloads (Last 6 weeks)85

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gan SXu GZhuge SZhang GZhang X(2024)Geodesic-Based Maximal Cliques Search for Non-Rigid Human Point Cloud RegistrationSensors10.3390/s2421692424:21(6924)Online publication date: 29-Oct-2024
https://doi.org/10.3390/s24216924
Hu LWang HYang XXu HLiao Y(2024)AFSMWD: A Descriptor Flexibly Encoding Multiscale and Oriented Shape FeaturesMathematics10.3390/math1218294612:18(2946)Online publication date: 22-Sep-2024
https://doi.org/10.3390/math12182946
So JYoum SKim S(2024)A Human Body Simulation Using Semantic Segmentation and Image-Based Reconstruction Techniques for Personalized HealthcareApplied Sciences10.3390/app1416710714:16(7107)Online publication date: 13-Aug-2024
https://doi.org/10.3390/app14167107
Zhang HXu HWang YXiong R(2024)Human-Robot Sign Language Motion Retargeting from Videos2024 43rd Chinese Control Conference (CCC)10.23919/CCC63176.2024.10662807(4736-4741)Online publication date: 28-Jul-2024
https://doi.org/10.23919/CCC63176.2024.10662807
Dal Brun DPescarini ECalonaci SBonello EMeneguzzo P(2024)Body evaluation in men: the role of body weight dissatisfaction in appearance evaluation, eating, and muscle dysmorphia psychopathologyJournal of Eating Disorders10.1186/s40337-024-01025-912:1Online publication date: 21-May-2024
https://doi.org/10.1186/s40337-024-01025-9
Lian YPei SChen MHua J(2024)Relation Constrained Capsule Graph Neural Networks for Non-Rigid Shape CorrespondenceACM Transactions on Intelligent Systems and Technology10.1145/368885115:6(1-26)Online publication date: 16-Aug-2024
https://dl.acm.org/doi/10.1145/3688851
Sundararaman RDonati NMelzi SCorman EOvsjanikov M(2024)Deformation Recovery: Localized Learning for Detail-Preserving DeformationsACM Transactions on Graphics10.1145/368796843:6(1-16)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687968
Luo ZLiu HLi CDu WJin ZSun WNie YChen WHan X(2024)GarVerseLOD: High-Fidelity 3D Garment Reconstruction from a Single In-the-Wild Image using a Dataset with Levels of DetailsACM Transactions on Graphics10.1145/368792143:6(1-12)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687921
Lang IXu FDecatur DBabu SHanocka R(2024)iSeg: Interactive 3D Segmentation via Interactive AttentionSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687605(1-11)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687605
Wu YShu CPai D(2024)RightSizing: Disentangling Generative Models of Human Body Shapes with Metric ConstraintsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3671658(1-10)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3671658
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents