research-article

Real-time data driven deformation using kernel canonical correlation analysis

Authors:

Yizhou YuAuthors Info & Claims

SIGGRAPH '08: ACM SIGGRAPH 2008 papers

Article No.: 91, Pages 1 - 9

https://doi.org/10.1145/1399504.1360690

Published: 01 August 2008 Publication History

Abstract

Achieving intuitive control of animated surface deformation while observing a specific style is an important but challenging task in computer graphics. Solutions to this task can find many applications in data-driven skin animation, computer puppetry, and computer games. In this paper, we present an intuitive and powerful animation interface to simultaneously control the deformation of a large number of local regions on a deformable surface with a minimal number of control points. Our method learns suitable deformation subspaces from training examples, and generate new deformations on the fly according to the movements of the control points. Our contributions include a novel deformation regression method based on kernel Canonical Correlation Analysis (CCA) and a Poisson-based translation solving technique for easy and fast deformation control based on examples. Our run-time algorithm can be implemented on GPUs and can achieve a few hundred frames per second even for large datasets with hundreds of training examples.

Supplementary Material

MOV File (a91-feng.mov)

Download
21.15 MB

References

[1]

Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., and Davis, J. 2005. Scape: shape completion and animation of people. ACM Transactions on Graphics 24, 3, 408--416.

Digital Library

[2]

Chai, J., and Hodgins, J. 2005. Performance animation from low-dimensional control signals. ACM TOG 24, 3, 686--696.

Digital Library

[3]

Deng, Z., Chiang, P.-Y., Fox, P., and Neumann, U. 2006. Animating blendshape faces by cross-mapping motion capture data. In I3D '06: Proceedings of the 2006 symposium on Interactive 3D graphics and games, 43--48.

Digital Library

[4]

Der, K., Sumner, R., and Popović, J. 2006. Inverse kinematics for reduced deformable models. ACM Transactions on Graphics 25, 3, 1174--1179.

Digital Library

[5]

Dontcheva, M., Yngve, G., and Popivic, Z. 2003. Layered acting for character animation. ACM TOG 22, 3, 409--416.

Digital Library

[6]

Grochow, K., Martin, S., Hertzmann, A., and Popivic, Z. 2004. Style-based inverse kinematics. ACM TOG 23, 3, 520--529.

Digital Library

[7]

Hotelling, H. 1936. Relations between two sets of variates. Biometrika 28, 321--377.

[8]

James, D., and Twigg, C. 2005. Skinning mesh animations. ACM Transactions on Graphics 24, 3, 399--407.

Digital Library

[9]

Joshi, P., Tien, W., Desbrun, M., and Pighin, F. 2003. Learning controls for blend shape based realistic facial animation. In Proceedings of the 2003 Eurographics/SIGGRAPH symposium on computer animation, 162--174.

Digital Library

[10]

Kavan, L., Collins, S., Zara, J., and O'Sullivan, C. 2007. Skinning with dual quaternions. In I3D '07: Proceedings of the 2007 symposium on Interactive 3D graphics and games, 39--46.

Digital Library

[11]

Kavan, L., McDonnell, R., Dobbyn, S., Zara, J., and O'Sullivan, C. 2007. Skinning arbitrary deformations. In I3D '07: Proceedings of the 2007 symposium on Interactive 3D graphics and games, 53--60.

Digital Library

[12]

Kircher, S., and Garland, M. 2006. Editing arbitrarily deforming surface animations. ACM Transactions on Graphics 25, 3, 1098--1107.

Digital Library

[13]

Lau, M., Chai, J., Xu, Y.-Q., and Shum, H.-Y. 2007. Face poser: Interactive modeling of 3d facial expressions using model priors. In ACM SIGGRAPH / Eurographics Symposium on Computer Animation (SCA 2007), 161--170.

Digital Library

[14]

Magnenat-Thalmann, N., Laperrire, R., and Thalmann, D. 1988. Joint-dependent local deformations for hand animation and object grasping. In Graphics Interface, 26--33.

Digital Library

[15]

Melzer, T., Reitera, M., and Bischofb, H. 2003. Appearance models based on kernel canonical correlation analysis. Pattern Recognition 36, 9, 1961--1971.

[16]

Meyer, M., and Anderson, J. 2007. Key point subspace acceleration and soft caching. ACM Transactions on Graphics 26, 3, 74.1--74.8.

Digital Library

[17]

Mohr, A., and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Transactions on Graphics 22, 3, 562--568.

Digital Library

[18]

nVidia Cuda. Compute unified device architecture (cuda). http://developer.nvidia.com/object/cuda.html.

[19]

Park, S., and Hodgins, J. 2006. Capturing and animating skin deformation in human motion. ACM Transactions on Graphics 25, 3, 881--889.

Digital Library

[20]

Shi, L., Yu, Y., Bell, N., and Feng, W.-W. 2006. A fast multigrid algorithm for mesh deformation. ACM Transactions on Graphics 25, 3, 1108--1117.

Digital Library

[21]

Sumner, R., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Transactions on Graphics 23, 3, 397--403.

Digital Library

[22]

Sumner, R., Zwicker, M., Gotsman, C., and Popović, J. 2005. Mesh-based inverse kinematics. ACM Transactions on Graphics 24, 3, 488--495.

Digital Library

[23]

Wang, R., Pulli, K., and Popović, J. 2007. Real-time enveloping with rotational regression. ACM Transactions on Graphics 26, 3, 73.1--73.9.

Digital Library

[24]

Weber, O., Sorkine, O., Lipman, Y., and Gotsman, C. 2007. Context-aware skeletal shape deformation. Computer Graphics Forum (Eurographics 2007) 26, 3, 265--274.

[25]

White, R., Crane, K., and Forsyth, D. 2007. Capturing and animating occluded cloth. ACM Transactions on Graphics 26, 3, 34.1--34.8.

Digital Library

[26]

Xu, W., Zhou, K., Yu, Y., Tan, Q., Peng, Q., and Guo, B. 2007. Gradient domain editing of deforming mesh sequences. ACM Transactions on Graphics 26, 3, 84.1--84.10.

Digital Library

[27]

Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Shum, H.-Y. 2004. Mesh editing with poisson-based gradient field manipulation. ACM Transactions on Graphics (special issue for SIGGRAPH 2004) 23, 3, 641--648.

Digital Library

[28]

Zhang, L., Snavely, N., Curless, B., and Seitz, S. M. 2004. Spacetime faces: High-resolution capture for modeling and animation. ACM Transactions on Graphics 23, 3, 548--558.

Digital Library

Cited By

Bailey SOtte DDilorenzo PO'Brien J(2018)Fast and deep deformation approximationsACM Transactions on Graphics10.1145/3197517.320130037:4(1-12)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201300
Shtern ASela MKimmel R(2018)Fast Blended Transformations for Partial Shape RegistrationJournal of Mathematical Imaging and Vision10.1007/s10851-017-0782-960:6(913-928)Online publication date: 1-Jul-2018
https://dl.acm.org/doi/10.1007/s10851-017-0782-9
Han XGao CYu Y(2017)DeepSketch2FaceACM Transactions on Graphics10.1145/3072959.307362936:4(1-12)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073629
Show More Cited By

Index Terms

Real-time data driven deformation using kernel canonical correlation analysis
1. Computing methodologies
  1. Computer graphics
    1. Animation

Recommendations

Matching People across Camera Views using Kernel Canonical Correlation Analysis
ICDSC '14: Proceedings of the International Conference on Distributed Smart Cameras

Matching people across views is still an open problem in computer vision and in video surveillance systems. In this paper we address the problem of person re-identification across disjoint cameras by proposing an efficient but robust kernel descriptor ...
A deformation transformer for real-time cloth animation

Achieving interactive performance in cloth animation has significant implications in computer games and other interactive graphics applications. Although much progress has been made, it is still much desired to have real-time high-quality results that ...
SMPL: a skinned multi-person linear model

We present a learned model of human body shape and pose-dependent shape variation that is more accurate than previous models and is compatible with existing graphics pipelines. Our Skinned Multi-Person Linear model (SMPL) is a skinned vertex-based model ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '08: ACM SIGGRAPH 2008 papers

August 2008

887 pages

ISBN:9781450301121

DOI:10.1145/1399504

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Korean Government (MOEHRD)

Conference

SIGGRAPH '08

Sponsor:

SIGGRAPH

SIGGRAPH '08: Special Interest Group on Computer Graphics and Interactive Techniques Conference

August 11 - 15, 2008

California, Los Angeles

Acceptance Rates

SIGGRAPH '08 Paper Acceptance Rate 90 of 518 submissions, 17%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
1,380
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bailey SOtte DDilorenzo PO'Brien J(2018)Fast and deep deformation approximationsACM Transactions on Graphics10.1145/3197517.320130037:4(1-12)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201300
Shtern ASela MKimmel R(2018)Fast Blended Transformations for Partial Shape RegistrationJournal of Mathematical Imaging and Vision10.1007/s10851-017-0782-960:6(913-928)Online publication date: 1-Jul-2018
https://dl.acm.org/doi/10.1007/s10851-017-0782-9
Han XGao CYu Y(2017)DeepSketch2FaceACM Transactions on Graphics10.1145/3072959.307362936:4(1-12)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073629
Jang DLee S(2017)Regression‐Based Landmark Detection on Dynamic Human ModelsComputer Graphics Forum10.1111/cgf.1327336:7(73-82)Online publication date: 13-Oct-2017
https://doi.org/10.1111/cgf.13273
Alexanderson SOSullivan CBeskow J(2017)Real-time labeling of non-rigid motion capture marker setsComputers and Graphics10.1016/j.cag.2017.10.00169:C(59-67)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1016/j.cag.2017.10.001
Sucontphunt T(2014)A practical approach for identity-embodied 3D artistic face modelingInternational Journal of Computer Games Technology10.1155/2014/7819502014(7-7)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.1155/2014/781950
Vögele AHermann MKrüger BKlein R(2012)Interactive steering of mesh animationsProceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation10.5555/2421731.2421740(53-58)Online publication date: 29-Jul-2012
https://dl.acm.org/doi/10.5555/2421731.2421740
Le BMa XDeng Z(2012)Live Speech Driven Head-and-Eye Motion GeneratorsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.7418:11(1902-1914)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.74
Ma XDeng Z(2012)A Statistical Quality Model for Data-Driven Speech AnimationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2012.6718:11(1915-1927)Online publication date: 1-Nov-2012
https://dl.acm.org/doi/10.1109/TVCG.2012.67
Rhee THwang YKim JKim CLiu KBridson RBargteil Avan de Panne M(2011)Real-time facial animation from live video trackingProceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation10.1145/2019406.2019435(215-224)Online publication date: 5-Aug-2011
https://dl.acm.org/doi/10.1145/2019406.2019435
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents