article

Turning to the masters: motion capturing cartoons

Authors:

Christoph Bregler,

Hrishi DeshpandeAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 21, Issue 3

Pages 399 - 407

https://doi.org/10.1145/566654.566595

Published: 01 July 2002 Publication History

Abstract

In this paper, we present a technique we call "cartoon capture and retargeting" which we use to track the motion from traditionally animated cartoons and retarget it onto 3-D models, 2-D drawings, and photographs. By using animation as the source, we can produce new animations that are expressive, exaggerated or non-realistic.Cartoon capture transforms a digitized cartoon into a cartoon motion representation. Using a combination of affine transformation and key-shape interpolation, cartoon capture tracks non-rigid shape changes in cartoon layers. Cartoon retargeting translates this information into different output media. The result is an animation with a new look but with the movement of the original cartoon.

References

[1]

ALEXA, M., AND MÜLLER, W. 2000. Representing animations by principal components. 411-418. ISSN 1067-7055.

[2]

ALEXA, M., COHEN-OR, D., AND LEVIN, D. 2000. As-rigid-as-possible shape interpolation. In Proceedings of SIGGRAPH 2000, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, Computer Graphics Proceedings, Annual Conference Series, 157-164. ISBN 1-58113-208-5.

[3]

BERGEN, J., ANANDAN, P., HANNA, K., AND HINGORANI, R. 1992. Hierarchical model-based motion estimation. In ECCV, 237-252.

[4]

BLACK, M., AND JEPSON, A., 1996. Eigentracking: robust matching and tracking of articulated objects using a view-based representation.

[5]

BLANZ, V., AND VETTER, T. August 1999. A morphable model for the synthesis of 3d faces. Proceedings of SIGGRAPH 99, 187-194. ISBN 0-20148-560-5. Held in Los Angeles, California.

[6]

BREGLER, C., AND OMOHUNDRO, S. 1994. Surface learning with applications to lipreading. In Advances in Neural Information Processing Systems, Morgan Kaufman, San Francisco, A. Cowan, Tesauro, Ed.

[7]

CANNY, J. 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679-698.

[8]

GILL, P., MURRAY, W., AND WRIGHT, M. 1981. Practical Optimization. Academic Press, London, UK.

[9]

GLEICHER, M. 1998. Retargeting motion to new characters. In SIGGRAPH 98 Conference Proceedings, Addison Wesley, M. Cohen, Ed., Annual Conference Series, ACM SIGGRAPH, 33-42. ISBN 0-89791-999-8.

[10]

HORN, B., AND SCHUNK, G. 1981. Determining optical flow. Artificial Intelligence 17.

[11]

JOLLIFE, I. T. 1986. Principal Components Analysis. New York: Springer.

[12]

LANITIS, A., TAYLOR, C., COOTES, T., AND AHMED, T. 1995. Automatic interpretation of human faces and hand gestures using flexible models. In International Workshop on Automatic Face- and Gesture-Recognition.

[13]

LUCAS, B., AND KANADE, T. 1981. An iterative image registration technique with an application to stereo vision. Proc. 7th Int. Joinnt Conf. on Art. Intell.

[14]

NGO, T., DANA, J., CUTRELL, D., DONALD, B., LOEB, L., AND ZHU, S. 2000. Accessible animation and customizable graphics via simplicial configuration modeling. In SIGGRAPH 2000 Proceedings.

[15]

PARKE, F. 1972. Computer generated animation of faces. In ACM National Conferences, 451-457.

[16]

PIGHIN, F., HECKER, J., LISCHINSKI, D., SZELISKI, R., AND SALESIN, D. H. 1998. Synthesizing realistic facial expressions from photographs. In SIGGRAPH 98 Conference Proceedings, Addison Wesley, M. Cohen, Ed., Annual Conference Series, ACM SIGGRAPH, 75-84. ISBN 0-89791-999-8.

[17]

POPOVIĆ, Z., AND WITKIN, A. 1999. Physically based motion transformation. In SIGGRAPH 99 Conference Proceedings, ACM SIGGRAPH.

[18]

SHI, J., AND TOMASI, C. 1994. Good features to track. In CVPR.

[19]

WHITAKER, H., AND HALAS, J. 1981. Timing for Animation. FOCAL PRESS LTD.

[20]

YONG NOH, J., AND NEUMANN, U. 2001. Expression cloning. In Proceedings of SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, Computer Graphics Proceedings, Annual Conference Series, 277-288. ISBN 1-58113-292-1.

Cited By

Sumner RPopović J(2023)Deformation Transfer for Triangle MeshesSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596736(215-221)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596736
Nguyen KVu LNguyen T(2023)Turning Human into 2D Virtual Character Using Real-Time Motion CaptureCooperative Design, Visualization, and Engineering10.1007/978-3-031-43815-8_21(214-224)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-43815-8_21
Zhang JChen KZheng J(2022)Facial Expression Retargeting From Human to Avatar Made EasyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.301387628:2(1274-1287)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TVCG.2020.3013876
Show More Cited By

Index Terms

Turning to the masters: motion capturing cartoons
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Shape representations
      2. Image and video acquisition
        Motion capture
  2. Computer graphics
    1. Animation
      1. Motion capture
      2. Motion processing

Recommendations

Turning to the masters: motion capturing cartoons
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniques

In this paper, we present a technique we call "cartoon capture and retargeting" which we use to track the motion from traditionally animated cartoons and retarget it onto 3-D models, 2-D drawings, and photographs. By using animation as the source, we ...
Automatic rigging and animation of 3D characters
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Animating an articulated 3D character currently requires manual rigging to specify its internal skeletal structure and to define how the input motion deforms its surface. We present a method for animating characters automatically. Given a static ...
Automatic rigging and animation of 3D characters

Animating an articulated 3D character currently requires manual rigging to specify its internal skeletal structure and to define how the input motion deforms its surface. We present a method for animating characters automatically. Given a static ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 21, Issue 3

July 2002

548 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/566654

Issue’s Table of Contents

Copyright © 2002 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2002

Published in TOG Volume 21, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

88
Total Citations
View Citations
2,649
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sumner RPopović J(2023)Deformation Transfer for Triangle MeshesSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596736(215-221)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1145/3596711.3596736
Nguyen KVu LNguyen T(2023)Turning Human into 2D Virtual Character Using Real-Time Motion CaptureCooperative Design, Visualization, and Engineering10.1007/978-3-031-43815-8_21(214-224)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1007/978-3-031-43815-8_21
Zhang JChen KZheng J(2022)Facial Expression Retargeting From Human to Avatar Made EasyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.301387628:2(1274-1287)Online publication date: 1-Feb-2022
https://dl.acm.org/doi/10.1109/TVCG.2020.3013876
Rohmer DTarini MKalyanasundaram NMoshfeghifar FCani MZordan V(2021)Velocity Skinning for Real‐time Stylized Skeletal AnimationComputer Graphics Forum10.1111/cgf.14265440:2(549-561)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142654
Qinran YWeiqun C(2021)Video‐Driven 2D Character AnimationChinese Journal of Electronics10.1049/cje.2021.07.01630:6(1038-1048)Online publication date: Nov-2021
https://doi.org/10.1049/cje.2021.07.016
Mao TDong WMao ALi GLuo J(2020)Pose Transfer of 2D Human Cartoon CharactersAdvances in Computer Graphics10.1007/978-3-030-61864-3_22(256-266)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1007/978-3-030-61864-3_22
Hao CChen YWu E(2019)Efficient PatchMatch-Based Synthesis for Cartoon AnimationIEEE Access10.1109/ACCESS.2019.29031487(31262-31272)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2903148
Hao CJiang BWu WLiu SHe L(2019)Efficient PatchMatch-Based Image Registration and Retargeting for Cartoon AnimationArtificial Intelligence and Security10.1007/978-3-030-24274-9_58(640-651)Online publication date: 11-Jul-2019
https://doi.org/10.1007/978-3-030-24274-9_58
Aparajeya PLeymarie Fal-Rifaie M(2019)Swarm-Based Identification of Animation Key Points from 2D-medialness MapsComputational Intelligence in Music, Sound, Art and Design10.1007/978-3-030-16667-0_5(69-83)Online publication date: 24-Apr-2019
https://dl.acm.org/doi/10.1007/978-3-030-16667-0_5
Fan XBermano AKim VPopović JRusinkiewicz SWyvill BFu H(2018)TooncapProceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering10.1145/3229147.3229149(1-12)Online publication date: 17-Aug-2018
https://dl.acm.org/doi/10.1145/3229147.3229149
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents