research-article

KinÊtre: animating the world with the human body

Authors:

Andrew FitzgibbonAuthors Info & Claims

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

Pages 435 - 444

https://doi.org/10.1145/2380116.2380171

Published: 07 October 2012 Publication History

Abstract

KinÊtre allows novice users to scan arbitrary physical objects and bring them to life in seconds. The fully interactive system allows diverse static meshes to be animated using the entire human body. Traditionally, the process of mesh animation is laborious and requires domain expertise, with rigging specified manually by an artist when designing the character. KinÊtre makes creating animations a more playful activity, conducted by novice users interactively "at runtime". This paper describes the KinÊtre system in full, highlighting key technical contributions and demonstrating many examples of users animating meshes of varying shapes and sizes. These include non-humanoid meshes and incomplete surfaces produced by 3D scanning - two challenging scenarios for existing mesh animation systems. Rather than targeting professional CG animators, KinÊtre is intended to bring mesh animation to a new audience of novice users. We demonstrate potential uses of our system for interactive storytelling and new forms of physical gaming.

Supplementary Material

JPG File (paper_0234-file3.jpg)

Download
11.08 KB

suppl.mov (paper_0234-file3.mp4)

Supplemental video

Download
86.24 MB

References

[1]

Ahmed, N. et al. Automatic generation of personalized human avatars from multi-view video. In Proc. VRST, ACM (2005).

Digital Library

[2]

Allen, B., B. Curless, and Z. Popović. Articulated body deformation from range scan data. In Proc. SIGGRAPH (2002).

Digital Library

[3]

Anguelov, D. et al. Scape: shape completion and animation of people. ACM SIGGRAPH (2005).

Digital Library

[4]

Baran, I., and J. Popović. Automatic rigging and animation of 3d characters. ACM SIGGRAPH (2007).

Digital Library

[5]

Barnes, C. et al. Video puppetry. ACM SIGGRAPH Asia (2008).

Digital Library

[6]

Ben-Chen, M., O. Weber, and C. Gotsman. Variational harmonic maps for space deformation. In Proc. SIGGRAPH, ACM (2009).

Digital Library

[7]

Chen, Y., and G. Medioni. Object modelling by registration of multiple range images. Image Vision Computing (1992).

Digital Library

[8]

Curless, B., and M. Levoy. A volumetric method for building complex models from range images. In Proc. SIGGRAPH, ACM (1996).

Digital Library

[9]

Davis, J. et al. A sketching interface for articulated figure animation. In Proc. Symposium on Computer Animation, ACM SIGGRAPH/Eurographics (2003).

Digital Library

[10]

Dontcheva, M., G. Yngve, and Z. Popović. Layered acting for character animation. In Proc. SIGGRAPH, ACM (2003).

Digital Library

[11]

Garau, M. et al. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proc. CHI, ACM (2003).

Digital Library

[12]

Igarashi, T., S. Matsuoka, and H. Tanaka. Teddy: A sketching interface for 3d freeform design. In Proc. SIGGRAPH, ACM (1999).

Digital Library

[13]

Igarashi, T., T. Moscovich, and J. F. Hughes. As-rigid-as-possible shape manipulation. ACM SIGGRAPH (2005).

Digital Library

[14]

Igarashi, T., T. Moscovich, and J. F. Hughes. Spatial keyframing for performance-driven animation. In Proc. Symposium on Computer Animation, ACM SIGGRAPH/Eurographics (2005).

Digital Library

[15]

Izadi, S. et al. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In Proc. UIST, ACM (2011).

Digital Library

[16]

Jacobson, A. et al. Bounded biharmonic weights for real-time deformation. In Proc. SIGGRAPH, ACM (2011).

Digital Library

[17]

Jacobson, A., and O. Sorkine. Stretchable and twistable bones for skeletal shape deformation. In Proc. SIGGRAPH Asia, ACM (2011).

Digital Library

[18]

Johnson, M. P. et al. Sympathetic interfaces. In Proc. CHI, ACM (1999).

Digital Library

[19]

Joshi, P. et al. Harmonic coordinates for character articulation. In Proc. SIGGRAPH, ACM (2007).

Digital Library

[20]

Ju, T., S. Schaefer, and J. Warren. Mean value coordinates for closed triangular meshes. In Proc. SIGGRAPH, ACM (2005).

Digital Library

[21]

Kipp, M., and Q. Nguyen. Multitouch puppetry. In Proc. ITS, ACM (2010).

Digital Library

[22]

Knep, B. et al. Dinosaur input device. In Proc. CHI, ACM (1995).

Digital Library

[23]

Komatsu, K. Human skin model capable of natural shape variation. The Visual Computer 3, 5 (1988).

[24]

Lehtinen, J. et al. A meshless hierarchical representation for light transport. ACM SIGGRAPH (2008).

Digital Library

[25]

Lipman, Y., D. Levin, and D. Cohen-Or. Green coordinates. ACM SIGGRAPH (2008).

Digital Library

[26]

Magnenat-Thalmann, N., R. Laperrire, and D. Thalmann. Joint-dependent local deformations for hand animation and object grasping. In Proc. Graphics Interface, Canadian Info. Proc. Society (1988).

Digital Library

[27]

Schaefer, S., T. McPhail, and J. Warren. Image deformation using moving least squares. ACM SIGGRAPH (2006).

Digital Library

[28]

Shi, X. et al. Mesh puppetry: cascading optimization of mesh deformation with inverse kinematics. ACM SIGGRAPH (2007).

Digital Library

[29]

Shin, H. J. et al. Computer puppetry: An importance-based approach. ACM Trans. on Graphics 20, 2 (2001).

Digital Library

[30]

Shotton, J. et al. Real-time human pose recognition in parts from single depth images. In Proc. CVPR, IEEE (2011).

Digital Library

[31]

Sturman, D. J. Computer puppetry. IEEE Computer Graphics & Applications 18, 1 (1998).

Digital Library

[32]

Sumner, R. W., J. Schmid, and M. Pauly. Embedded deformation for shape manipulation. ACM SIGGRAPH (2007).

Digital Library

[33]

Thorne, M., D. Burke, and M. van de Panne. Motion doodles: an interface for sketching character motion. ACM SIGGRAPH (Aug. 2004).

Digital Library

[34]

Vlasic, D. et al. Articulated mesh animation from multi-view silhouettes. ACM SIGGRAPH (2008).

Digital Library

[35]

Yamane, K., Y. Ariki, and J. Hodgins. Animating non-humanoid characters with human motion data. In Proc. SCA, ACM SIGGRAPH/Eurographics (2010).

Digital Library

Cited By

Cui JZhang JKneip LSchwertfeger S(2024)Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene MappingSensors10.3390/s2421691924:21(6919)Online publication date: 28-Oct-2024
https://doi.org/10.3390/s24216919
Hashimoto THirao Y(2024)Selfrionette: A Fingertip Force-Input Controller for Continuous Full-Body Avatar Manipulation and Diverse Haptic InteractionsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676409(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676409
Li BYuan LYan ZLiu QShen YWang Z(2024)AniCraft: Crafting Everyday Objects as Physical Proxies for Prototyping 3D Character Animation in Mixed RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676325(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676325
Show More Cited By

Index Terms

KinÊtre: animating the world with the human body
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

KinÊtre: animating the world with the human body
SIGGRAPH '12: ACM SIGGRAPH 2012 Talks

Imagine you are asked to produce a 3D animation of a demonic armchair terrorizing an innocent desk lamp. You may think about model rigging, skeleton deformation, and keyframing. Depending on your experience, you might imagine hours to days at the ...
Special Section on Computer Graphics in Brazil: A selection of papers from SIBGRAPI 2012: Representing mesh-based character animations

We propose a new approach to represent and manipulate a mesh-based character animation preserving its time-varying details. Our method first decomposes the input mesh animation into coarse and fine deformation components. A model for the coarse ...
Interactive steering of mesh animations
SCA '12: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Creating geometrically detailed mesh animations is an involved and resource-intensive process in digital content creation. In this work we present a method to rapidly combine available sparse motion capture data with existing mesh sequences to produce a ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

October 2012

608 pages

ISBN:9781450315807

DOI:10.1145/2380116

General Chair:
Rob Miller
MIT CSAIL, USA
,
Program Chairs:
Hrvoje Benko
Microsoft Research, USA
,
Celine Latulipe
University of North Carolina at Charlotte, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '12

Sponsor:

UIST '12: The 25th Annual ACM Symposium on User Interface Software and Technology

October 7 - 10, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
1,015
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)5

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cui JZhang JKneip LSchwertfeger S(2024)Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene MappingSensors10.3390/s2421691924:21(6919)Online publication date: 28-Oct-2024
https://doi.org/10.3390/s24216919
Hashimoto THirao Y(2024)Selfrionette: A Fingertip Force-Input Controller for Continuous Full-Body Avatar Manipulation and Diverse Haptic InteractionsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676409(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676409
Li BYuan LYan ZLiu QShen YWang Z(2024)AniCraft: Crafting Everyday Objects as Physical Proxies for Prototyping 3D Character Animation in Mixed RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676325(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676325
Takashita SArai KSaito HKitazaki MInami M(2024)Embodied Tentacle: Mapping Design to Control of Non-Analogous Body Parts with the Human BodyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642340(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642340
Zhang YNguyen CKazi RYu L(2023)PoseVEC: Authoring Adaptive Pose-aware Effects using Visual Programming and DemonstrationsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606788(1-15)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606788
Davis JAsente PYang X(2023)Multimodal Direct Manipulation in Video Conferencing: Challenges and OpportunitiesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596099(1174-1193)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596099
Jiang YLi ZHe MLindlbauer DYan Y(2023)HandAvatar: Embodying Non-Humanoid Virtual Avatars through HandsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581027(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581027
Mateus ARanade SRamalingam SMiraldo P(2023)Fast and Accurate 3D Registration from Line Intersection ConstraintsInternational Journal of Computer Vision10.1007/s11263-023-01774-1131:8(2044-2069)Online publication date: 10-May-2023
https://doi.org/10.1007/s11263-023-01774-1
Wang CZhou QFitzmaurice GAnderson F(2022)VideoPoseVR: Authoring Virtual Reality Character Animations with Online VideosProceedings of the ACM on Human-Computer Interaction10.1145/35677286:ISS(448-467)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567728
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten