demonstration

Real Time Animation of 3D Models with Finger Plays and Hand Shadow

Authors:

Amato Tsuji,

Keita Ushida,

Qiu ChenAuthors Info & Claims

ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Pages 441 - 444

https://doi.org/10.1145/3279778.3279918

Published: 19 November 2018 Publication History

Get Access

Abstract

In this paper the authors report a method for animating 3D models with finger play and hand shadow. For preparation, the motion of the models is associated with a motion of the hands. Appropriate association based on finger play and hand shadow provides intuitive operation. For example, the user makes a hermit crab's claw pinch by pinching the index and middle finger. On using the system the user doesn't need to wear sensors or gloves. The operation of the method is so easy that children can animate 3D models. In the evaluation, participants are mostly positive to the method.

Supplementary Material

suppl.mov (issde07.mp4)

Supplemental video

Download
35.93 MB

References

[1]

Leite, L. and Orvalho, V. Mani-Pull-Action: Hand-based Digital Puppetry, In Proc. ACM Hum.-Comput.Interact., Vol.1, Issue EICS (2017), 16 pages.

Digital Library

Google Scholar

[2]

Rock Scissors Paper #1 Finger Play Song, 2015, https://youtu.be/P65yE_EXLd8, Watched on 2018-05-06.

Google Scholar

[3]

Held, H., et al. 3D puppetry: a kinect-based interface for 3D animation, In Proc. ACM UIST '12 (2012), pp.423--434.

Digital Library

Google Scholar

[4]

Jacobson, A., et al, O. Tangible and modular input device for character articulation, ACM Trans. Graphics (2014), Vol.33, Issue 4, 12 pages.

Digital Library

Google Scholar

[5]

Chen, J., et al. KinÊtre: animating the world with the human body, In Proc. ACM UIST '12 (2012), pp.435--444.

Digital Library

Google Scholar

[6]

Goto, K. The Book of interesting silhouette art of hands. PHP Institute, Kyoto, Japan, 2005 (in Japanese).

Google Scholar

Cited By

View all

Zhou QLedo DFitzmaurice GAnderson F(2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641927
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Manipulating Human Avatar Actions with Intuitive Hand Gestures and Upper-Body PosturesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558689(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558689
Show More Cited By

Index Terms

Real Time Animation of 3D Models with Finger Plays and Hand Shadow
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor
ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information Technology

The hand gesture provides a natural and intuitive communication medium for the human and machine interaction. Because, it can use in virtual reality, language detection, computer games, and other human-computer or human-machine instruction applications. ...
A novel finger and hand pose estimation technique for real-time hand gesture recognition

This paper presents a high-level hand feature extraction method for real-time gesture recognition. Firstly, the fingers are modelled as cylindrical objects due to their parallel edge feature. Then a novel algorithm is proposed to directly extract ...
A robust and accurate 3d hand posture estimation method for interactive systems
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

In this paper, a new 3D hand posture estimation system using a single camera and 3 interactive systems are introduced. Existing hand gesture recognition systems estimate hand's 3D models based on image features such as contour or skin texture. However, ...

Comments

Information & Contributors

Information

Published In

ISS '18: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

November 2018

499 pages

ISBN:9781450356947

DOI:10.1145/3279778

General Chairs:
Hideki Koike
Tokyo Institute of Technology, Japan
,
Carlo Ratti
Massachusetts Institute of Technology, USA
,
Yuichiro Takeuchi
Sony Computer Science Laboratories Inc., Japan
,
Program Chairs:
Kentaro Fukuchi
Meiji University, Japan
,
Stacey Scott
University of Guelph, Canada
,
Diego Martinez Plasencia
University of Sussex, United Kingdom

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2018

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

ISS '18

Sponsor:

SIGCHI

ISS '18: 2018 ACM International Conference on Interactive Surfaces and Spaces

November 25 - 28, 2018

Tokyo, Japan

Acceptance Rates

ISS '18 Paper Acceptance Rate 28 of 105 submissions, 27%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
197
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhou QLedo DFitzmaurice GAnderson F(2024)TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641927(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641927
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Exploring Intuitive Hand Gestures and Upper-Body Postures for Manipulating Human Avatar ActionsProceedings of the 28th ACM Symposium on Virtual Reality Software and Technology10.1145/3562939.3565609(1-11)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3562939.3565609
Hung CChang RChen HLiang CChan LChen B(2022)Puppeteer: Manipulating Human Avatar Actions with Intuitive Hand Gestures and Upper-Body PosturesAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558689(1-3)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526114.3558689
Pei SChen ALee JZhang Y(2022)Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive InteractionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501898(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501898
Tsuji AUshida K(2021)A Telepresence System using Toy Robots the Users can Assemble and Manipulate with Finger Plays and Hand Shadow2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW52623.2021.00213(661-662)Online publication date: Mar-2021
https://doi.org/10.1109/VRW52623.2021.00213
Tsuji AUshida K(2021)Telecommunication Using 3DCG Avatars Manipulated with Finger Plays and Hand Shadow2021 IEEE 10th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE53005.2021.9621877(39-40)Online publication date: 12-Oct-2021
https://doi.org/10.1109/GCCE53005.2021.9621877
Ye HKwan KSu WFu H(2020)ARAnimatorACM Transactions on Graphics10.1145/3386569.339240439:4(83:1-83:12)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392404

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Human-Machine Interaction based on Hand Gesture Recognition using Skeleton Information of Kinect Sensor

A novel finger and hand pose estimation technique for real-time hand gesture recognition

A robust and accurate 3d hand posture estimation method for interactive systems