Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3491396.3506524acmconferencesArticle/Chapter ViewAbstractPublication PagesiceaConference Proceedingsconference-collections
research-article

Motion Feature Extraction and Stylization for Character Animation using Hilbert-Huang Transform

Published: 07 January 2022 Publication History

Abstract

This paper presents novel insights to feature extraction and stylization of character motion in the instantaneous frequency domain by proposing a method using the Hilbert-Huang transform (HHT). HHT decomposes human motion capture data in the frequency domain into several pseudo monochromatic signals, so-called intrinsic mode functions (IMFs). We propose an algorithm to reconstruct these IMFs and extract motion features automatically using the Fibonacci sequence in the link-dynamical structure of the human body. Our research revealed that these reconstructed motions could be mainly divided into three parts, a primary motion and a secondary motion, corresponding to the animation principles, and a basic motion consisting of posture and position. Our method help animators edit target motions by extracting and blending the primary or secondary motions extracted from a source motion. To demonstrate results, we applied our proposed method to general motions (jumping, punching, and walking motions) to achieve different stylizations.

References

[1]
Kfir Aberman, Rundi Wu, Dani Lischinski, Baoquan Chen, and Daniel Cohen-Or. 2019. Learning character-agnostic motion for motion retargeting in 2d. arXiv preprint arXiv:1905.01680 (2019).
[2]
Ronald Newbold Bracewell and Ronald N Bracewell. 1986. The Fourier transform and its applications. Vol. 31999. McGraw-Hill New York.
[3]
CMU. [n. d.]. BVH conversions of the 2500-motion Carnegie-Mellon motion capture dataset. ([n. d.]). Retrieved May 20, 2019 from https://sites.google.com/a/cgspeed.com/cgspeed/motion-capture
[4]
Ran Dong, Dongsheng Cai, and Nobuyoshi Asai. 2017. Nonlinear dance motion analysis and motion editing using Hilbert-Huang transform. In Proceedings of the computer graphics international conference. 1--6.
[5]
Ran Dong, Dongsheng Cai, and Soichiro Ikuno. 2020. Motion capture data analysis in the instantaneous frequency-domain using hilbert-huang transform. Sensors 20, 22 (2020), 6534.
[6]
Ran Dong, Qiong Chang, and Soichiro Ikuno. 2021. A deep learning framework for realistic robot motion generation. Neural Computing and Applications (2021), 1--14.
[7]
Daniel Holden, Jun Saito, and Taku Komura. 2016. A deep learning framework for character motion synthesis and editing. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1--11.
[8]
Daniel Holden, Jun Saito, Taku Komura, and Thomas Joyce. 2015. Learning motion manifolds with convolutional autoencoders. In SIGGRAPH Asia 2015 Technical Briefs. 1--4.
[9]
Jianzhao Huang, Jian Xie, Feng Li, and Liang Li. 2013. A threshold denoising method based on EMD. Journal of Theoretical and Applied Information Technology 47, 1 (2013), 419--424.
[10]
Norden Eh Huang. 2014. Hilbert-Huang transform and its applications. Vol. 16. World Scientific.
[11]
Norden E Huang, Zheng Shen, Steven R Long, Manli C Wu, Hsing H Shih, Quanan Zheng, Nai-Chyuan Yen, Chi Chao Tung, and Henry H Liu. 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: mathematical, physical and engineering sciences 454, 1971 (1998), 903--995.
[12]
Jing Lin and Liangsheng Qu. 2000. Feature extraction based on Morlet wavelet and its application for mechanical fault diagnosis. Journal of sound and vibration 234, 1 (2000), 135--148.
[13]
J Niu, Y Liu, W Jiang, X Li, and G Kuang. 2012. Weighted average frequency algorithm for Hilbert-Huang spectrum and its application to micro-Doppler estimation. IET Radar, Sonar & Navigation 6, 7 (2012), 595--602.
[14]
Dario Pavllo, David Grangier, and Michael Auli. 2018. Quaternet: A quaternion-based recurrent model for human motion. arXiv preprint arXiv:1805.06485 (2018).
[15]
Christopher Torrence and Gilbert P Compo. 1998. A practical guide to wavelet analysis. Bulletin of the American Meteorological society 79, 1 (1998), 61--78.
[16]
David A Winter. 2009. Biomechanics and motor control of human movement. John Wiley & Sons.

Cited By

View all

Index Terms

  1. Motion Feature Extraction and Stylization for Character Animation using Hilbert-Huang Transform

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ACM ICEA '21: Proceedings of the 2021 ACM International Conference on Intelligent Computing and its Emerging Applications
      December 2021
      241 pages
      ISBN:9781450391603
      DOI:10.1145/3491396
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 January 2022

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Hilbert-Huang transform
      2. biomechanics
      3. deep learning
      4. feature extraction
      5. motion stylization

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Funding Sources

      • JSPS KAKENHI

      Conference

      ACM ICEA '21
      Sponsor:

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 135
        Total Downloads
      • Downloads (Last 12 months)36
      • Downloads (Last 6 weeks)7
      Reflects downloads up to 10 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media