research-article

Human motion reconstruction from force sensors

Authors:

C. Karen LiuAuthors Info & Claims

SCA '11: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Pages 129 - 138

https://doi.org/10.1145/2019406.2019424

Published: 05 August 2011 Publication History

Abstract

Consumer-grade, real-time motion capture devices are becoming commonplace in every household, thanks to the recent development in depth-camera technologies. We introduce a new approach to capturing and reconstructing freeform, full-body human motion using force sensors, supplementary to existing, consumer-grade mocap systems. Our algorithm exploits the dynamic aspects of human movement, such as linear and angular momentum, to provide key information for full-body motion reconstruction. Using two pressure sensing platforms (Wii Balance Board) and a hand tracking device, we demonstrate that human motion can be largely reconstructed from ground reaction forces along with a small amount of arm movement information.

Supplementary Material

JPG File (p129-ha.jpg)

Download
9.94 KB

AVI File (p129-ha.avi)

Download
28.07 MB

References

[1]

{Adv} Advanced Mechanical Technology: Multi-Axis Force Plates, http://www.amti.biz/. 2

[2]

{ALP04} Abe Y., Liu C. K., Popović Z.: Momentum-based parameterization of dynamic character motion. In Eurographics/SIGGRAPH Symposium on Computer Animation (2004), pp. 173--182. 3

Digital Library

[3]

{Can} CanestaTechnology: Canesta Technology, http://canesta.com/. 2

[4]

{CBK05} Cheung K., Baker S., Kanade T.: Shape-fromsilhouette across time: Part ii: Applications to human modeling and markerless motion tracking. In International Journal of Computer Vision (2005). 63(3):225--245. 2

Digital Library

[5]

{CTMS03} Carranza J., Theobalt C., Magnor M., Seidel H.: Free-viewpoint video of human actors. In ACM Transactions on Graphics (2003). 22(3):569--577. 2

Digital Library

[6]

{dAST*08} d. Aguiar E., Stoll1 C., Theobalt C., Ahmed N., Seidel H.-P., Thrun S.: Performance capture from sparse multi-view video. In ACM Transactions on Graphics (2008). 27(3). 2

Digital Library

[7]

{FL90} Fahlman S. E., Lebiere C.: The cascade-correlation learning architecture. In Advances in neural information processing systems 2 (1990), pp. 524--532. 4

Digital Library

[8]

{GK04} Goswami A., Kallem V.: Rate of change of angular momentum and balance maintenance of biped robots. In Proc. IEEE Int'l Conf on Robotics and Automation (2004), IEEE, pp. 3785--3790. 3

[9]

{GMHP04} Grochow K., Martin S. L., Hertzmann A., Popovic Z.: Style-based inverse kinematics. ACM Transactions on Graphics 23, 3 (2004), 522--531. 3, 6

Digital Library

[10]

{HP08} Herr H., Popovic M.: Angular momentum in human walking. In Journal of Experimental Biology (2008). 3

[11]

{Int} IntersenseTechnology: Intersense Technology, http://www.intersense.com/. 2

[12]

{IWZL09} Ishigaki S., White T. M., Zordan V. B., Liu C. K.: Performanced-based control interface for character animation. ACM Transaction on Graphics 28, 3 (Aug. 2009). 6

Digital Library

[13]

{KG04} Kovar L., Gleicher M.: Automated extraction and parameterization of motions in large data sets. ACM Transactions on Graphics 23, 3 (2004), 559--568. 3

Digital Library

[14]

{Kin} KinectHacks: Kinect Hacks, http://kinecthacks.net/. 2

[15]

{KKK*03} Kajita S., Kanehiro F., Kaneko K., Fujiwara K., Harada K., Yokoi K., Hirukawa H.: Resolved momentum control: humanoid motion planning based on the linear and angular momentum. In Intelligent Robots and Systems (2003), pp. 1644--1650. 3

[16]

{KLK04} Komura T., Leung H., Kuffner J.: Animating reactive motions for biped locomotion. In VRST '04: Proceedings of the ACM symposium on Virtual reality software and technology (2004), pp. 32--40. 3

Digital Library

[17]

{LP02} Liu C. K., Popović Z.: Synthesis of complex dynamic character motion fromsimple animations. ACM Trans. on Graphics (SIGGRAPH) 21, 3 (July 2002), 408--416. 3

Digital Library

[18]

{Mic} Microsoft: Microsoft XBOX, http://www.xbox.com:80/en-US/kinect. 2

[19]

{MZS09} Macchietto A., Zordan V., Shelton C. R.: Momentum control for balance. ACM Trans. on Graphics (SIGGRAPH) 28, 3 (2009), 1--8. 3

Digital Library

[20]

{Ope} OpenKinect: Open Kinect, http://openkinect.org. 2

[21]

{Pha} PhaseSpaceTechnology: PhaseSpace Technology, http://www.phasespace.com/. 2

[22]

{Pri} PrimesenseTechnology: Primesense Technology, http://www.primesense.com/. 2

[23]

{Ras} Rasco B.: Where's the Wiimote? Using Kalman filtering to extract accelerometer data. http://www.gamasutra.com/. 4

[24]

{RSC01} Rose C. F., Sloan P.-P. J., Cohen M. F.: Artist-directed inverse-kinematics using radial basis function interpolation. Computer Graphics Forum 20, 3 (2001), 239--250. 3

[25]

{SH08a} Shiratori T., Hodgins J. K.: Accelerometer-based user interfaces for the control of a physically simulated character. ACM Trans. on Graphics 27, 5 (2008). 2

Digital Library

[26]

{SH08b} Slyper R., Hodgins J. K.: Action capture with accelerometers. In ACM SIGGRAPH/Eurographics symposium on Computer animation (2008), pp. 194--199. 2

Digital Library

[27]

{VAV*07} Vlasic D., Adelsberger R., Vannucci G., Barnwell J., Gross M., Matusik W., Popović J.: Practical motion capture in everyday surroundings. ACM Trans. Graph. 26, 3 (2007), 35. 2

Digital Library

[28]

{Vic} ViconTechnology: Vicon Technology, http://www.vicon.com/. 2

[29]

{Wel93} Welman C.: Inverse kinematics and geometric constraints for articulated figure manipulation. 3

[30]

{WH97} Wiley D. J., Hahn J. K.: Interpolation synthesis of articulated figure motion. IEEE Computer Graphics and Applications 17, 6 (1997), 39--45. 3

Digital Library

[31]

{Wii} WiiBrew: WiiBrew, http://wiibrew.org/wiki/Main_Page/. 2

[32]

{XSea} XSenseTechnology: XSense Technology, http://www.xsense.com. 2

[33]

{XSeb} XSensorTechnology: XSensor Technology Corporation, http://www.xsensor.com/. 2

[34]

{YN03} Yamane K., Nakamura Y.: Natural motion animation through constraining and deconstraining at will. IEEE Transactions on Visualization and Computer Graphics 9, 3 (July 2003), 352--360. 3

Digital Library

[35]

{YP03} Yin K., Pai D. K.: Footsee: an interactive animation system. In ACM SIGGRAPH/Eurographics symposium on Computer animation (2003), pp. 329--338. 2

Digital Library

[36]

{ZB98} Zhao L., Badler N.: Gesticulation behaviors for virtual humans. In Pacific Graphics (1998), pp. 161--168. 3

Digital Library

Cited By

Chen XJiang XZhan LGuo SRuan QLuo GLiao MQin Y(2023)Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible SensorsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/356470020:2(1-19)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3564700
Mourot LHoyet LClerc FHellier P(2023)UnderPressure: Deep Learning for Foot Contact Detection, Ground Reaction Force Estimation and Footskate CleanupComputer Graphics Forum10.1111/cgf.1463541:8(195-206)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14635
Cennamo NArcadio FMarletta VDel Prete DAndo BZeni LCesaro MDe Matteis A(2022)A simple and highly sensitive Force Sensor based on modified plastic optical fibers and cantilevers2022 IEEE Sensors Applications Symposium (SAS)10.1109/SAS54819.2022.9881346(1-5)Online publication date: 1-Aug-2022
https://doi.org/10.1109/SAS54819.2022.9881346
Show More Cited By

Index Terms

Human motion reconstruction from force sensors
1. Computing methodologies
  1. Computer graphics
    1. Animation
  2. Modeling and simulation
    1. Simulation types and techniques
      1. Simulation by animation

Recommendations

Automatic reconstruction of 3D human motion pose from uncalibrated monocular video sequences based on markerless human motion tracking

We present a method to reconstruct human motion pose from uncalibrated monocular video sequences based on the morphing appearance model matching. The human pose estimation is made by integrated human joint tracking with pose reconstruction in depth-...
Human Motion Reconstruction Based on Multi-view Video
IHMSC '13: Proceedings of the 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics - Volume 02

In this paper, the key technologies of human motion reconstruction Based on multi-view video are discussed. A more robust motion reconstruction method with markers is presented, which includes camera calibration, markers extraction, markers tracking and ...
Multiple Motion Scene Reconstruction with Uncalibrated Cameras

In this paper, we describe a reconstruction method for multiple motion scenes, which are scenes containing multiple moving objects, from uncalibrated views. Assuming that the objects are moving with constant velocities, the method recovers the scene ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SCA '11: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

August 2011

297 pages

ISBN:9781450309233

DOI:10.1145/2019406

Conference Chairs:
Karen Liu
Georgia Institute of Technology
,
Robert Bridson
University of British Columbia
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Adam Bargteil
University of Utah
,
Michiel van de Panne
University of British Columbia

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EUROGRAPHICS: The European Association for Computer Graphics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SCA '11

Sponsor:

SIGGRAPH
EUROGRAPHICS

SCA '11: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation 2011

August 5 - 7, 2011

British Columbia, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 183 of 487 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
717
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen XJiang XZhan LGuo SRuan QLuo GLiao MQin Y(2023)Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible SensorsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/356470020:2(1-19)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3564700
Mourot LHoyet LClerc FHellier P(2023)UnderPressure: Deep Learning for Foot Contact Detection, Ground Reaction Force Estimation and Footskate CleanupComputer Graphics Forum10.1111/cgf.1463541:8(195-206)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14635
Cennamo NArcadio FMarletta VDel Prete DAndo BZeni LCesaro MDe Matteis A(2022)A simple and highly sensitive Force Sensor based on modified plastic optical fibers and cantilevers2022 IEEE Sensors Applications Symposium (SAS)10.1109/SAS54819.2022.9881346(1-5)Online publication date: 1-Aug-2022
https://doi.org/10.1109/SAS54819.2022.9881346
Ahuja KOfek EGonzalez-Franco MHolz CWilson A(2021)CoolMovesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34634995:2(1-23)Online publication date: 24-Jun-2021
https://dl.acm.org/doi/10.1145/3463499
Ahuja KMayer SGoel MHarrison CKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Pose-on-the-Go: Approximating User Pose with Smartphone Sensor Fusion and Inverse KinematicsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445582(1-12)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445582
Ahuja KGoel MHarrison C(2020)BodySLAM: Opportunistic User Digitization in Multi-User AR/VR ExperiencesProceedings of the 2020 ACM Symposium on Spatial User Interaction10.1145/3385959.3418452(1-8)Online publication date: 31-Oct-2020
https://dl.acm.org/doi/10.1145/3385959.3418452
Chan VMohamed FYusoff YDewi DAnuar AShamsudin MMong W(2019)Using game controller as position tracking sensor for 3D freehand ultrasound imagingMedical & Biological Engineering & Computing10.1007/s11517-019-02044-4Online publication date: 10-Oct-2019
https://doi.org/10.1007/s11517-019-02044-4
Pham TCaron SKheddar A(2018)Multicontact Interaction Force Sensing From Whole-Body Motion CaptureIEEE Transactions on Industrial Informatics10.1109/TII.2017.276091214:6(2343-2352)Online publication date: Jun-2018
https://doi.org/10.1109/TII.2017.2760912
Siang CMohamed FMat Isham MAzimi Yusoff YAbd Aziz AEkashanti Octorina Dewi D(2018)A Framework of Position Tracked Freehand 3D Ultrasound Reconstruction Using Game Controller and Pixel Nearest Neighbour Method for Marching Cubes Volume Visualization2018 IEEE Conference on Big Data and Analytics (ICBDA)10.1109/ICBDAA.2018.8629650(99-104)Online publication date: Nov-2018
https://doi.org/10.1109/ICBDAA.2018.8629650
Lee YKwon T(2017)Performance-Based Biped Control using a Consumer Depth CameraComputer Graphics Forum10.5555/3128975.312901036:2(387-395)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.5555/3128975.3129010
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents