research-article

Lower body control of a semi-autonomous avatar in Virtual Reality: Balance and Locomotion of a 3D Bipedal Model

Authors:

Vincent Thomasset,

Stéphane Caron,

Vincent WeistrofferAuthors Info & Claims

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

Article No.: 4, Pages 1 - 11

https://doi.org/10.1145/3359996.3364240

Published: 12 November 2019 Publication History

Abstract

Animated virtual humans may rely on full-body tracking system to reproduce user motions. In this paper, we reduce tracking to the upper-body and reconstruct the lower body to follow autonomously its upper counterpart. Doing so reduces the number of sensors required, making the application of virtual humans simpler and cheaper. It also enable deployment in cluttered scenes where the lower body is often hidden. The contribution here is the inversion of the well-known capture problem for bipedal walking. It determines footsteps rather than center-of-mass motions and yet can be solved with an off-the-shelf capture problem solver. The quality of our method is assessed in real-time tracking experiments on a wide variety of movements.

Supplementary Material

a4-thomasset-supplement (vrst2019.avi)

video

Download
26.99 MB

References

[1]

Shailen Agrawal, Shuo Shen, and Michiel van de Panne. 2013. Diverse motion variations for physics-based character animation. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation. ACM, 37–44.

Digital Library

[2]

Shailen Agrawal and Michiel van de Panne. 2016. Task-based locomotion. ACM Transactions on Graphics (TOG) 35, 4 (2016), 82.

Digital Library

[3]

Katrin Allmendinger. 2010. Social presence in synchronous virtual learning situations: The role of nonverbal signals displayed by avatars. Educational Psychology Review 22, 1 (2010), 41–56.

[4]

Stéphane Caron, Adrien Escande, Leonardo Lanari, and Bastien Mallein. 2019. Capturability-based Pattern Generation for Walking with Variable Height. IEEE Transactions on Robotics(2019).

[5]

Cyrille Collette, Alain Micaelli, Claude Andriot, and Pierre Lemerle. 2008. Robust balance optimization control of humanoid robots with multiple non coplanar grasps and frictional contacts. In IEEE International Conference on Robotics and Automation. 3187–3193.

[6]

Stelian Coros, Philippe Beaudoin, and Michiel Van de Panne. 2010. Generalized biped walking control. In ACM Transactions on Graphics, Vol. 29. 130.

[7]

Andrea Del Prete, Steve Tonneau, and Nicolas Mansard. 2018. Zero Step Capturability for Legged Robots in Multicontact. IEEE Transactions on Robotics 34, 4 (Aug. 2018), 1021–1034.

Digital Library

[8]

Ahmed Elhasairi and Alexandre Pechev. 2015. Humanoid robot balance control using the spherical inverted pendulum mode. Frontiers in Robotics and AI 2 (2015), 21.

[9]

Johannes Englsberger, Christian Ott, and Alin Albu-Schäffer. 2015. Three-dimensional bipedal walking control based on divergent component of motion. IEEE Transactions on Robotics 31, 2 (2015), 355–368.

Digital Library

[10]

Robert J Griffin, Georg Wiedebach, Sylvain Bertrand, Alexander Leonessa, and Jerry Pratt. 2017. Walking stabilization using step timing and location adjustment on the humanoid robot, atlas. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 667–673.

Digital Library

[11]

John Hauser, Alessandro Saccon, and Ruggero Frezza. 2004. Achievable motorcycle trajectories. In IEEE Conference on Decision and Control, Vol. 4. 3944–3949.

[12]

Andrei Herdt, Nicolas Perrin, and Pierre-Brice Wieber. 2010. Walking without thinking about it. In IEEE/RSJ International Conference on Intelligent Robots and Systems. 190–195.

[13]

Shuuji Kajita, Fumio Kanehiro, Kenji Kaneko, Kazuhito Yokoi, and Hirohisa Hirukawa. 2001. The 3D Linear Inverted Pendulum Mode: A simple modeling for a biped walking pattern generation. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 1. 239–246.

[14]

Majid Khadiv, Alexander Herzog, S Ali A Moosavian, and Ludovic Righetti. 2017. Walking Control Based on Step Timing Adaptation. arXiv preprint arXiv:1704.01271(2017).

[15]

Yun-hyeong Kim, Taesoo Kwon, Daeun Song, and Young J Kim. 2017. Full-Body Animation of Human Locomotion in Reduced Gravity Using Physics-Based Control. IEEE computer graphics and applications 37, 6 (2017), 28–39.

[16]

Twan Koolen, Tomas De Boer, John Rebula, Ambarish Goswami, and Jerry Pratt. 2012. Capturability-based analysis and control of legged locomotion, Part 1: Theory and application to three simple gait models. The International Journal of Robotics Research 31, 9 (2012), 1094–1113.

Digital Library

[17]

Twan Koolen, Michael Posa, and Russ Tedrake. 2016. Balance control using center of mass height variation: limitations imposed by unilateral contact. In IEEE-RAS International Conf. on Humanoid Robots. 8–15.

Digital Library

[18]

Max Krichenbauer, Goshiro Yamamoto, Takafumi Taketom, Christian Sandor, and Hirokazu Kato. 2017. Augmented reality versus virtual reality for 3d object manipulation. IEEE transactions on visualization and computer graphics 24, 2(2017), 1038–1048.

[19]

Leonardo Lanari, Seth Hutchinson, and Luca Marchionni. 2014. Boundedness issues in planning of locomotion trajectories for biped robots. In IEEE-RAS International Conference on Humanoid Robots. 951–958.

[20]

Marc Erich Latoschik, Florian Kern, Jan-Philipp Stauffert, Andrea Bartl, Mario Botsch, and Jean-Luc Lugrin. 2019. Not Alone Here?! Scalability and User Experience of Embodied Ambient Crowds in Distributed Social Virtual Reality. IEEE transactions on visualization and computer graphics 25, 5(2019), 2134–2144.

[21]

Mingxing Liu. 2012. Personnage virtuel: contrôleur hybride couplant commande dynamique multi-objectifs et mouvements capturés. Ph.D. Dissertation. Paris 6.

[22]

Igor Mordatch, Martin De Lasa, and Aaron Hertzmann. 2010. Robust physics-based locomotion using low-dimensional planning. ACM Transactions on Graphics 29, 4 (2010), 71.

Digital Library

[23]

David E Orin, Ambarish Goswami, and Sung-Hee Lee. 2013. Centroidal dynamics of a humanoid robot. Autonomous Robots 35, 2-3 (2013), 161–176.

Digital Library

[24]

Mamy Pouliquen, Alain Bernard, Jacques Marsot, and Laurent Chodorge. 2007. Virtual hands and virtual reality multimodal platform to design safer industrial systems. Computers in Industry 58, 1 (2007), 46–56.

Digital Library

[25]

Jerry Pratt, John Carff, Sergey Drakunov, and Ambarish Goswami. 2006. Capture point: A step toward humanoid push recovery. In IEEE-RAS International Conference on Humanoid Robots. 200–207.

[26]

Jerry E Pratt and Sergey V Drakunov. 2007. Derivation and application of a conserved orbital energy for the inverted pendulum bipedal walking model. In IEEE International Conference on Robotics and Automation. 4653–4660.

[27]

Oscar E Ramos and Kris Hauser. 2015. Generalizations of the capture point to nonlinear center of mass paths and uneven terrain. In IEEE-RAS International Conference on Humanoid Robots. 851–858.

Digital Library

[28]

Clare Regan. 1995. An investigation into nausea and other side-effects of head-coupled immersive virtual reality. Virtual Reality 1, 1 (1995), 17–31.

Digital Library

[29]

Joseph Salini, Vincent Padois, and Philippe Bidaud. 2011. Synthesis of complex humanoid whole-body behavior: a focus on sequencing and tasks transitions. In IEEE International Conference on Robotics and Automation. 1283–1290.

[30]

Tomomichi Sugihara. 2009. Standing stabilizability and stepping maneuver in planar bipedalism based on the best COM-ZMP regulator. In IEEE Int. Conf. on Robotics and Automation. 1966–1971.

Cited By

Hu BGuo HYang YTao XHe J(2024)Lightweight Physics-Based Character for Generating Sensible Postures in Dynamic EnvironmentsIEEE Access10.1109/ACCESS.2024.341722012(89660-89678)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3417220
Zhang HCarroll J(2024)Exploring Virtual Reality Through Ihde’s Instrumental RealismWisdom, Well-Being, Win-Win10.1007/978-3-031-57860-1_6(82-93)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1007/978-3-031-57860-1_6
Duval JThakkar RDu DChin KLuo SElor AEl-Nasr MJohn M(2022)Designing Spellcasters from Clinician Perspectives: A Customizable Gesture-Based Immersive Virtual Reality Game for Stroke RehabilitationACM Transactions on Accessible Computing10.1145/353082015:3(1-25)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3530820
Show More Cited By

Recommendations

Human upper-body inverse kinematics for increased embodiment in consumer-grade virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

Having a virtual body can increase embodiment in virtual reality (VR) applications. However, comsumer-grade VR falls short of delivering sufficient sensory information for full-body motion capture. Consequently, most current VR applications do not even ...
Motion-capture-based avatar control framework in third-person view virtual environments
ACE '06: Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology

This paper presents a motion-capture-based control framework for third-person view virtual reality applications. Using motion capture devices, a user can directly control the full body motion of an avatar in virtual environments. In addition, using a ...
User experience with semi-natural locomotion techniques in virtual reality: the case of the Virtuix Omni
SUI '17: Proceedings of the 5th Symposium on Spatial User Interaction

Prior studies have shown that semi-natural VR locomotion techniques (i.e., those with moderate levels of interaction fidelity) can produce an inferior user experience compared to both real walking and non-natural locomotion techniques [1], but it is not ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

November 2019

498 pages

ISBN:9781450370011

DOI:10.1145/3359996

Editors:
Tomas Trescak
Western Sydney University
,
Simeon Simoff
Western Sydney University
,
Deborah Richards
Macquarie University
,
Anton Bogdanovych
Western Sydney University
,
Thierry Duval
IMT Atlantique
,
Torsten Kuhlen
RWTH Aachen University
,
Huyen Nguyen
University of New South Wales
,
Shigeo Morishima
University of Waseda
,
Yuichi Itoh
University of Osaka
,
Richard Skarbez
La Trobe
,
Anton Bogdanovych
Western Sydney University
,
Martin Masek
Edith Cowan University

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRST '19

Sponsor:

VRST '19: 25th ACM Symposium on Virtual Reality Software and Technology

November 12 - 15, 2019

NSW, Parramatta, Australia

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hu BGuo HYang YTao XHe J(2024)Lightweight Physics-Based Character for Generating Sensible Postures in Dynamic EnvironmentsIEEE Access10.1109/ACCESS.2024.341722012(89660-89678)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3417220
Zhang HCarroll J(2024)Exploring Virtual Reality Through Ihde’s Instrumental RealismWisdom, Well-Being, Win-Win10.1007/978-3-031-57860-1_6(82-93)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1007/978-3-031-57860-1_6
Duval JThakkar RDu DChin KLuo SElor AEl-Nasr MJohn M(2022)Designing Spellcasters from Clinician Perspectives: A Customizable Gesture-Based Immersive Virtual Reality Game for Stroke RehabilitationACM Transactions on Accessible Computing10.1145/353082015:3(1-25)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3530820
Yang DKim DLee S(2021)LoBSTr: Real‐time Lower‐body Pose Prediction from Sparse Upper‐body Tracking SignalsComputer Graphics Forum10.1111/cgf.14263140:2(265-275)Online publication date: 4-Jun-2021
https://doi.org/10.1111/cgf.142631
Vincent TVincent WPhilippe F(2021)User Embodiment Comparison of Semi-Autonomous and Fully-Captured Avatar Movements in Virtual Reality2021 IEEE 7th International Conference on Virtual Reality (ICVR)10.1109/ICVR51878.2021.9483831(223-230)Online publication date: 20-May-2021
https://doi.org/10.1109/ICVR51878.2021.9483831
Zhang MWang YZhou JPan Z(2021)SimuMan: A Simultaneous Real-Time Method for Representing Motions and Emotions of Virtual Human in MetaverseInternet of Things – ICIOT 202110.1007/978-3-030-96068-1_6(77-89)Online publication date: 10-Dec-2021
https://dl.acm.org/doi/10.1007/978-3-030-96068-1_6

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents