research-article

Iteratively Adapting Avatars using Task-Integrated Optimisation

Authors:

Hubert Dariusz Zajac,

Andreea Nicoleta Stefan,

Joanna Bergström,

Kasper HornbækAuthors Info & Claims

UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

Pages 709 - 721

https://doi.org/10.1145/3379337.3415832

Published: 20 October 2020 Publication History

Abstract

Virtual Reality allows users to embody avatars that do not match their real bodies. Earlier work has selected changes to the avatar arbitrarily and it therefore remains unclear how to change avatars to improve users' performance. We propose a systematic approach for iteratively adapting the avatar to perform better for a given task based on users' performance. The approach is evaluated in a target selection task, where the forearms of the avatar are scaled to improve performance. A comparison between the optimised and real arm lengths shows a significant reduction in average tapping time by 18.7%, for forearms multiplied in length by 5.6. Additionally, with the adapted avatar, participants moved their real body and arms significantly less, and subjective measures show reduced physical demand and frustration. In a second study, we modify finger lengths for a linear tapping task to achieve a better performing avatar, which demonstrates the generalisability of the approach.

Supplementary Material

VTT File (3379337.3415832.vtt)

Download
5.52 KB

MP4 File (ufp3419pv.mp4)

Preview video

Download
16.94 MB

MP4 File (ufp3419vf.mp4)

Video figure

Download
29.75 MB

MP4 File (3379337.3415832.mp4)

Presentation Video

Download
19.71 MB

References

[1]

Adrian JT Alsmith. 2019. Bodily structure and body representation. Synthese (2019), 1--30.

[2]

Myroslav Bachynskyi, Gregorio Palmas, Antti Oulasvirta, and Tino Weinkauf. 2015. Informing the Design of Novel Input Methods with Muscle Coactivation Clustering. ACM Trans. Comput.-Hum. Interact. 21, 6, Article Article 30 (Jan. 2015), 25 pages. http://dx.doi.org/10.1145/2687921

Digital Library

[3]

Doug A Bowman and Larry F Hodges. An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environments. Technical Report. http://lsc.univ-evry.fr/ davesne/ens/pub/grab.pdf

[4]

Eric Brochu, Vlad M Cora, and Nando De Freitas. 2010. A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv preprint arXiv:1012.2599 (2010).

[5]

Valeria Carofiglio, Berardina Nadja De Carolis, and Francesca D'Errico. 2019. A BCI-based Assessment of a Player's State of Mind for Game Adaptation. In Proceedings of GHItaly19--3rd International Workshop on Games-Human Interaction.

[6]

Chris Christou and Despina Michael. Aliens versus Humans: Do avatars make a difference in how we play the game? Technical Report. https://ieeexplore.ieee.org/document/7012029

[7]

Tiare Feuchtner and Jörg Müller. 2017. Extending the Body for Interaction with Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5145--5157. http://dx.doi.org/10.1145/3025453.3025689

Digital Library

[8]

Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Technical Report 6.

[9]

Arvid Guterstam, Zakaryah Abdulkarim, and H Henrik Ehrsson. 2015. Illusory ownership of an invisible body reduces autonomic and subjective social anxiety responses. Scientific reports 5 (2015), 9831.

[10]

Arvid Guterstam, Valeria I. Petkova, and H. Henrik Ehrsson. 2011. The Illusion of Owning a Third Arm. PLOS ONE 6, 2 (02 2011), 1--11. http://dx.doi.org/10.1371/journal.pone.0017208

[11]

Sandra G Hart and Moffett E Field California Lowell Staveland. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Technical Report.

[12]

Ludovic Hoyet, Ferran Argelaguet, Corentin Nicole, and Anatole Lé cuyer. 2016. "Wow! I Have Six Fingers!": Would You Accept Structural Changes of Your Hand in VR? Frontiers in Robotics and AI 3 (5 2016), 27. http://dx.doi.org/10.3389/frobt.2016.00027

[13]

Konstantina Kilteni, Jean Marie Normand, Maria V. Sanchez-Vives, and Mel Slater. 2012. Extending body space in immersive virtual reality: A very long arm illusion. PLoS ONE 7, 7 (2012), 40867. http://dx.doi.org/10.1371/journal.pone.0040867

[14]

Andrey Krekhov, Sebastian Cmentowski, Katharina Emmerich, and Jens Krüger. 2019. Beyond Human: Animals as an Escape from Stereotype Avatars in Virtual Reality Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '19). Association for Computing Machinery, New York, NY, USA, 439--451. http://dx.doi.org/10.1145/3311350.3347172

Digital Library

[15]

Andrey Krekhov, Sebastian Cmentowski, and Jens Krüger. 2018. VR Animals: Surreal Body Ownership in Virtual Reality Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY '18 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 503--511. http://dx.doi.org/10.1145/3270316.3271531

Digital Library

[16]

Bireswar Laha, Jeremy N Bailenson, Andrea Stevenson Won, and Jakki O. Bailey. 2016. Evaluating control schemes for the third arm of an avatar. Presence: Teleoperators and Virtual Environments 25, 2 (2016), 129--147. http://dx.doi.org/10.1162/PRES_a_00251

Digital Library

[17]

Byungjoo Lee, Mathieu Nancel, and Antti Oulasvirta. 2016. AutoGain: Adapting Gain Functions by Optimizing Submovement Efficiency. CoRR abs/1611.08154 (2016). http://arxiv.org/abs/1611.08154

[18]

Antonella Maselli and Mel Slater. 2013. The building blocks of the full body ownership illusion. Frontiers in Human Neuroscience 7 (2013).r1662--5161 (Linking) http://dx.doi.org/10.3389/fnhum.2013.00083

[19]

Roberto A. Montano Murillo, Sriram Subramanian, and Diego Martinez Plasencia. 2017. Erg-O: Ergonomic Optimization of Immersive Virtual Environments. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). Association for Computing Machinery, New York, NY, USA, 759--771. http://dx.doi.org/10.1145/3126594.3126605

Digital Library

[20]

Antti Oulasvirta, Anna Reichel, Wenbin Li, Yan Zhang, Myroslav Bachynskyi, Keith Vertanen, and Per Ola Kristensson. 2013. Improving Two-thumb Text Entry on Touchscreen Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2765--2774. http://dx.doi.org/10.1145/2470654.2481383

Digital Library

[21]

Tabitha C Peck, Sofia Seinfeld, Salvatore M Aglioti, and Mel Slater. 2013. Putting yourself in the skin of a black avatar reduces implicit racial bias. Consciousness and Cognition 22, 3 (2013), 779--787. http://dx.doi.org/10.1016/j.concog.2013.04.016

[22]

Stanley Plagenhoef, F. Gaynor Evans, and Thomas Abdelnour. 1983. Anatomical Data for Analyzing Human Motion. Research Quarterly for Exercise and Sport 54, 2 (6 1983), 169--178. http://dx.doi.org/10.1080/02701367.1983.10605290

[23]

V P Plagianakos, G D Magoulas, and M N Vrahatis. Chapter 2 LEARNING RATE ADAPTATION IN STOCHASTIC GRADIENT DESCENT. Technical Report. http://www.dcs.bbk.ac.uk/ gmagoulas/c-7.pdf

[24]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. The Go-Go Interaction Technique: Non-linear Mapping for Direct Manipulation in VR. Technical Report. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.38.6690&rep=rep1&type=pdf

[25]

Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology - UIST '96. 79--80. http://dx.doi.org/10.1145/237091.237102

Digital Library

[26]

Yuan Yuan Qian and Robert J Teather. 2017. The eyes don't have it. In Proceedings of the 5th Symposium on Spatial User Interaction - SUI '17, Vol. 8. 91--98. http://dx.doi.org/10.1145/3131277.3132182

Digital Library

[27]

Valentin Schwind, Pascal Knierim, Lewis Chuang, and Niels Henze. 2017. 'Where's Pinky'?: The Effects of a Reduced Number of Fingers in Virtual Reality. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17). Association for Computing Machinery, New York, NY, USA, 507--515. http://dx.doi.org/10.1145/3116595.3116596

Digital Library

[28]

Yeongho Seol, Carol O'Sullivan, and Jehee Lee. 2013. Creature Features: Online Motion Puppetry for Non-Human Characters. In Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA '13). Association for Computing Machinery, New York, NY, USA, 213--221. http://dx.doi.org/10.1145/2485895.2485903

Digital Library

[29]

Mel Slater, Daniel Perez-Marcos, H Henrik Ehrsson, and Maria V Sanchez-Vives. 2009. Inducing illusory ownership of a virtual body. (2009). http://dx.doi.org/10.3389/neuro.01.029.2009

[30]

James C Spall. 1998. An overview of the simultaneous perturbation method for efficient optimization. Johns Hopkins apl technical digest 19, 4 (1998), 482--492.

[31]

William Steptoe, Anthony Steed, and Mel Slater. 2013. Human tails: Ownership and control of extended humanoid avatars. IEEE Transactions on Visualization and Computer Graphics 19, 4 (2013), 583--590. http://dx.doi.org/10.1109/TVCG.2013.32

[32]

John J Tomick. 1995. On convergence of the Nelder-Mead simplex algorithm for unconstrained stochastic optimization. Technical Report. AIR FORCE INST OF TECH WRIGHT-PATTERSON AFB OH.

[33]

Chi Thanh Vi, Izdihar Jamil, David Coyle, and Sriram Subramanian. 2014. Error related negativity in observing interactive tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3787--3796.

Digital Library

[34]

Johann Wentzel, Greg d'Eon, and Daniel Vogel. 2020. Improving Virtual Reality Ergonomics Through Reach-Bounded Non-Linear Input Amplification. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--12.

Digital Library

[35]

Graham Wilson, Mark McGill, Matthew Jamieson, Julie R. Williamson, and Stephen A. Brewster. 2018. Object Manipulation in Virtual Reality Under Increasing Levels of Translational Gain. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 99, 13 pages. http://dx.doi.org/10.1145/3173574.3173673

[36]

Robert C Wilson, Amitai Shenhav, Mark Straccia, and Jonathan D Cohen. 2019. The Eighty Five Percent Rule for optimal learning. Nature communications 10, 1 (2019), 1--9.

[37]

Andrea Stevenson Won, Jeremy Bailenson, Jimmy Lee, and Jaron Lanier. 2015b. Homuncular Flexibility in Virtual Reality. Journal of Computer-Mediated Communication 20, 3 (5 2015), 241--259. http://dx.doi.org/10.1111/jcc4.12107

Digital Library

[38]

Andrea Stevenson Won, Jeremy N Bailenson, and Jaron Lanier. 2015a. Appearance and task success in novel avatars. Presence: Teleoperators and Virtual Environments 24, 4 (2015), 335--346. http://dx.doi.org/10.1162/PRES_a_00238

Digital Library

[39]

Nick Yee and Jeremy Bailenson. 2007. The proteus effect: The effect of transformed self-representation on behavior. Human Communication Research 33, 3 (2007), 271--290. http://dx.doi.org/10.1111/j.1468--2958.2007.00299.x

Cited By

Yu DCibulskis MMortensen EChristensen MBergström J(2024)Metrics of Motor Learning for Analyzing Movement Mapping in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642354(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642354
Cotumaccio ND’Agostino GPolicriti APrezza N(2023)Co-lexicographically Ordering Automata and Regular Languages - Part IJournal of the ACM10.1145/360747170:4(1-73)Online publication date: 12-Aug-2023
https://dl.acm.org/doi/10.1145/3607471
Zhi YXie XShen CSun JZhang XGuan X(2023)Seed Selection for Testing Deep Neural NetworksACM Transactions on Software Engineering and Methodology10.1145/360719033:1(1-33)Online publication date: 7-Jul-2023
https://dl.acm.org/doi/10.1145/3607190
Show More Cited By

Recommendations

Hybrid avatars: enabling co-presence in multiple realities
Web3D '16: Proceedings of the 21st International Conference on Web3D Technology

Virtual reality (VR) and augmented reality (AR) technologies are quickly making their way into people's everyday lives. Typically, these technologies are used separately to create either plain VR or AR applications rather than harnessing the ...
Observing Virtual Avatars: The Impact of Avatars’ Fidelity on Identifying Interactions
Academic Mindtrek '21: Proceedings of the 24th International Academic Mindtrek Conference

There are many cases where observing the interactions of a virtual avatar can be useful. However, it is unclear to what extent the avatar fidelity affects bystanders’ performance when observing gestures performed by avatars. We, therefore, conducted an ...
SocialSlider: Changing the Transparency of Avatars
AHs '22: Proceedings of the Augmented Humans International Conference 2022

Due to the growing number of users, social virtual reality can get crowded. As we sometimes prefer to be only surrounded by friends or more enjoy empty galleries to have a better view, we designed SocialSlider: an interaction technique that allows us to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '20: Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology

October 2020

1297 pages

ISBN:9781450375146

DOI:10.1145/3379337

General Chairs:
Shamsi Iqbal
Microsoft Research, USA
,
Karon MacLean
University of British Columbia, Canada
,
Program Chairs:
Fanny Chevalier
University of Toronto, Canada
,
Stefanie Mueller
MIT CSAIL, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Research Council

Conference

UIST '20

Sponsor:

UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology

October 20 - 23, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
446
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)6

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yu DCibulskis MMortensen EChristensen MBergström J(2024)Metrics of Motor Learning for Analyzing Movement Mapping in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642354(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642354
Cotumaccio ND’Agostino GPolicriti APrezza N(2023)Co-lexicographically Ordering Automata and Regular Languages - Part IJournal of the ACM10.1145/360747170:4(1-73)Online publication date: 12-Aug-2023
https://dl.acm.org/doi/10.1145/3607471
Zhi YXie XShen CSun JZhang XGuan X(2023)Seed Selection for Testing Deep Neural NetworksACM Transactions on Software Engineering and Methodology10.1145/360719033:1(1-33)Online publication date: 7-Jul-2023
https://dl.acm.org/doi/10.1145/3607190
Wu JWei LJiang YCheung SRen LXu C(2023)Programming by Example Made EasyACM Transactions on Software Engineering and Methodology10.1145/360718533:1(1-36)Online publication date: 7-Jul-2023
https://dl.acm.org/doi/10.1145/3607185
Okamoto NHirose MWakisaka SSaito HIzumihara AInami M(2023)WeightMorphy: A Dynamic Weight-Shifting Method to Enhance the Virtual Experience with Body DeformationProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611367(71-75)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611367
Hirzle TMüller FDraxler FSchmitz MKnierim PHornbæk K(2023)When XR and AI Meet - A Scoping Review on Extended Reality and Artificial IntelligenceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581072(1-45)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581072
Hofmann MAuradkar NBirchfield JCao JHughes AKim GKurpad SLum KMack KNilakantan ASeehorn MWarnock EMankoff JHudson S(2023)OPTIMISM: Enabling Collaborative Implementation of Domain Specific Metaheuristic OptimizationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580904(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580904
Tseng WHuron SLecolinet EGugenheimer J(2023)FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined SpacesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580736(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580736
Cheymol AFribourg RLécuyer ANormand JArgelaguet F(2023)Beyond my Real Body: Characterization, Impacts, Applications and Perspectives of “Dissimilar” Avatars in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332020929:11(4426-4437)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320209
Gong YZhang QNG BLi W(2022)BreathMentorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345956:2(1-28)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534595
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents