research-article

Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration

Authors:

Thammathip Piumsomboon,

Jonathon D. Hart,

Robert W. Lindeman,

Bruce H. Thomas, and

Mark BillinghurstAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

Paper No.: 46, Pages 1 - 13

https://doi.org/10.1145/3173574.3173620

Published: 19 April 2018 Publication History

Abstract

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures while it transforms in size and orientation to stay within the AR user's field of view. A user study was conducted to evaluate Mini-Me in two collaborative scenarios: an asymmetric remote expert in VR assisting a local worker in AR, and a symmetric collaboration in urban planning. We found that the presence of the Mini-Me significantly improved Social Presence and the overall experience of MR collaboration.

Supplementary Material

suppl.mov (pn1287-file3.mp4)

Supplemental video

Download
47.97 MB

suppl.mov (pn1287-file5.mp4)

Supplemental video

Download
14.53 MB

References

[1]

Hesam Alizadeh, Anna Witcraft, Anthony Tang and Ehud Sharlin. 2016. HappyFeet: Embodiments for Joint Remote Dancing. in In GI '16: Proceedings of the 2016 Graphics Interface Conference, 117--124.

Digital Library

[2]

AltspaceVR. AltspaceVR. 2017. Retrieved January 1, 2018 from https://altvr.com

[3]

Judith Amores, Xavier Benavides and Pattie Maes. 2015. Showme: A remote collaboration system that supports immersive gestural communication. in Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, ACM, 1343--1348.

Digital Library

[4]

Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: a technique for visualizing off-screen objects. in Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 481--488.

Digital Library

[5]

Mark Billinghurst and Hirokazu Kato. 1999. Collaborative mixed reality. in Proceedings of the First International Symposium on Mixed Reality, 261--284.

[6]

Mark Billinghurst, Hirokazu Kato, Kiyoshi Kiyokawa, Daniel Belcher and Ivan Poupyrev. 2002. Experiments with face-to-face collaborative AR interfaces. Virtual Reality, 6 (3). 107--121.

[7]

Mark Billinghurst, Hirokazu Kato and Ivan Poupyrev. 2001. The MagicBook: a transitional AR interface. Computers & Graphics, 25 (5). 745--753.

[8]

D. Borland, T. Peck and M. Slater. 2013. An Evaluation of Self-Avatar Eye Movement for Virtual Embodiment. IEEE Transactions on Visualization and Computer Graphics, 19 (4). 591--596.

Digital Library

[9]

Wolfgang Broll, Irma Lindt, Jan Ohlenburg, Michael Wittkämper, Chunrong Yuan, Thomas Novotny, Chiron Mottram, A Fatah gen Schieck and A Strothman. 2004. Arthur: A collaborative augmented environment for architectural design and urban planning.

[10]

Bill Buxton. 2009. Mediaspace--meaningspace-- meetingspace. Media space 20+ years of mediated life. 217--231.

[11]

Andre Doucette, Carl Gutwin, Regan L Mandryk, Miguel Nacenta and Sunny Sharma. 2013. Sometimes when we touch: how arm embodiments change reaching and collaboration on digital tables. in Proceedings of the 2013 conference on Computer supported cooperative work, ACM, 193--202.

Digital Library

[12]

Thierry Duval, Thi Thuong Huyen Nguyen, Cédric Fleury, Alain Chauffaut, Georges Dumont and Valérie Gouranton. 2014. Improving awareness for 3D virtual collaboration by embedding the features of users' physical environments and by augmenting interaction tools with cognitive feedback cues. Journal on Multimodal User Interfaces, 8 (2). 187--197.

[13]

Barrett Ens, Eyal Ofek, Neil Bruce and Pourang Irani. 2015. Spatial constancy of surface-embedded layouts across multiple environments. in Proceedings of the 3rd ACM Symposium on Spatial User Interaction, ACM, 65--68.

Digital Library

[14]

Raphael Grasset, Philip Lamb and Mark Billinghurst. 2005. Evaluation of Mixed-Space Collaboration Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 90--99.

Digital Library

[15]

Saul Greenberg, Carl Gutwin and Mark Roseman. 1996. Semantic telepointers for groupware. in Computer-Human Interaction, 1996. Proceedings., Sixth Australian Conference on, IEEE, 54--61.

Digital Library

[16]

Carl Gutwin and Saul Greenberg. 1996. Workspace awareness for groupware. in Conference Companion on Human Factors in Computing Systems, ACM, 208--209.

Digital Library

[17]

Chad Harms and Frank Biocca. 2004. Internal consistency and reliability of the networked minds measure of social presence.

[18]

Keita Higuchi, Yinpeng Chen, Philip A Chou, Zhengyou Zhang and Zicheng Liu. 2015. Immerseboard: Immersive telepresence experience using a digital whiteboard. in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, 2383--2392.

Digital Library

[19]

Keita Higuchi, Ryo Yonetani and Yoichi Sato. 2016. Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 5180--5190.

Digital Library

[20]

T. Kim, A. Kachhara and B. MacIntyre. 2016. Redirected head gaze to support AR meetings distributed over heterogeneous environments. in 2016 IEEE Virtual Reality (VR), 207--208.

[21]

Kiyoshi Kiyokawa, Haruo Takemura and Naokazu Yokoya. 1999. A collaboration support technique by integrating a shared virtual reality and a shared augmented reality. in Systems, Man, and Cybernetics, 1999. IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on, IEEE, 48--53.

[22]

Minoru Kobayashi and Hiroshi Ishii. 1993. ClearBoard: a novel shared drawing medium that supports gaze awareness in remote collaboration. IEICE Transactions on Communications, 76 (6). 609--617.

[23]

Harry T. Lawless and Hildegarde Heymann. 2010. Preference Testing. in Sensory Evaluation of Food: Principles and Practices, Springer New York, New York, NY, 303--324.

[24]

Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan and Bruno Arnaldi. 2015. The stretchable arms for collaborative remote guiding. in Proceedings of International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments.

Digital Library

[25]

Morgan Le Chénéchal, Thierry Duval, Valérie Gouranton, Jérôme Royan and Bruno Arnaldi. 2016. Vishnu: virtual immersive support for HelpiNg users an interaction paradigm for collaborative remote guiding in mixed reality. in Collaborative Virtual Environments (3DCVE), 2016 IEEE Third VR International Workshop on, IEEE, 9--12.

[26]

Hao Li, Laura Trutoiu, Kyle Olszewski, Lingyu Wei, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls and Chongyang Ma. 2015. Facial performance sensing head-mounted display. ACM Trans. Graph., 34 (4). 1--9.

Digital Library

[27]

Andrew Maimone, Xubo Yang, Nate Dierk, Andrei State, Mingsong Dou and Henry Fuchs. 2013. Generalpurpose telepresence with head-worn optical seethrough displays and projector-based lighting. in Virtual Reality (VR), 2013 IEEE, IEEE, 23--26.

[28]

Microsoft. 2017. Spatial Understanding.

[29]

Jens Mueller, Roman Rädle and Harald Reiterer. 2017. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 6481--6486.

Digital Library

[30]

Benjamin Nuernberger, Eyal Ofek, Hrvoje Benko and Andrew D Wilson. 2016. Snaptoreality: Aligning augmented reality to the real world. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, 1233--1244.

Digital Library

[31]

Oculus. 2017. Facebook Spaces.

[32]

Ohan Oda, Carmine Elvezio, Mengu Sukan, Steven Feiner and Barbara Tversky. 2015. Virtual replicas for remote assistance in virtual and augmented reality. in Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ACM, 405--415.

Digital Library

[33]

Ohan Oda and Steven Feiner. 2012. 3D referencing techniques for physical objects in shared augmented reality. in Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on, IEEE, 207--215.

Digital Library

[34]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time Proceedings of the 29th Annual Symposium on User Interface Software and Technology, ACM, Tokyo, Japan, 741--754.

Digital Library

[35]

Kazuhiro Otsuka. 2016. MMSpace: Kineticallyaugmented telepresence for small group-to-group conversations. in Virtual Reality (VR), 2016 IEEE, IEEE, 19--28.

[36]

Tomislav Pejsa, Julian Kantor, Hrvoje Benko, Eyal Ofek and Andrew Wilson. 2016. Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, ACM, San Francisco, California, USA, 1716--1725.

Digital Library

[37]

Thammathip Piumsomboon, Arindam Day, Barrett Ens, Youngho Lee, Gun Lee and Mark Billinghurst. 2017. Exploring enhancements for remote mixed reality collaboration SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, ACM, Bangkok, Thailand, 1--5.

Digital Library

[38]

Thammathip Piumsomboon, Youngho Lee, Gun A Lee, Arindam Dey and Mark Billinghurst. 2017. Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See. in Ubiquitous Virtual Reality (ISUVR), 2017 International Symposium on, IEEE, 3841.

[39]

Thammathip Piumsomboon, Youngho Lee, Gun Lee and Mark Billinghurst. 2017. CoVAR: a collaborative virtual and augmented reality system for remote collaboration SIGGRAPH Asia 2017 Emerging Technologies, ACM, Bangkok, Thailand, 1--2.

Digital Library

[40]

Simon Prince, Adrian David Cheok, Farzam Farbiz, Todd Williamson, Nik Johnson, Mark Billinghurst and Hirokazu Kato. 2002. 3-D live: real time interaction for mixed reality Proceedings of the 2002 ACM conference on Computer supported cooperative work, ACM, New Orleans, Louisiana, USA, 364--371.

Digital Library

[41]

Jeff Sauro and Joseph S Dumas. 2009. Comparison of three one-question, post-task usability questionnaires. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 1599--1608.

Digital Library

[42]

Rajinder S. Sodhi, Brett R. Jones, David Forsyth, Brian P. Bailey and Giuliano Maciocci. 2013. BeThere: 3D mobile collaboration with spatial input Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, Paris, France, 179--188.

Digital Library

[43]

Aaron Stafford, Wayne Piekarski and Bruce H. Thomas. 2006. Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users. in 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality, 165--172.

Digital Library

[44]

Aaron Stafford, Bruce H Thomas and Wayne Piekarski. 2008. Efficiency of techniques for mixed-space collaborative navigation. in Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 181--182.

Digital Library

[45]

Matthew Tait and Mark Billinghurst. 2015. The Effect of View Independence in a Collaborative AR System. Comput. Supported Coop. Work, 24 (6). 563--589.

Digital Library

[46]

Anthony Tang, Carman Neustaedter and Saul Greenberg. 2007. Videoarms: embodiments for mixed presence groupware. in People and Computers XX- Engage, Springer, 85--102.

[47]

Anthony Tang, Michel Pahud, Kori Inkpen, Hrvoje Benko, John C Tang and Bill Buxton. 2010. Three's company: understanding communication channels in three-way distributed collaboration. in Proceedings of the 2010 ACM conference on Computer supported cooperative work, ACM, 271--280.

Digital Library

[48]

Franco Tecchia, Leila Alem and Weidong Huang. 2012. 3D helping hands: a gesture based MR system for remote collaboration. in Proceedings of the 11th ACM SIGGRAPH International Conference on VirtualReality Continuum and its Applications in Industry, ACM, 323--328.

Digital Library

[49]

Vuforia. Vuforia SDK. 2017. Retrieved January 1, 2018 from https://developer.vuforia.com/downloads/sdk

[50]

Kevin Winata Wong. 2015. HandsOn: A Portable System for Collaboration on Virtual 3D Objects Using Binocular Optical Head-Mounted Display, Massachusetts Institute of Technology.

[51]

Ferdinand Rudolf Hendrikus Zijlstra. 1993. Efficiency in work behaviour: A design approach for modern tools.

[52]

Jakob Zillner, Christoph Rhemann, Shahram Izadi and Michael Haller. 2014. 3D-board: a whole-body remote collaborative whiteboard. in Proceedings of the 27th annual ACM symposium on User interface software and technology, ACM, 471--479.

Digital Library

Cited By

Pouke MUotila ECenter ETimperi KChambers AOjala TLavalle S(2024)Adaptation to Simulated Hypergravity in a Virtual Reality Throwing TaskACM Transactions on Applied Perception10.1145/364384921:2(1-23)Online publication date: 5-Feb-2024
https://dl.acm.org/doi/10.1145/3643849
Liao JVan KXia ZSuzuki R(2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661631
Ujjainkar NShahan EChen KDuinkharjav BSun QZhu YTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual RealityProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624860(166-180)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624860
Show More Cited By

Index Terms

Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging Technologies

We present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...
Read More
VROOM: Virtual Robot Overlay for Online Meetings
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Telepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online ...
Read More
Snow Dome: A Multi-Scale Interaction in Mixed Reality Remote Collaboration
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

We present Snow Dome, a Mixed Reality (MR) remote collaboration application that supports a multi-scale interaction for a Virtual Reality (VR) user. We share a local Augmented Reality (AR) user's reconstructed space with a remote VR user who has an ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

57
Total Citations
View Citations
4,747
Total Downloads

Downloads (Last 12 months)635
Downloads (Last 6 weeks)79

Other Metrics

View Author Metrics

Citations

Cited By

Pouke MUotila ECenter ETimperi KChambers AOjala TLavalle S(2024)Adaptation to Simulated Hypergravity in a Virtual Reality Throwing TaskACM Transactions on Applied Perception10.1145/364384921:2(1-23)Online publication date: 5-Feb-2024
https://dl.acm.org/doi/10.1145/3643849
Liao JVan KXia ZSuzuki R(2024)RealityEffects: Augmenting 3D Volumetric Videos with Object-Centric Annotation and Dynamic Visual EffectsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661631(1248-1261)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661631
Ujjainkar NShahan EChen KDuinkharjav BSun QZhu YTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual RealityProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624860(166-180)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624860
Do NLe KLy DFjeld MTran M(2024)XRPublicSpectator: Towards Public Mixed Reality Viewing in Collocated Asymmetric GroupsExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650796(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650796
Zhang JHan BDong ZWen RLee GHoermann SZhang WPiumsomboon T(2024)Virtual Triplets: A Mixed Modal Synchronous and Asynchronous Collaboration with Human-Agent Interaction in Virtual RealityExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650766(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650766
Sakashita MThoravi Kumaravel BMarquardt NWilson A(2024)SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote CollaborationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642945(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642945
Irlitti ALatifoglu MHoang TSyiem BVetere F(2024)Volumetric Hybrid Workspaces: Interactions with Objects in Remote and Co-located TelepresenceProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642814(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642814
Ullal ATauseef MWatkins AJuckett LMaxwell CTate JMion LSarkar N(2024)An Iterative Participatory Design Approach to Develop Collaborative Augmented Reality Activities for Older Adults in Long-Term Care FacilitiesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642595(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642595
Mello BWelsch RVerbokkem MKnierim PDechant M(2024)Navigating the Virtual Gaze: Social Anxiety's Role in VR ProxemicsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642359(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642359
Grønbæk JSánchez Esquivel JLeiva GVelloso EGellersen HPfeuffer K(2024)Blended Whiteboard: Physicality and Reconfigurability in Remote Mixed Reality CollaborationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642293(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642293
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents