demonstration

Virtual reality conferencing: multi-user immersive VR experiences on the web

Authors:

Omar A. NiamutAuthors Info & Claims

MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference

Pages 498 - 501

https://doi.org/10.1145/3204949.3208115

Published: 12 June 2018 Publication History

Get Access

Abstract

Virtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. While Social VR applications are getting more momentum, most services regarding Social VR focus on animated avatars. In this demo, we present our efforts towards Social VR services based on photo-realistic video recordings. In this demo paper, we focus on two parts, the communication between multiple people (max 3) and the integration of new media formats to represent users as 3D point clouds. We enhance a green screen (chroma key) like cut-out of the person with depth data, allowing point cloud based rendering in the client. Further, the paper presents a user study with 54 people evaluating a three-people communication use case and a technical analysis to move towards 3D representations of users. This demo consists of two shared virtual environments to communicate and interact with others, i.e. i) a 360-degree virtual space with users being represented as 2D video streams (with the background removed) and ii) a 3D space with users being represented as point clouds (based on color and depth video data).

References

[1]

Steve Benford, Chris Greenhalgh, Tom Rodden, and James Pycock. 2001. Collaborative virtual environments. Commun. ACM 44, 7 (2001), 79--85.

Digital Library

Google Scholar

[2]

Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 529--536.

Digital Library

Google Scholar

[3]

Simon Gunkel, Martin Prins, Hans Stokking, and Omar Niamut. 2017. WebVR meets WebRTC: Towards 360-degree social VR experiences. In Virtual Reality (VR), 2017 IEEE. IEEE, 457--458.

Google Scholar

[4]

Simon NB Gunkel, Martin Prins, Hans Stokking, and Omar Niamut. 2017. Social VR Platform: Building 360-degree Shared VR Spaces. In Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video. ACM, 83--84.

Digital Library

Google Scholar

[5]

Michitaka Hirose, Tetsuro Ogi, and Toshio Yamada. 1999. Integrating live video for immersive environments. IEEE MultiMedia 6, 3 (1999), 14--22.

Digital Library

Google Scholar

[6]

Peter Kauff and Oliver Schreer. 2002. An immersive 3D video-conferencing system using shared virtual team user environments. In Proceedings of the 4th international conference on Collaborative virtual environments. ACM, 105--112.

Digital Library

Google Scholar

[7]

Jason Leigh, Andrew E Johnson, Thomas A DeFanti, Maxine Brown, M Dastagir Ali, Stuart Bailey, Andy Banerjee, P Benerjee, Jim Chen, Kevin Curry, et al. 1999. A review of tele-immersive applications in the CAVE research network. In Virtual Reality, 1999. Proceedings., IEEE. IEEE, 180--187.

Digital Library

Google Scholar

[8]

Tetsuro Ogi, Toshio Yamada, Ken Tamagawa, Makoto Kano, and Michitaka Hirose. 2001. Immersive telecommunication using stereo video avatar. In Virtual Reality, 2001. Proceedings. IEEE. IEEE, 45--51.

Digital Library

Google Scholar

[9]

J. Outlaw and B. Duckles. 2017. Why Woman Don't Like Social Virtual Reality. https://extendedmind.io/social-vr

Google Scholar

[10]

MJ Prins, S Gunkel, and OA Niamut. 2017. TOGETHERVR: A FRAMEWORK FOR PHOTO-REALISTIC SHARED MEDIA EXPERIENCES IN 360-DEGREE VR. In Technical Papers International Broadcasting Convention (IBC).

Google Scholar

[11]

Ralph Schroeder. 2012. The social life of avatars: Presence and interaction in shared virtual environments. Springer Science & Business Media.

Digital Library

Google Scholar

Cited By

View all

Rasch JPerzl FWeiss YMüller F(2024)Just Undo It: Exploring Undo Mechanics in Multi-User Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642864(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642864
Shin KCho CRyu JJo D(2023)Exploring the Perception of the Effect of Three-Dimensional Interaction Feedback Types on Immersive Virtual Reality EducationElectronics10.3390/electronics1221441412:21(4414)Online publication date: 26-Oct-2023
https://doi.org/10.3390/electronics12214414
Dasari MLu EFarb MPereira NLiang IRowe A(2023)Scaling VR Video Conferencing2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00080(648-657)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00080
Show More Cited By

Index Terms

Virtual reality conferencing: multi-user immersive VR experiences on the web
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality
2. Information systems
  1. Information systems applications
    1. Multimedia information systems
  2. World Wide Web
    1. Web applications
      1. Internet communications tools
        Web conferencing

Recommendations

Experiencing Virtual Reality Together: Social VR Use Case Study
TVX '18: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video

As Virtual Reality (VR) applications gain more momentum recently, the social and communication aspects of VR experiences become more relevant. In this paper, we present some initial results of understanding the type of applications and factors that ...
Social VR Platform: Building 360-degree Shared VR Spaces
TVX '17 Adjunct: Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video

Virtual Reality (VR) and 360-degree video are set to become part of the future social environment, enriching and enhancing the way we share experiences and collaborate remotely. In this demo, we present our ongoing efforts towards social and shared VR; ...
VRComm: an end-to-end web system for real-time photorealistic social VR communication
MMSys '21: Proceedings of the 12th ACM Multimedia Systems Conference

Tools and platforms that enable remote communication and collaboration provide a strong contribution to societal challenges. Virtual meetings and conferencing, in particular, can help to reduce commutes and lower our ecological footprint, and can ...

Comments

Information & Contributors

Information

Published In

MMSys '18: Proceedings of the 9th ACM Multimedia Systems Conference

June 2018

604 pages

ISBN:9781450351928

DOI:10.1145/3204949

General Chair:
Pablo Cesar
Centrum Wiskunde & Informatica, The Netherlands
,
Program Chairs:
Michael Zink
University of Massachusetts Amherst
,
Niall Murray
Athlone Institute of Technology, Ireland

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2018

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

European Commission

Conference

MMSys '18

Sponsor:

SIGMM

MMSys '18: 9th ACM Multimedia Systems Conference

June 12 - 15, 2018

Amsterdam, Netherlands

Acceptance Rates

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
1,099
Total Downloads

Downloads (Last 12 months)113
Downloads (Last 6 weeks)11

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rasch JPerzl FWeiss YMüller F(2024)Just Undo It: Exploring Undo Mechanics in Multi-User Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642864(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642864
Shin KCho CRyu JJo D(2023)Exploring the Perception of the Effect of Three-Dimensional Interaction Feedback Types on Immersive Virtual Reality EducationElectronics10.3390/electronics1221441412:21(4414)Online publication date: 26-Oct-2023
https://doi.org/10.3390/electronics12214414
Dasari MLu EFarb MPereira NLiang IRowe A(2023)Scaling VR Video Conferencing2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00080(648-657)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00080
Bambušek DMaterna ZKapinus MBeran VSmrž P(2023)How Do I Get There? Overcoming Reachability Limitations of Constrained Industrial Environments in Augmented Reality Applications2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00027(115-122)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00027
Orduna MPérez PGutiérrez JGarcía N(2023)Methodology to Assess Quality, Presence, Empathy, Attitude, and Attention in 360-degree Videos for Immersive CommunicationsIEEE Transactions on Affective Computing10.1109/TAFFC.2022.314916214:3(2375-2388)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TAFFC.2022.3149162
Moslavac MBrzica LDrozd LKušurin NVlahović SSkorin-Kapov L(2023)Assessment of Varied User Representations and XR Environments in Consumer-Grade XR Telemeetings2023 17th International Conference on Telecommunications (ConTEL)10.1109/ConTEL58387.2023.10199061(1-8)Online publication date: 11-Jul-2023
https://doi.org/10.1109/ConTEL58387.2023.10199061
Moreira CSimoes FLee MZorzal ELindeman RPereira JJohnsen KJorge J(2023)Toward VR in VR: Assessing Engagement and Social Interaction in a Virtual ConferenceIEEE Access10.1109/ACCESS.2022.323331211(1906-1922)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2022.3233312
Chung SJo HLee H(2022)A Comparison of Behaviours and Responses towards Different Social VR Environments in Initial Social InteractionArchives of Design Research10.15187/adr.2022.08.35.3.5335:3(53-67)Online publication date: 31-Aug-2022
https://doi.org/10.15187/adr.2022.08.35.3.53
Zhang DZhou PHan BPathak PGummeson JLee SGao JXing G(2022)M5Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems10.1145/3560905.3568540(31-46)Online publication date: 6-Nov-2022
https://dl.acm.org/doi/10.1145/3560905.3568540
Eo JNiu ZCheng WYan FGao RKardhashi JInglis SRevow MChun BCheng PXiong Y(2022)OpenNetLab: Open Platform for RL-based Congestion Control for Real-Time CommunicationsProceedings of the 6th Asia-Pacific Workshop on Networking10.1145/3542637.3542648(70-75)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1145/3542637.3542648
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Experiencing Virtual Reality Together: Social VR Use Case Study

Social VR Platform: Building 360-degree Shared VR Spaces

VRComm: an end-to-end web system for real-time photorealistic social VR communication