research-article

PC-MCU: point cloud multipoint control unit for multi-user holoconferencing systems

Authors:

Gianluca Cernigliaro,

Mario Montagud,

Sergi FernandezAuthors Info & Claims

NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

Pages 47 - 53

https://doi.org/10.1145/3386290.3396936

Published: 08 June 2020 Publication History

Abstract

This paper introduces the Point Cloud Multipoint Control Unit (PC-MCU): a key component for multi-user holoconferencing systems, where remote participants are represented as Point Clouds. The presented solution redefines the idea of MCU, broadly used to optimize connections and communications between users in traditional videoconferencing, and introduces a set of key features for the optimization of holoconferencing services where multiple users can be remotely connected. The PC-MCU is a virtualized cloud-based component, that aims at reducing the end-user client computational resources and bandwidth usage, providing the following key features: fusion of volumetric videos, Level of Detail (LoD) adjustment and non visible data removal. The results obtained for a scenario with two remote users, show how the introduction of the PC-MCU provides significant benefits in terms of computational resources and bandwidth savings, thus alleviating the requirements at the client side in holoconferencing services when compared to a baseline condition without using it. These improvements open the door to further research on this area to enable scalable and adaptive holoconferencing services using lightweight devices.

References

[1]

M Reha Civanlar, Öznur Özkasap, and Tahir Çelebi. 2005. Peer-to-peer multipoint videoconferencing on the Internet. Signal Processing: Image Communication 20, 8 (2005), 743--754.

[2]

Sylvie Dijkstra-Soudarissanane, Karim El Assal, Simon Gunkel, Frank ter Haar, Rick Hindriks, Jan Willem Kleinrouweler, and Omar Niamut. 2019. Multi-sensor capture and network processing for virtual reality conferencing. In Proceedings of the 10th ACM Multimedia Systems Conference. 316--319.

Digital Library

[3]

Eugene d'Eon, Bob Harrison, Taos Myers, and Phil A. Chou. 2017. 8i voxelized full bodies-a voxelized point cloud dataset. ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document WG11M40059/WG1M74006 (2017).

[4]

Global System for Mobile Communications Association. [n.d.]. Cloud AR/VR Whitepaper. https://www.gsma.com/futurenetworks/wiki/cloud-ar-vr-whitepaper/. Accessed: 2020-03-09.

[5]

Silvano Gai, Tommi Salli, and Roger Andersson. 2010. Cisco Unified Computing System (UCS)(Data Center): A Complete Reference Guide to the Cisco Data Center Virtualization Server Architecture. Pearson Education.

[6]

Mohammad Hosseini and Christian Timmerer. 2018. Dynamic adaptive point cloud streaming. In Proceedings of the 23rd Packet Video Workshop. 25--30.

Digital Library

[7]

Junlin Li, Li-wei He, and Dinei Florêncio. 2007. Multi-party audio conferencing based on a simpler MCU and client-side echo cancellation. In 2007 IEEE International Conference on Multimedia and Expo. IEEE, 84--87.

[8]

David Luebke, Martin Reddy, Jonathan D Cohen, Amitabh Varshney, Benjamin Watson, and Robert Huebner. 2003. Level of detail for 3D graphics. Morgan Kaufmann.

[9]

Rufael Mekuria, Kees Blom, and Pablo Cesar. 2016. Design, implementation, and evaluation of a point cloud codec for tele-immersive video. IEEE Transactions on Circuits and Systems for Video Technology 27, 4 (2016), 828--842.

Digital Library

[10]

M. Montagud, J.A. De Rus, R. Fayos-Jordán, M. García-Pineda, and J. Segura-Garcia. 2020. Open-Source Software Tools for Measuring Resources Consumption and DASH Metrics. In Proceedings of the 11th ACM Multimedia System Conference.

[11]

Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L Davidson, Sameh Khamis, Mingsong Dou, et al. 2016. Holoportation: Virtual 3d teleportation in real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 741--754.

Digital Library

[12]

Cagri Ozcinar, Ana De Abreu, and Aljosa Smolic. 2017. Viewport-aware adaptive 360 video streaming using tiles for virtual reality. In 2017 IEEE International Conference on Image Processing (ICIP). IEEE, 2174--2178.

[13]

Jounsup Park, Philip A Chou, and Jenq-Neng Hwang. 2019. Rate-utility optimized streaming of volumetric media for augmented reality. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2019), 149--162.

[14]

Kyungmo Park. [n.d.]. Network Based Media Processing. ISO/IEC JTC1/SC29/WG11 N18270, January, 2019.

[15]

Feng Qian, Bo Han, Jarrell Pair, and Vijay Gopalakrishnan. 2019. Toward practical volumetric video streaming on commodity smartphones. In Proceedings of the 20th International Workshop on Mobile Computing Systems and Applications. 135--140.

Digital Library

[16]

Maurice Quach, Giuseppe Valenzise, and Frederic Dufaux. 2019. Learning convolutional transforms for lossy point cloud geometry compression. In 2019 IEEE International Conference on Image Processing (ICIP). IEEE, 4320--4324.

[17]

Sebastian Schwarz, Marius Preda, Vittorio Baroncini, Madhukar Budagavi, Pablo Cesar, Philip A Chou, Robert A Cohen, Maja Krivokuća, Sebastien Lasserre, Zhu Li, et al. 2018. Emerging MPEG standards for point cloud compression. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2018), 133--148.

[18]

Gary A Thom. 1996. H. 323: the multimedia communications standard for local area networks. IEEE communications Magazine 34, 12 (1996), 52--56.

[19]

MH Willebeek-LeMair, Dilip D Kandlur, and Z-Y Shae. 1994. On multipoint control units for videoconferencing. In Proceedings of 19th conference on local computer networks. IEEE, 356--364.

Cited By

Gunkel SHindriks RShiferaw YDijkstra-Soudarissanane SNiamut O(2024)VP9 bitstream-based Tiled Multipoint Control UnitProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647608(23-33)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3647608
Liebers CPfützenreuter NProchazka MMegarajan PFuruno ELöber JStratmann TAuda JDegraen DGruenefeld USchneegass S(2024)Look Over Here! Comparing Interaction Methods for User-Assisted Remote Scene ReconstructionExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650982(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650982
Petkova RBozhilov IManolova ATonchev KPoulkov V(2024)On the Way to Holographic-Type Communications: Perspectives and Enabling TechnologiesIEEE Access10.1109/ACCESS.2024.339312412(59236-59259)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3393124
Show More Cited By

Index Terms

PC-MCU: point cloud multipoint control unit for multi-user holoconferencing systems
1. Computer systems organization
  1. Real-time systems
    1. Real-time operating systems
2. Networks
  1. Network services
    1. Cloud computing

Recommendations

Welcome to the Jungle: Using ARTV to Balance Media Immersion and Reality Awareness for Passengers on Public Transport
IMX '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences

Head-mounted displays (HMDs) offer new possibilities for reclaiming and improving passenger travel time. Common Virtual Reality (VR) HMDs provide an immersive mobile media viewing experience, overcoming the screen size constraints of mobile and seat-...
Regulating the Metaverse, a Blueprint for the Future
Extended Reality
Abstract
The core Immersive Media (IM) technologies of Virtual Reality (VR) and Augmented Reality (AR) have steadily advanced over the last thirty years, enabling high fidelity experiences at consumer prices. Over the same period, networking speeds have ...
Exploring Extended Reality Multi-Robot Ground Control Stations
AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

This paper presents work-in-progress research exploring the use of extended reality headsets to overcome the intrinsic limitations of conventional, screen-based ground control stations. Specifically, we discuss an extended reality ground control station ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

June 2020

73 pages

ISBN:9781450379458

DOI:10.1145/3386290

General Chair:
M. Reha Civanlar
Ozyegin University
,
Program Chairs:
Lucile Sassatelli
Universite Cote d'Azur
,
Jong-Seok Lee
Yonsei University

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article

Funding Sources

EU H2020 Program

Conference

MMSys '20

Sponsor:

SIGMM

MMSys '20: 11th ACM Multimedia Systems Conference

June 10 - 11, 2020

Istanbul, Turkey

Acceptance Rates

NOSSDAV '20 Paper Acceptance Rate 10 of 22 submissions, 45%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
281
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gunkel SHindriks RShiferaw YDijkstra-Soudarissanane SNiamut O(2024)VP9 bitstream-based Tiled Multipoint Control UnitProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647608(23-33)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3625468.3647608
Liebers CPfützenreuter NProchazka MMegarajan PFuruno ELöber JStratmann TAuda JDegraen DGruenefeld USchneegass S(2024)Look Over Here! Comparing Interaction Methods for User-Assisted Remote Scene ReconstructionExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650982(1-8)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650982
Petkova RBozhilov IManolova ATonchev KPoulkov V(2024)On the Way to Holographic-Type Communications: Perspectives and Enabling TechnologiesIEEE Access10.1109/ACCESS.2024.339312412(59236-59259)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3393124
Fernandez SMontagud MRincón DMoragues JCernigliaro GEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)Addressing Scalability for Real-time Multiuser Holo-portation: Introducing and Assessing a Multipoint Control Unit (MCU) for Volumetric VideoProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613777(9243-9251)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3613777
Serreli LBingöl GPorcu SFloris AMartalò M(2023)Robust QUIC-Based Signalling for WebRTC in Impaired Networks2023 IEEE International Mediterranean Conference on Communications and Networking (MeditCom)10.1109/MeditCom58224.2023.10266652(187-192)Online publication date: 4-Sep-2023
https://doi.org/10.1109/MeditCom58224.2023.10266652
Viola IJansen JSubramanyam SReimat ICesar P(2023)VR2Gather: A Collaborative, Social Virtual Reality System for Adaptive, Multiparty Real-Time CommunicationIEEE MultiMedia10.1109/MMUL.2023.326394330:2(48-59)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/MMUL.2023.3263943
Chochliouros IVardakas JRamantas KPollin SMayrargue SKsentini ANitzold WRahman MO’Meara JChawla AKritharidis DTheodorou VSiddiqui SIbañez FGardikis GDiagourtas DChristofi LMourad ANicholson DKostopoulos ASpiliopoulou AVerikoukis C(2023)6G-BRICKS: Developing a Modern Experimentation Facility for Validation, Testing and Showcasing of 6G Breakthrough Technologies and DevicesArtificial Intelligence Applications and Innovations. AIAI 2023 IFIP WG 12.5 International Workshops10.1007/978-3-031-34171-7_1(17-31)Online publication date: 2-Jun-2023
https://doi.org/10.1007/978-3-031-34171-7_1
Petkova RPoulkov VManolova ATonchev K(2022)Challenges in Implementing Low-Latency Holographic-Type Communication SystemsSensors10.3390/s2224961722:24(9617)Online publication date: 8-Dec-2022
https://doi.org/10.3390/s22249617
Subramanyam SViola IJansen JAlexiou EHanjalic ACesar PMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Evaluating the Impact of Tiled User-Adaptive Real-Time Point Cloud Streaming on VR Remote CommunicationProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548220(3094-3103)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3548220
Langa SCliment MCernigliaro GRincon Rivera D(2022)Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV ScenariosIEEE Transactions on Broadcasting10.1109/TBC.2021.312349968:1(13-32)Online publication date: Mar-2022
https://doi.org/10.1109/TBC.2021.3123499
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents