Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Context-Aware and Reliable Transport Layer Framework for Interactive Immersive Media Delivery Over Millimeter Wave

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

In order to achieve truly immersive multimedia experiences, full freedom of movement has to be supported, and high-quality, interactive video delivery to the head-mounted device is vital. In wireless environments, this is very challenging due to the massive bandwidth and ultra-low delay requirements of such applications. Millimeter wave (mmWave) networks promise ultra-high speed owing to the availability of high-capacity bands at a frequency range of 30 GHz to 300 GHz. However, they are prone to signal attenuation due to blockage and beam misalignment due to mobility, leading to packet loss and retransmissions. This can lead to the head-of-line blocking problem on the transport layer which results in playout stalls and delivery of lower quality data that can be highly detrimental to a user’s quality of experience (QoE). Complementary to research efforts trying to make mmWave networks more resilient through lower-layer enhancements, this paper presents a transport layer solution that provides an adaptive and reliable transmission over mmWave networks-based on partially reliable QUIC. Using context information retrieved periodically from the client to adapt according to the networking conditions induced due to mobility and obstacles, the essential part of the video content (i.e., in the viewport of the end user) is transmitted reliably, while less important content (i.e., outside of the viewport of the end user) is sent unreliably. Our decision-making logic is able to effectively deliver 22.5% more content in the viewport reliably. This is achieved without additional playout interruptions or quality changes for scenarios with high-bitrate volumetric video streaming evaluated over realistic mmWave network traces. In case the server can perfectly predict the network bandwidth, playout interruptions can be avoided altogether.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Algorithm 1
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Data Availability

No datasets were generated or analysed during the current study.

Notes

  1. https://iperf.fr/.

  2. https://www.tp-link.com/us/home-networking/wifi-router/ad7200/.

  3. https://roverrobotics.com/products/4wd-rover-pro.

References

  1. Struye, J., Ravuri, H.K., Assasa, H., Fiandrino, C., Lemic, F., Widmer, J., Famaey, J., Torres Vega, M.: Opportunities and challenges for virtual reality streaming over millimeter-wave: An experimental analysis. In: 2022 13th International Conference on Network of the Future (NoF), pp. 1–5 (2022). IEEE

  2. Clemm, A., Torres Vega, M., Ravuri, H.K., Wauters, T., De Turck, F.: Toward truly immersive holographic-type communication: challenges and solutions. IEEE Commun. Mag. 58(1), 93–99 (2020)

    Article  Google Scholar 

  3. Chaccour, C., Soorki, M.N., Saad, W., Bennis, M., Popovski, P.: Can terahertz provide high-rate reliable low-latency communications for wireless vr? IEEE Internet Things J. 9(12), 9712–9729 (2022). https://doi.org/10.1109/JIOT.2022.3142674

    Article  Google Scholar 

  4. Uwaechia, A.N., Mahyuddin, N.M.: A comprehensive survey on millimeter wave communications for fifth-generation wireless networks: Feasibility and challenges. IEEE Access 8, 62367–62414 (2020)

    Article  Google Scholar 

  5. Nor, A.M., Halunga, S., Fratu, O.: Survey on positioning information assisted mmwave beamforming training. Ad Hoc Netw. 135, 102947 (2022)

    Article  Google Scholar 

  6. Ravuri, H.K., Struye, J., Torres Vega, M., Hooft, J., Famaey, J., Wauters, T., De Turck, F.: Streaming 8k video over millimeter wave networks: An experimental demonstrator. In: 2022 13th International Conference on Network of the Future (NoF), pp. 1–3 (2022). IEEE

  7. Ren, Y., Yang, W., Zhou, X., Chen, H., Liu, B.: A survey on TCP over mmWave. Comput. Commun. 171, 80–88 (2021)

    Article  Google Scholar 

  8. Tarafder, P., Choi, W.: Mac protocols for mmwave communication: a comparative survey. Sensors 22(10), 3853 (2022)

    Article  Google Scholar 

  9. Jung, J., An, D.: Access latency reduction in the quic protocol based on communication history. Electronics 8(10), 1204 (2019)

    Article  Google Scholar 

  10. Ravuri, H.K., Torres Vega, M., van der Hooft, J., Wauters, T., De Turck, F.: Partially reliable transport layer for QUICker interactive immersive media delivery. In: Proceedings of the 1st Workshop on Interactive eXtended Reality, pp. 41–49 (2022)

  11. Iyengar, J., Thomson, M.: RFC 9000 QUIC: A UDP-based multiplexed and secure transport. Omtermet Emgomeeromg Task Force (2021)

  12. Li, J., Niu, Y., Wu, H., Ai, B., Chen, S., Feng, Z., Zhong, Z., Wang, N.: Mobility support for millimeter wave communications: Opportunities and challenges. IEEE Communications Surveys & Tutorials (2022)

  13. Cao, Y., Lv, T., Ni, W.: Intelligent reflecting surface aided multi-user mmwave communications for coverage enhancement. In: 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications, pp. 1–6 (2020). https://doi.org/10.1109/PIMRC48278.2020.9217160

  14. Hayes, D.A., Ros, D., Alay, Ö., Teymoori, P., Vister, T.M.: Investigating predictive model-based control to achieve reliable consistent multipath mmwave communication. Comput. Commun. 194, 29–43 (2022)

    Article  Google Scholar 

  15. Chakareski, J., Khan, M., Ropitault, T., Blandino, S.: Millimeter wave and free-space-optics for future dual-connectivity 6dof mobile multi-user vr streaming. ACM Trans. Multimed. Comput. Commun. Appl. 19(2), 1–25 (2023)

    Article  Google Scholar 

  16. Zhang, D., Han, B., Pathak, P., Wang, H.: Innovating multi-user volumetric video streaming through cross-layer design. In: Proceedings of the Twentieth ACM Workshop on Hot Topics in Networks, pp. 16–22 (2021)

  17. Struye, J., Lemic, F., Famaey, J.: Covrage: Millimeter-wave beamforming for mobile interactive virtual reality. IEEE Trans. Wirel. Commun. 22(7), 4828–4842 (2022)

    Article  Google Scholar 

  18. Wu, H., Caso, G., Ferlin, S., Alay, Ö., Brunstrom, A.: Multipath scheduling for 5g networks: Evaluation and outlook. IEEE Commun. Mag. 59(4), 44–50 (2021)

    Article  Google Scholar 

  19. Haile, H., Grinnemo, K.-J., Hurtig, P., Brunstrom, A.: Rbbr: a receiver-driven bbr in quic for low-latency in cellular networks. IEEE Access 10, 18707–18719 (2022)

    Article  Google Scholar 

  20. Michel, F., Cohen, A., Malak, D., De Coninck, Q., Médard, M., Bonaventure, O.: FlEC: enhancing QUIC with application-tailored reliability mechanisms. IEEE/ACM Trans. Netw. 31(2), 606–619 (2022)

    Article  Google Scholar 

  21. Li, J., Zhang, C., Liu, Z., Hong, R., Hu, H.: Optimal volumetric video streaming with hybrid saliency based tiling. IEEE Trans. Multimed. Early Access 25, 2939–2953 (2022)

    Article  Google Scholar 

  22. Zverev, M., Garrido, P., Fernandez, F., Bilbao, J., Alay, Ö., Ferlin, S., Brunstrom, A., Agüero, R.: Robust QUIC: integrating practical coding in a low latency transport protocol. IEEE Access 9, 138225–138244 (2021)

    Article  Google Scholar 

  23. van der Hooft, J., Wauters, T., De Turck, F., Timmerer, C., Hellwagner, H.: Towards 6DOF HTTP adaptive streaming through point cloud compression. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 2405–2413 (2019)

  24. d’Eon, E., Harrison, B., Myers, T., Chou, P.A.: 8i voxelized full bodies-a voxelized point cloud dataset. ISO/IEC JTC1/SC29 Joint WG11/WG1 (MPEG/JPEG) input document WG11M40059/WG1M74006 7, 8 (2017)

  25. Schwarz, S., Preda, M., Baroncini, V., Budagavi, M., Cesar, P., Chou, P.A., Cohen, R.A., Krivokuća, M., Lasserre, S., Li, Z.: Emerging MPEG standards for point cloud compression. IEEE J. Emerg. Sel. Top. Circ. Syst. 9(1), 133–148 (2018)

    Article  Google Scholar 

  26. Ravuri, H.K., Torres Vega, M., van der Hooft, J.D., Wauters, T., De Turck, F.: Adaptive partially reliable delivery of immersive media over quic-http/3. IEEE Access 11, 38094–38111 (2023)

    Article  Google Scholar 

  27. Marx, R., Herbots, J., Lamotte, W., Quax, P.: Same standards, different decisions: a study of QUIC and HTTP/3 implementation diversity. In: Proceedings of the Workshop on the Evolution, Performance, and Interoperability of QUIC, pp. 14–20 (2020)

  28. Kaur, K., Singh, J., Ghumman, N.S.: Mininet as software defined networking testing platform. In: International Conference on Communication, Computing & Systems (ICCCS), pp. 139–42 (2014)

  29. IDLabt ilab.t: https://doc.ilabt.imec.be/ilabt/virtualwall/ (2023). https://doc.ilabt.imec.be/ilabt/virtualwall/

Download references

Acknowledgements

Part of this research was funded by the ICON project INTERACT, realized in collaboration with imec, with project support from Flanders Innovation and Entepreneurship (VLAIO). Project partners are imec, Rhinox, Pharrowtech, Dekimo and TEO. This research is partially funded by the FWO WaveVR project (Grant number: G034322N).

Author information

Authors and Affiliations

  1. IDLab, Ghent University-imec, Ghent, Belgium

    Hemanth Kumar Ravuri, Jeroen van der Hooft, Tim Wauters, Filip De Turck & Maria Torres Vega

  2. IDLab, University of Antwerp - imec, Antwerp, Belgium

    Jakob Struye & Jeroen Famaey

  3. eMedia Lab, KU Leuven, Leuven, Belgium

    Maria Torres Vega

Authors
  1. Hemanth Kumar Ravuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jakob Struye
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeroen van der Hooft
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tim Wauters
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Filip De Turck
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jeroen Famaey
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Maria Torres Vega
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

H.K.R. took the lead on the experiments and the writing of the manuscript J.S. aided on the experiments and on the proofreading of the manuscript. J.H., T.W., F.D.T. contributed to the concept and proofreading of the manuscript. J.F. and M.T.V. designed the original concept, aided to the writing and proofreading of the manuscript.

Corresponding author

Correspondence to Maria Torres Vega.

Ethics declarations

Competing Interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ravuri, H.K., Struye, J., van der Hooft, J. et al. Context-Aware and Reliable Transport Layer Framework for Interactive Immersive Media Delivery Over Millimeter Wave. J Netw Syst Manage 32, 78 (2024). https://doi.org/10.1007/s10922-024-09845-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10922-024-09845-5

Keywords

Search

Navigation