short-paper

MV-HEVC: How to optimize compression of immersive 3D content

Authors:

Thomas Guionnet,

Khaled Jerbi,

Thomas Burnichon,

Mickaäl RauletAuthors Info & Claims

MHV '24: Proceedings of the 3rd Mile-High Video Conference

Page 87

https://doi.org/10.1145/3638036.3640246

Published: 14 March 2024 Publication History

Get Access

Abstract

Multiview High Efficiency Video Coding (MV-HEVC) is an HEVC extension focused on efficiently coding spatially related images, such as a left eye and right eye views of 3D stereoscopic content. MV-HEVC was released in the second version of HEVC back in October 2014 [2]. MV-HEVC was created alongside another extension named SHVC, which is already used in ATSC 3.0 use cases since 2018 [1]. The two extensions share many fundamentals, codified in an annex for common specifications for multi-layer extensions. Their base principle is scalability: A traditional HEVC decoder can rely on the base layer only, hence providing backward compatibility, but a more elaborate decoder can use the second layer as well to improve the rendition.

The MV-HEVC format recently gained widespread attention with Apple announcing support for 3D movies on the Apple Vision Pro at WWDC23 [9][8]. Apple provided public guidelines on stereo video encoding [3], packaging [5], and streaming [4] as well as on providing parallax information to improve caption placement [6]. Apple also organized Apple Vision Pro developer labs [7].

This presentation will describe the MV-HEVC standard and how it works in theory. An implementation of MV-HEVC [10] will also be studied to assess performance in practice in industrial settings. Deployment aspects such as packaging and captioning will be discussed. Finally, 3D-specific optimization strategies will be analyzed, including software architecture and rate control.

References

[1]

2018. Convergence TV Project Demonstrates World First SHVC at NAB 2018. (2018). https://www.ateme.com/press/the-convergence-tv-project-demonstrates-world-first-shvc-based-hd-uhd-hybrid-delivery-at-nab-2018/

Google Scholar

[2]

2021. Recommendation ITU-T H.265 | International Standard ISO/IEC 23008-2. (2021). http://handle.itu.int/11.1002/1000/12296|https://www.iso.org/standard/67660.html

Google Scholar

[3]

2023. Apple HEVC Stereo Video Profile. (2023). https://developer.apple.com/av-foundation/HEVC-Stereo-Video-Profile.pdf

Google Scholar

[4]

2023. Apple HLS authoring specifications for Apple devices, Stereo Video. (2023). https://developer.apple.com/documentation/http-live-streaming/hls-authoring-specification-for-apple-devices#Stereo-Video

Google Scholar

[5]

2023. Apple Stereo Video ISOBMFF Extensions. (2023). https://developer.apple.com/av-foundation/Stereo-Video-ISOBMFF-Extensions pdf

Google Scholar

[6]

2023. Apple Video Contour Map Metadata. (2023). https://developer.apple.com/av-foundation/Video-Contour-Map-Metadata.pdf

Google Scholar

[7]

2023. Apple Vision Pro developer labs. (2023). https://developer.apple.com/visionos/labs/

Google Scholar

[8]

2023. Apple WWDC23, Deliver video content for spatial experiences. (2023). https://developer.apple.com/videos/play/wwdc2023/10071/?time=405

Google Scholar

[9]

2023. Apple WWDC23, Keynote. (2023). https://developer.apple.com/videos/play/wwdc2023/101/?time=5886

Google Scholar

[10]

2023. Ateme announces MV-HEVC support at IBC 2023. (2023). https://www.ateme.com/press/ateme-introduces-its-next-generation-video-compression/

Google Scholar

Cited By

View all

Wang SLiu MDasari MKoutsonikolas DGanesan DLane NShi W(2024)A First Look at Apple’s Stereoscopic Video and its Potential in Live Video Streaming for XR HeadsetsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3697437(1617-1619)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3697437

Index Terms

MV-HEVC: How to optimize compression of immersive 3D content
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Image compression

Recommendations

Mixed-resolution HEVC based multiview video codec for low bitrate transmission

There has been increasing demand for multiview video transmission over band limited channel over past years and various techniques have been proposed to fulfil this need. In this paper, a High Efficiency Video Codec (HEVC) based spatial resolution ...
AVC to HEVC transcoder based on quadtree limitation

Following the finalization of the state-of-the-art High Efficiency Video Coding (HEVC) standard in January 2013, several new services are being deployed in order to take advantage of the superior coding efficiency (estimated at 50 % less bitrate for the ...
Cross residual transform for lossless intra-coding for HEVC

A new lossless intra-coding method based on a cross residual transform is applied to the next generation video coding standard HEVC (High Efficiency Video Coding). HEVC includes a multi-directional spatial prediction method to reduce spatial redundancy ...

Comments

Information & Contributors

Information

Published In

MHV '24: Proceedings of the 3rd Mile-High Video Conference

February 2024

150 pages

ISBN:9798400704932

DOI:10.1145/3638036

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

MHV '24

Sponsor:

SIGMM

MHV '24: Mile-High Video Conference

February 11 - 14, 2024

CO, Denver, USA

Upcoming Conference

MHV '25

Sponsor:
sigmm

Mile-High Video Conference

February 18 - 20, 2025

Denver , CO , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
91
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wang SLiu MDasari MKoutsonikolas DGanesan DLane NShi W(2024)A First Look at Apple’s Stereoscopic Video and its Potential in Live Video Streaming for XR HeadsetsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3697437(1617-1619)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3697437

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Mixed-resolution HEVC based multiview video codec for low bitrate transmission

AVC to HEVC transcoder based on quadtree limitation

Cross residual transform for lossless intra-coding for HEVC

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Mixed-resolution HEVC based multiview video codec for low bitrate transmission

AVC to HEVC transcoder based on quadtree limitation

Cross residual transform for lossless intra-coding for HEVC

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations