research-article

360-Degree VR Video Watermarking Based on Spherical Wavelet Transform

Authors:

Antonios Argyriou,

Zhen XuAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 17, Issue 1

Article No.: 38, Pages 1 - 23

https://doi.org/10.1145/3425605

Published: 16 April 2021 Publication History

Abstract

Similar to conventional video, the increasingly popular 360

virtual reality (VR) video requires copyright protection mechanisms. The classic approach for copyright protection is the introduction of a digital watermark into the video sequence. Due to the nature of spherical panorama, traditional watermarking schemes that are dedicated to planar media cannot work efficiently for 360

VR video. In this article, we propose a spherical wavelet watermarking scheme to accommodate 360

VR video. With our scheme, the watermark is first embedded into the spherical wavelet transform domain of the 360

VR video. The spherical geometry of the 360

VR video is used as the host space for the watermark so that the proposed watermarking scheme is compatible with the multiple projection formats of 360

VR video. Second, the just noticeable difference model, suitable for head-mounted displays (HMDs), is used to control the imperceptibility of the watermark on the viewport. Third, besides detecting the watermark from the spherical projection, the proposed watermarking scheme also supports detecting watermarks robustly from the viewport projection. The watermark in the spherical domain can protect not only the 360

VR video but also its corresponding viewports. The experimental results show that the embedded watermarks are reliably extracted both from the spherical and the viewport projections of the 360

VR video, and the robustness of the proposed scheme to various copyright attacks is significantly better than that of the competing planar-domain approaches when detecting the watermark from viewport projection.

References

[1]

MPEG Experts. 2016. Summary of survey on virtual reality. ISO/IECJTC 1/SC 29/WG 11, m16542.

[2]

Huawei-iLab. 2018. Cloud VR Network Solution White Paper. Retrieved from http://www.huawei.com/.

[3]

L. E. Beausoleil. 2017. Copyright Issues and Implications of Emerging Virtual Reality Technologies. Boston College Intellectual Property and Technology Forum. Retrieved from http:// http://bciptf.org/.

[4]

N. P. Sheppard, R. Safavi-Naini, and P. Ogunbona. 2002. Digital watermarks for copyright protection. Journal of Law and Information Science 12, 1 (2002), 110–130.

[5]

I. J. Cox, M. L. Miller, J. A. Bloom, J. Fridrich, and T. Kalker. 2008. Digital Watermarking and Steganography. Morgan Kaufmann Publisher.

[6]

K. Liu, Y. Liu, J. Liu, A. Argyriou, and X. Yang. 2017. Joint source encoding and networking optimization for panoramic streaming over LTE-A downlink. In Proc. IEEE Global Communications Conference (GLOBECOM'17). 1--7.

[7]

Y. Liu, J. Liu, A. Argyriou, and S. Ci. 2019. MEC-assisted panoramic VR video streaming over millimeter wave mobile networks. IEEE Transactions on Multimedia 21, 5 (2019), 1302–1316.

Digital Library

[8]

Y. He, B. Vishwanath, X. Xiu, and Y. Ye. 2016. AHG8: InterDigitals projection format conversion tool. Joint Video Exploration Team of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JVET, D0021.

[9]

P. Schröder and W. Sweldens. 1995. Spherical wavelets: Efficiently representing functions on the sphere. In Proc. SIGGRAPH. 161-172.

[10]

F. Simons, I. Loris, G. Nolet, I. C. Daubechies, S. Voronin, et al. 2011. Solving or resolving global tomographic models with spherical wavelets, and the scale and sparsity of seismic heterogeneity. Geophysical Journal International 187 (2011), 969–988.

[11]

Z. Wang, C. Leung, Y. Zhu, and T. Wong. 2004. Data compression with spherical wavelets and wavelets for the image-based relighting. Computer Vision and Image Understanding 96, 3 (2004), 327–344.

Digital Library

[12]

J. D. McEwen, P. Vandergheynst, and Y. Wiaux. 2013. On the computation of directional scale-discretized wavelet transforms on the sphere. In Proc. SPIE Wavelets and Sparsity XV. 8858.

[13]

P. W. Wong and N. Memon. 2001. Secret and public key image watermarking schemes for image authentication and ownership verification. IEEE Transactions on Image Processing 10, 10 (2001), 1593–1601.

Digital Library

[14]

J. S. Tsai, W. B. Huang, and Y. H. Kuo. 2011. On the selection of optimal feature region set for robust digital image watermarking. IEEE Transactions on Image Processing 20, 3 (2011), 735–743.

Digital Library

[15]

I. J. Cox, J. Kilian, F. T. Leighton, and T. Shamoon. 1997. Secure spread spectrum watermarking for multimedia. IEEE Transactions on Image Processing 6, 12 (1997), 1673–1687.

Digital Library

[16]

M. Amini, M. Ahmad, and M. Swamy. 2018. A robust multibit multiplicative watermark decoder using vector-based hidden Markov model in wavelet domain. IEEE Transactions on Circuits and Systems for Video Technology 28, 2 (2018), 402–413.

[17]

Y.-S. Lee, Y.-H. Seo, and D.-W. Kim. 2019. Blind image watermarking based on adaptive data spreading in n-level DWT subbands. Security and Communication Networks 2019, Article 8357251 (2019), 1–11.

[18]

D. Xu, R. Wang, and Y. Q. Shi. 2014. Data hiding in encrypted H.264/AVC video streams by codeword substitution. IEEE Transactions on Information Forensics and Security 9, 4 (2014), 596–606.

Digital Library

[19]

T. Dutta and H. P. Gupta. 2016. A robust watermarking framework for high efficiency video coding (HEVC) encoded video with blind extraction process. Journal of Visual Communication and Image Representation 38 (2016), 29–44.

Digital Library

[20]

G. Hua, J. Goh, and V. L. L. Thing. 2015. Time-spread echo-based audio watermarking with optimized imperceptibility and robustness. IEEE/ACM Transactions on Audio, Speech, and Language Processing 23, 2 (2015), 227–239.

Digital Library

[21]

C. H. Chou and K. C. Liu. 2010. A perceptually tuned watermarking scheme for color images. IEEE Transactions on Image Processing 19, 11 (2010), 2966–2982.

Digital Library

[22]

M. Urvoy, D. Goudia, and F. Autrusseau. 2014. Perceptual DFT watermarking with improved detection and robustness to geometrical distortions. IEEE Transactions on Information Forensics and Security 9, 7 (2014), 1108–1119.

Digital Library

[23]

E. Halici and A. A. Alatan. 2009. Watermarking for depth-image-based rendering. In Proc. IEEE Int. Conf. Image Process. (ICIP'09). 4217–4220.

[24]

Y. Lin and J. Wu. 2011. A digital blind watermarking for depth-image-based rendering 3D images. IEEE Transactions on Broadcasting 57, 2 (2011), 602–611.

[25]

H. D. Kim, J. W. Lee, T. W. Oh, and H. K. Lee. 2012. Robust DT-CWT watermarking for DIBR 3D images. IEEE Transactions on Broadcasting 58, 4 (2012), 533–543.

[26]

A. Koz, C. Cigla, and A. A. Alatan. 2010. Watermarking of free-view video. IEEE Transactions on Image Processing 19, 7 (2010), 1785–1797.

Digital Library

[27]

Y. Miura, X. Li, S. Kang, and Y. Sakamoto. 2018. Data hiding technique for omnidirectional JPEG images displayed on VR spaces. In Proc. International Workshop on Advanced Image Technology. 1–4.

[28]

J. Kang, S. Ji, and H. Lee. 2019. Spherical panorama image watermarking using viewpoint detection. In Proc. Digital Forensics and Watermarking. Cham: Springer International Publishing, 95–109.

[29]

J. D. McEwen, M. P. Hobson, D. J. Mortlock, and A. N. Lasenby. 2007. Fast directional continuous spherical wavelet transform algorithms. IEEE Transactions on Signal Processing 55, 2 (2007), 520–529.

[30]

E. Eade. 2017. Lie groups for 2D and 3D transformations. Retrieved from http://www.ethaneade.com/lie.pdf.

[31]

J. D. McEwen, C. Durastanti, and Y. Wiaux. 2018. Localisation of directional scale-discretised wavelets on the sphere. Applied and Computational Harmonic Analysis 44 (2018), 59–88.

[32]

S. Mallat. 1996. Wavelets for vision. Proceedings of the IEEE 84 (1996), 604–614.

[33]

A. B. Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor. 1997. Visibility of wavelet quantization noise. IEEE Transactions on Image Processing 6, 8 (1997), 1164–1175.

Digital Library

[34]

A. P. Bradley. 1999. A wavelet visible difference predictor. IEEE Transactions on Image Processing 5, 8 (1999), 717–730.

Digital Library

[35]

L. Sorgi and K. Daniilidis. 2004. Normalized cross-correlation for spherical images. In Proc. European Conference on Computer Vision (ECCV ’04).

[36]

M. L. Miller and J. A. Bloom. 1999. Computing the probability of false watermark detection. In Proc. 3rd Int. Workshop Inf. Hiding, 146–158.

[37]

J. Cruz-Mota, I. Bogdanova, B. Paquier, M. Bierlaire, and J.-P. Thiran. 2012. Scale invariant feature transform on the sphere: Theory and applications. International Journal of Computer Vision 98 (2012), 217–241.

Digital Library

[38]

E. Alshina, J. Boyce, A. Abbas, and Y. Ye. 2017. JVET common test conditions and evaluation procedures for 360

video. JVET, H1030.

[39]

A. Singla, W. Robitza, and A. Raake. 2018. Comparison of subjective quality evaluation methods for omnidirectional videos with DSIS and modified ACR. In Proc. Human Vision and Electronic Imaging (HVEI’18).

[40]

ITU-R Recommendation BT.500-13. 2012. Methodology for the subjective assessment of the quality of television pictures. Geneva, Switzerland: International Telecommunication Union.

[41]

High Efficiency Video Coding (HEVC). Jan. 2013. Rec. ITU-T H.265 and ISO/IEC 23008-2.

[42]

C. Burini, S. Baudry, and G. Doërr. 2014. Blind detection for disparity-coherent stereo video watermarking. In Proc. SPIE 9028, Media Watermarking, Security, and Forensics. 90280B.

[43]

E. Garcia and J. Dugelay. 2003. Texture-based watermarking of 3D video objects. IEEE Transactions on Circuits and Systems for Video Technology 13 (2003), 853–866.

Digital Library

[44]

S. Baldoni, M. Brizzi, M. Carli, and A. Neri. 2019. A watermarking model for omni-directional digital images. In 11th International Symposium on Image and Signal Processing and Analysis (ISPA’19). 240–245.

[45]

J. Jin, M. Dai, H. Bao, and Q. Peng. 2004. Watermarking on 3D mesh based on spherical wavelet transform. Journal of Zhejiang University-SCIENCE A 5, 3 (2004), 251–258.

[46]

S. Voloshynovskiy, S. Pereira, A. Herrigel, N. Baumgartner, and T. Pun. 2000. Generalized watermarking attack based on watermark estimation and perceptual remodulation. In Proc. SPIE, vol. 3971. The International Society for Optical Engineering, 358–370.

[47]

G. Doërr and J. Dugelay. 2004. Security pitfalls of frame-by-frame approaches to video watermarking. IEEE Transactions on Signal Processing 52, 10 (2004), 2955–2964.

Digital Library

[48]

J. Kang, J. Hou, S. Ji, and H. Lee. 2020. Robust spherical panorama image watermarking against viewpoint desynchronization. IEEE Access 8 (2020), 127477–127490.

Cited By

Liu WCai JLi QLiao CCao JHe SYu Y(2024)Learning Nighttime Semantic Segmentation the Hard WayACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365003220:7(1-23)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1145/3650032
Zhao H(2024)Smart preschool education live streaming: VR-driven optimization strategyWireless Networks10.1007/s11276-022-03041-630:5(4379-4387)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11276-022-03041-6
Xie WWang STian SHuang LLiu YWang MWilliams BChen YNeville J(2023)Just noticeable visual redundancy forecastingProceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v37i3.25399(2965-2973)Online publication date: 7-Feb-2023
https://dl.acm.org/doi/10.1609/aaai.v37i3.25399
Show More Cited By

Index Terms

360-Degree VR Video Watermarking Based on Spherical Wavelet Transform
1. Security and privacy
  1. Security services
    1. Digital rights management

Recommendations

Content-adaptive reversible visible watermarking in encrypted images
Highlights
- Data embedding positions for accommodating the watermark can be adaptively selected to achieve the tradeoff between watermark visibility and marked image ...
Abstract
The reversible visible watermark which serves as the perceptual ownership identifier can be extracted to losslessly recover the original cover media. This paper presents a novel content-adaptive reversible visible watermarking scheme ...
A watermarking-based image ownership and tampering authentication scheme

Nowadays, image authentication schemes are widely applied to ownership protection and tampering detection of digital images. In this paper, we propose an image ownership and tampering authentication scheme based on watermarking techniques, which is ...
Visible watermarking with reversibility of multimedia images for ownership declarations

Digital watermarking technology is primarily the joining of the rightful owner of the protected media. Once the media are suspected to be illegally used, an open algorithm can be used to extract the digital watermark for the purpose of showing the media'...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 17, Issue 1

February 2021

392 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/3453992

Editor:
Alberto Del Bimbo
University of Firenze, Italy

Issue’s Table of Contents

Copyright © 2021 Association for Computing Machinery.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2021

Accepted: 01 September 2020

Revised: 01 August 2020

Received: 01 March 2020

Published in TOMM Volume 17, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

National Natural Science Foundation of China
Ningbo Natural Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
209
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu WCai JLi QLiao CCao JHe SYu Y(2024)Learning Nighttime Semantic Segmentation the Hard WayACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365003220:7(1-23)Online publication date: 4-Mar-2024
https://dl.acm.org/doi/10.1145/3650032
Zhao H(2024)Smart preschool education live streaming: VR-driven optimization strategyWireless Networks10.1007/s11276-022-03041-630:5(4379-4387)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1007/s11276-022-03041-6
Xie WWang STian SHuang LLiu YWang MWilliams BChen YNeville J(2023)Just noticeable visual redundancy forecastingProceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v37i3.25399(2965-2973)Online publication date: 7-Feb-2023
https://dl.acm.org/doi/10.1609/aaai.v37i3.25399
Zhang XGao WLi GJiang QCong R(2023)Image Quality Assessment–driven Reinforcement Learning for Mixed Distorted Image RestorationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/353262519:1s(1-23)Online publication date: 3-Feb-2023
https://dl.acm.org/doi/10.1145/3532625
Zhang XSu QSun YChen S(2023)A robust and high-efficiency blind watermarking method for color images in the spatial domainMultimedia Tools and Applications10.1007/s11042-023-14479-x82:18(27217-27243)Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1007/s11042-023-14479-x

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents