article

Protected interactive 3D graphics via remote rendering

Authors:

Michael Turitzin,

Giuseppe Croccia,

Roberto ScopignoAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 23, Issue 3

Pages 695 - 703

https://doi.org/10.1145/1015706.1015782

Published: 01 August 2004 Publication History

Abstract

Valuable 3D graphical models, such as high-resolution digital scans of cultural heritage objects, may require protection to prevent piracy or misuse, while still allowing for interactive display and manipulation by a widespread audience. We have investigated techniques for protecting 3D graphics content, and we have developed a remote rendering system suitable for sharing archives of 3D models while protecting the 3D geometry from unauthorized extraction. The system consists of a 3D viewer client that includes low-resolution versions of the 3D models, and a rendering server that renders and returns images of high-resolution models according to client requests. The server implements a number of defenses to guard against 3D reconstruction attacks, such as monitoring and limiting request streams, and slightly perturbing and distorting the rendered images. We consider several possible types of reconstruction attacks on such a rendering server, and we examine how these attacks can be defended against without excessively compromising the interactive experience for non-malicious users.

References

[1]

COLLBERG, C., AND THOMBORSON, C. 2000. Watermarking, tamper-proofing, and obfuscation: Tools for software protection. Tech. Rep. 170, Dept. of Computer Science, The University of Auckland.

[2]

DEBEVEC, P., TAYLOR, C., AND MALIK, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In Proc. of ACM SIGGRAPH 96, 11--20.

Digital Library

[3]

ENGEL, K., HASTREITER, P., TOMANDL, B., EBERHARDT, K., AND ERTL, T. 2000. Combining local and remote visualization techniques for interactive volume rendering in medical applications. In Proc. of IEEE Visualization 2000, 449--452.

Digital Library

[4]

GORTLER, S., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In Proc. of ACM SIGGRAPH 96, 43--54.

Digital Library

[5]

LAURENTINI, A. 1994. The visual hull concept for silhouette-based image understanding. IEEE Trans. on Pattern Analysis and Machine Intelligence 16, 2, 150--162.

Digital Library

[6]

LENSCH, H. P., HEIDRICH, W., AND SEIDEL, H.-P. 2001. A silhouette-based algorithm for texture registration and stitching. Graphical Models 63, 245--262.

Digital Library

[7]

LEVOY, M., AND HANRAHAN, P. 1996. Light field rendering. In Proc. of ACM SIGGRAPH 96, 31--42.

Digital Library

[8]

LEVOY, M., PULLI, K., CURLESS, B., RUSINKIEWICZ, S., KOLLER, D., PEREIRA, L., GINZTON, M., ANDERSON, S., DAVIS, J., GINSBERG, J., SHADE, J., AND FULK, D. 2000. The digital michelangelo project. In Proc. of ACM SIGGRAPH 2000, 131--144.

Digital Library

[9]

LEVOY, M. 1995. Polygon-assisted jpeg and mpeg compression of synthetic images. In Proc. of ACM SIGGRAPH 95, 21--28.

Digital Library

[10]

NIEM, W. 1997. Error analysis for silhouette-based 3D shape estimation from multiple views. In International Workshop on Synthetic-Natural Hybrid Coding and 3D Imaging.

[11]

OHBUCHI, R., MUKAIYAMA, A., AND TAKAHASHI, S. 2002. A frequency-domain approach to watermarking 3D shapes. Computer Graphics Forum 21, 3.

[12]

PRAUN, E., HOPPE, H., AND FINKELSTEIN, A. 1999. Robust mesh watermarking. In Proc. of ACM SIGGRAPH 99, 49--56.

Digital Library

[13]

RESSLER, S., 2001. Web3D security discussion. Online article: http://web3d.about.com/library/weekly/aa013101a.htm.

[14]

RUSINKIEWICZ, S., AND LEVOY, M. 2000. QSplat: A multiresolution point rendering system for large meshes. In Proc. of ACM SIGGRAPH 2000, 343--352.

Digital Library

[15]

SCHARSTEIN, D., AND SZELISKI, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1-3, 7--42.

Digital Library

[16]

SCHNEIER, B. 2000. The fallacy of trusted client software. Information Security(August).

[17]

SIMONS, D., AND LEVIN, D. 1997. Change blindness. Trends in Cognitive Sciences 1, 7, 261--267.

[18]

SLABAUGH, G., CULBERTSON, B., MALZBENDER, T., AND SCHAFER, R. 2001. A survey of methods for volumetric scene reconstruction from photographs. In Proc. of the Joint IEEE TCVG and Eurographics Workshop (VolumeGraphics-01), Springer-Verlag, 81--100.

Digital Library

[19]

STANFORD DIGITAL FORMA URBIS PROJECT. 2004. http://formaurbis.stanford.edu.

[20]

TARINI, M., CALLIERI, M., MONTANI, C., ROCCHINI, C., OLSSON, K., AND PERSSON, T. 2002. Marching intersections: An efficient approach to shape-from-silhouette. In Proceedings of the Conference on Vision, Modeling, and Visualization (VMV 2002), 255--262.

[21]

YOON, I., AND NEUMANN, U. 2000. Web-based remote rendering with IBRAC. Computer Graphics Forum 19, 3.

[22]

ZHANG, R., TSAI, P.-S., CRYER, J. E., AND SHAH, M. 1999. Shape from shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8, 690--706.

Digital Library

Cited By

Furferi RDi Angelo LBertini MMazzanti PDe Vecchis KBiffi M(2024)Enhancing traditional museum fruition: current state and emerging tendenciesHeritage Science10.1186/s40494-024-01139-y12:1Online publication date: 18-Jan-2024
https://doi.org/10.1186/s40494-024-01139-y
Kaddoura SAl Husseiny F(2023)The rising trend of Metaverse in education: challenges, opportunities, and ethical considerationsPeerJ Computer Science10.7717/peerj-cs.12529(e1252)Online publication date: 13-Feb-2023
https://doi.org/10.7717/peerj-cs.1252
Zuo CWang CLin ZCalandrino JTroncoso C(2023)A peek into the metaverseProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620457(3925-3942)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620457
Show More Cited By

Index Terms

Protected interactive 3D graphics via remote rendering
1. Computer systems organization
  1. Architectures
    1. Other architectures
      1. Special purpose systems
2. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Real-time remote rendering of 3D video for mobile devices
MM '09: Proceedings of the 17th ACM international conference on Multimedia

At the convergence of computer vision, graphics, and multimedia, the emerging 3D video technology promises immersive experiences in a truly seamless environment. However, the requirements of huge network bandwidth and computing resources make it still a ...
A real-time remote rendering system for interactive mobile graphics
Special section of best papers of ACM multimedia 2011, and special section on 3D mobile multimedia

Mobile devices are gradually changing people's computing behaviors. However, due to the limitations of physical size and power consumption, they are not capable of delivering a 3D graphics rendering experience comparable to desktops. Many applications ...
Protected interactive 3D graphics via remote rendering
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

Valuable 3D graphical models, such as high-resolution digital scans of cultural heritage objects, may require protection to prevent piracy or misuse, while still allowing for interactive display and manipulation by a widespread audience. We have ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 23, Issue 3

August 2004

684 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1015706

Editor:
John C. Hart

Issue’s Table of Contents

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

73
Total Citations
View Citations
1,620
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)10

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Furferi RDi Angelo LBertini MMazzanti PDe Vecchis KBiffi M(2024)Enhancing traditional museum fruition: current state and emerging tendenciesHeritage Science10.1186/s40494-024-01139-y12:1Online publication date: 18-Jan-2024
https://doi.org/10.1186/s40494-024-01139-y
Kaddoura SAl Husseiny F(2023)The rising trend of Metaverse in education: challenges, opportunities, and ethical considerationsPeerJ Computer Science10.7717/peerj-cs.12529(e1252)Online publication date: 13-Feb-2023
https://doi.org/10.7717/peerj-cs.1252
Zuo CWang CLin ZCalandrino JTroncoso C(2023)A peek into the metaverseProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620457(3925-3942)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620457
Ren HZhang HZheng JZheng JTang RHuo YBao HWang R(2023)MINERVAS: Massive INterior EnviRonments VirtuAl SynthesisComputer Graphics Forum10.1111/cgf.1465741:7(63-74)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14657
Yu GLiu CFang TJia JLin EHe YFu SWang LWei LHuang Q(2023)A survey of real-time rendering on Web3D applicationVirtual Reality & Intelligent Hardware10.1016/j.vrih.2022.04.0025:5(379-394)Online publication date: Oct-2023
https://doi.org/10.1016/j.vrih.2022.04.002
Liu CSong HFang TOu QYu GYou TYing M(2022)Web-Cloud Collaborative Mobile Online 3D Rendering SystemSecurity and Communication Networks10.1155/2022/47489462022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/4748946
Cheng RWu NChen SHan B(2022)Will Metaverse Be NextG Internet? Vision, Hype, and RealityIEEE Network10.1109/MNET.117.220005536:5(197-204)Online publication date: Sep-2022
https://doi.org/10.1109/MNET.117.2200055
Mugnai FCosentino AMazzanti PTucci G(2021)Vibration Analyses of a Gantry Structure by Mobile Phone Digital Image Correlation and Interferometric RadarGeomatics10.3390/geomatics20100022:1(17-35)Online publication date: 27-Dec-2021
https://doi.org/10.3390/geomatics2010002
Friess FBraun MBruder VFrey SReina GErtl T(2021)Foveated Encoding for Large High-Resolution DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.303044527:2(1850-1859)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3030445
Friers FBecher MReina GErtl T(2021)Amortised Encoding for Large High-Resolution Displays2021 IEEE 11th Symposium on Large Data Analysis and Visualization (LDAV)10.1109/LDAV53230.2021.00013(53-62)Online publication date: Oct-2021
https://doi.org/10.1109/LDAV53230.2021.00013
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents