article

Middleware for streaming 3D progressive meshes over lossy networks

Authors:

B. PrabhakaranAuthors Info & Claims

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 2, Issue 4

Pages 282 - 317

https://doi.org/10.1145/1201730.1201733

Published: 01 November 2006 Publication History

Abstract

Streaming 3D graphics have been widely used in multimedia applications such as online gaming and virtual reality. However, a gap exists between the zero-loss-tolerance of the existing compression schemes and the lossy network transmissions. In this article, we propose a generic 3D middleware between the 3D application layer and the transport layer for the transmission of triangle-based progressively compressed 3D models. Significant features of the proposed middleware include. 1) handling 3D compressed data streams from multiple progressive compression techniques. 2) considering end user hardware capabilities for effectively saving the data size for network delivery. 3) a minimum cost dynamic reliable set selector to choose the transport protocol for each sublayer based on the real-time network traffic. Extensive simulations with TCP/UDP and SCTP show that the proposed 3D middleware can achieve the dual objectives of maintaining low transmission delay and small distortion, and thus supporting high quality 3D streaming with high flexibility.

References

[1]

Al-Regib, G. and Altunbasak, Y. 2002. An unequal error protection method for packet loss resilient 3D mesh transmission. In Proceeding of INFOCOM.

[2]

Al-Regib, G. and Altunbasak, Y. 2003. 3TP: An application-layer protocol for streaming 3D graphics. In Proceedings of the IEEE International Conference on Multimedia and Expo.

Digital Library

[3]

Al-Regib, G. and Altunbasak, Y. 2004. 3D models transport protocol. In Proceedings of the 9th International Conference on 3D Web Technology.

Digital Library

[4]

Al-Regib, G., Altunbasak, Y., and Rossignac, J. 2002. A joint source and channel coding approach for progressively compressed 3D mesh transmission. In Proceedings of the International Conference on Image Processing.

[5]

Al-Regib, G., Altunbasak, Y., and Rossignac, J. 2005. Error-resilient transmission of 3D models. ACM Trans. Graph. 24, 182--208.

Digital Library

[6]

Alexa, M., Behr, J., Cohen-Or, D., Fleishman, S., Silva, C., and Levin, D. 2003. Computing and rendering point set surfaces. IEEE Trans. Visual. Comput. Graph. 9, 3--15.

Digital Library

[7]

Alliez, P. and Desbrun, M. 2001. Progressive compression for lossless transmission of triangle meshes. In Proceedings of SIGGRAPH.

Digital Library

[8]

Bischoff, S. and Kobbelt, L. 2002. Towards robust broadcasting of geometric data. Comput. Graph. 26, 665--675.

[9]

Chen, Z., Bodenheimer, B., and Barnes, J. 2003. Robust transmission of 3D geometry over lossy networks. In Proceeding of the 8th International Conference on 3D Web Technology. 161--172.

Digital Library

[10]

Choi, J., Kim, Y., Lee, H., Park, I., Lee, M., and Ahn, C. 2000. Geometry compression of 3D mesh models using predictive two-stage quantization. IEEE Trans. Circuits Syst. Video Technol. 10, 312--322.

Digital Library

[11]

Chow, M. 1997. Optimized geometry compression for real-time rendering. In Proceedings of IEEE Visualization. 346--354.

Digital Library

[12]

Deering, M. 1995. Geometry compression. In Proceedings of SIGGRAPH. 13--20.

Digital Library

[13]

Devillers, O. and Gandoin, P. 2000. Geometric compression for interactive transmission. In Proceedings of IEEE Visualization. 319--326.

Digital Library

[14]

Fleishman, S., Cohen-Or, D., Alexa, M., and Silva, C. 2003. Progressive point set surfaces. ACM Trans. Graph. 22, 997--1011.

Digital Library

[15]

Gandoin, P. and Devillers, O. 2002. Progressive lossless compression of arbitrary simplicical complexes. ACM Trans. Graph.

Digital Library

[16]

Garland, M. and Heckbert, P. 1997. Surface simplification using quadric error metrics. In Proceedings of SIGGRAPH. 209--216.

Digital Library

[17]

Hoppe, H. 1996. Progressive meshes. In Proceedings of SIGGRAPH. 99--108.

Digital Library

[18]

Hoppe, H. 1998. Efficient implementation of progressive meshes. Tech. rep., MSR-TR-98-02 (Jan.) Microsoft.

[19]

http://www.armandocaro.net/software/ns2sctp. PR-SCTP implementation.

[20]

Isenburg, M. and Gumhold, S. 2003. Out-of-core compression for gigantic polygon meshes. In Proceedings of SIGGGRAPH. 935--942.

Digital Library

[21]

Isenburg, M. and Snoeylink, J. 2002. Coding polygon meshes as compressable ASCII. Web3D.

Digital Library

[22]

Khodakovsky, A. and Guskov, I. 2000. Normal meshes. In Proceedings of SIGGRAPH.

Digital Library

[23]

Khodakovsky, A., Schroder, P., and Sweldens, W. 2000. Progressive geometry compression. In Proceedings of the SIGGRAPH.

Digital Library

[24]

Li, H., Shah, P., and Prabhakaran, B. 2004. Smart decision module for streaming 3D meshes over lossy networks. In Proceedings of DMS/VLC'04. 275--278.

[25]

Li, J. and Kuo, C. 1997. Progressive coding of 3-D graphics models. In Multimedia Computing and Systems.

Digital Library

[26]

Lipman, R. 2002. Mobile 3D visualization for construction. In Proceedings of the International Symposium on Automation and Robotics in Construction. 53--48.

[27]

Martin, I. 2002. Hybrid transcoding for adaptive transmission of 3D content. In Proceedings of the IEEE International Conference on Multimedia and Expo.

[28]

Mascolo, S., Casetti, C., Gerla, M., Lee, S., and Sanadidi, M. 2000. Tcp westwood: Congestion control with faster recovery. Tech. rep., UCLA CS 200017, University of California Los Angeles (UCLA).

[29]

Pajarola, R. and Rossignac, J. 2000. Compressed progressive meshes. IEEE Trans. Visual. Comput. Graph. 6, 79--93.

Digital Library

[30]

Portel, M. 2003. Pervasive 3D viewing for product data management. IEEE Comput. Graph. Appl. 23, 14--19.

Digital Library

[31]

Rossignac, J. 1999. Edgebreaker: Connectivity compression for triangle meshes. IEEE Trans. Visual. Comput. Graph. 47--61.

Digital Library

[32]

Rossignac, J. 2004. Handbook of Discrete and Computational Geometry. CRC Press (Chapter 54).

[33]

Southern, R., Perkins, S., Steyn, B., Muller, A., Marais, P., and Blake, E. 2001. A stateless client for progressive view-dependent transmission. In Proceedings of the Web3D Symposium.

Digital Library

[34]

Taubin, G., Gueziec, A., Horn, W., and Lazarus, F. 1998. Progressive forest split compression. In Proceedings of SIGGRAPH. 123--132.

Digital Library

[35]

Taubin, G. and Rossignac, J. 1998. Geometric compression through topological surgery. ACM Trans. Graph. 96, 84--115.

Digital Library

[36]

Valette, S. and Prost, R. 2004. A wavelet-based progressive compression scheme for triangle meshes: wavemesh. IEEE Trans. Visual. Comput. Graph. 10.

Digital Library

[37]

Yan, Z., Kumar, S., and Kuo, C. 2001. Error resilient coding of 3D graphic models via adaptive mesh segmentation. IEEE Trans. Circuits Syst. Video Technol. 11.

Digital Library

[38]

Yan, Z., Kumar, S., Li, J., and Kuo, C. 1999. Robust encoding of 3D mesh using data partitioning. In Proceedings of the 1999 IEEE International Symposium on Circuits and Systems. Vol. 4. 495--498.

[39]

Yang, S., Kim, C., and Kuo, C. 2004. A progressive view-dependent technique for interactive 3D mesh transmission. IEEE Trans. Circuits Syst. Video. Technol. 14, 1249--1264.

Digital Library

Cited By

Soltani Mohammadi IGhanbari MHashemi M(2022)GAMORRAComputers and Graphics10.1016/j.cag.2022.05.007106:C(9-19)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.05.007
Liu YGuo JDeng KLiu Y(2019)A Three-Stage Progressive Transmission Scheme for Virtual Environments Over Lossy NetworksIEEE Access10.1109/ACCESS.2019.29600537(184411-184422)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2960053
Moreno CLi M(2018)A Progressive Transmission Technique for the Streaming of Point Cloud Data Using the Kinect2018 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICCNC.2018.8390310(593-598)Online publication date: Mar-2018
https://doi.org/10.1109/ICCNC.2018.8390310
Show More Cited By

Index Terms

Middleware for streaming 3D progressive meshes over lossy networks

Recommendations

Receiver-based loss tolerance method for 3D progressive streaming

While progressive compression techniques were proposed long time ago, fast and efficient streaming of detailed 3D models over lossy networks still remains a challenge. A primary reason is that packet loss occurring in unreliable networks is highly ...
Rate-Distortion Optimized Progressive Geometry Compression
CGIV '06: Proceedings of the International Conference on Computer Graphics, Imaging and Visualisation

During progressive transmission of 3D geometry models, the transmission order of details at different region has great effects on the quality of reconstructed models at low bit-rate. This work presents a ratedistortion (R-D) optimized progressive ...
A Comprehensive Approach for Streaming 3D Progressive Meshes
ISM '09: Proceedings of the 2009 11th IEEE International Symposium on Multimedia

Fast and efficient streaming of detailed 3D model over lossy network has long been a challenge, al-though progressive compression techniques were pro-posed long time ago. One reason is that packet loss occurring in unreliable networks is highly ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications

ACM Transactions on Multimedia Computing, Communications, and Applications Volume 2, Issue 4

November 2006

148 pages

ISSN:1551-6857

EISSN:1551-6865

DOI:10.1145/1201730

Issue’s Table of Contents

Copyright © 2006 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2006

Published in TOMM Volume 2, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
679
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Soltani Mohammadi IGhanbari MHashemi M(2022)GAMORRAComputers and Graphics10.1016/j.cag.2022.05.007106:C(9-19)Online publication date: 1-Aug-2022
https://dl.acm.org/doi/10.1016/j.cag.2022.05.007
Liu YGuo JDeng KLiu Y(2019)A Three-Stage Progressive Transmission Scheme for Virtual Environments Over Lossy NetworksIEEE Access10.1109/ACCESS.2019.29600537(184411-184422)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2960053
Moreno CLi M(2018)A Progressive Transmission Technique for the Streaming of Point Cloud Data Using the Kinect2018 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICCNC.2018.8390310(593-598)Online publication date: Mar-2018
https://doi.org/10.1109/ICCNC.2018.8390310
Li MReeves JMoreno C(2018)Multi-level sample importance ranking based progressive transmission strategy for time series body sensor dataComputer Networks10.1016/j.comnet.2018.03.001136(119-127)Online publication date: May-2018
https://doi.org/10.1016/j.comnet.2018.03.001
Zhao SOoi WCarlier AMorin GCharvillat V(2014)Bandwidth adaptation for 3D mesh preview streamingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/253785410:1s(1-20)Online publication date: 5-Jan-2014
https://dl.acm.org/doi/10.1145/2537854
Mekuria RSanna MIzquierdo EBulterman DCesar P(2014)Enabling Geometry-Based 3-D Tele-Immersion With Fast Mesh Compression and Linear Rateless CodingIEEE Transactions on Multimedia10.1109/TMM.2014.233191916:7(1809-1820)Online publication date: Nov-2014
https://doi.org/10.1109/TMM.2014.2331919
Zhao SOoi WCarlier AMorin GCharvillat VGriwodz C(2013)3D mesh preview streamingProceedings of the 4th ACM Multimedia Systems Conference10.1145/2483977.2484001(178-189)Online publication date: 28-Feb-2013
https://dl.acm.org/doi/10.1145/2483977.2484001
Mekuria RSanna MAsioli SIzquierdo EBulterman DCesar PGriwodz C(2013)A 3D tele-immersion system based on live captured mesh geometryProceedings of the 4th ACM Multimedia Systems Conference10.1145/2483977.2483980(24-35)Online publication date: 28-Feb-2013
https://dl.acm.org/doi/10.1145/2483977.2483980
Fechteler PHilsmann AEisert PBroeck SStevens CWall JSanna MMauro DKuijk FMekuria RCesar PMonaghan DO'Connor NDaras PAlexiadis DZahariadis TEisert PGagalowicz A(2013)A framework for realistic 3D tele-immersionProceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications10.1145/2466715.2466718(1-8)Online publication date: 6-Jun-2013
https://dl.acm.org/doi/10.1145/2466715.2466718
Nowak SSobczak D(2012)Progressive 3D Mesh Transmission in IP Networks: Implementation and Traffic MeasurementsInternet - Technical Developments and Applications 210.1007/978-3-642-25355-3_3(25-37)Online publication date: 2012
https://doi.org/10.1007/978-3-642-25355-3_3
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents