research-article

A framework for realistic 3D tele-immersion

Authors:

N. E. O'Connor,

D. Alexiadis, and

T. ZahariadisAuthors Info & Claims

MIRAGE '13: Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications

June 2013

Article No.: 12, Pages 1 - 8

https://doi.org/10.1145/2466715.2466718

Published: 06 June 2013 Publication History

Abstract

Meeting, socializing and conversing online with a group of people using teleconferencing systems is still quite different from the experience of meeting face to face. We are abruptly aware that we are online and that the people we are engaging with are not in close proximity. Analogous to how talking on the telephone does not replicate the experience of talking in person. Several causes for these differences have been identified and we propose inspiring and innovative solutions to these hurdles in attempt to provide a more realistic, believable and engaging online conversational experience. We present the distributed and scalable framework REVERIE that provides a balanced mix of these solutions. Applications build on top of the REVERIE framework will be able to provide interactive, immersive, photo-realistic experiences to a multitude of users that for them will feel much more similar to having face to face meetings than the experience offered by conventional teleconferencing systems.

References

[1]

R. Aguilar, V. Muoz, and Y. Callero. Control application using fuzzy logic: Design of a fuzzy temperature controller, pages 379--396. Fuzzy Inference System - Theory and Applications. May 2012.

[2]

D. Alexiadis, D. Zarpalas, and P. Daras. Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras. IEEE Transactions on Multimedia, 15(2):339--358, 2013.

Digital Library

[3]

G. AlRegib and Y. Altunbasak. 3TP: An application-layer protocol for streaming 3-D graphics. IEEE Transactions on Multimedia, 7(6):1149--1156, 2005.

Digital Library

[4]

D. R. Begault. 3-D Sound: For Virtual Reality and Multimedia. Academic Press Professional, Cambridge, MA, 1994.

Digital Library

[5]

J. Blauert. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, Cambridge, MA, 1996.

[6]

W. Cheng, W. Ooi, S. Mondet, R. Grigoras, and G. Morin. Modeling progressive mesh streaming: Does data dependency matter? ACM Transactions on Multimedia Computing, Communications, and Applications, 7(2), 2011.

Digital Library

[7]

B. Curless and M. Levoy. A Volumetric Method for Building Complex Models from Range Images. In SIGGRAPH '96, 1996.

Digital Library

[8]

P. Fechteler, A. Hilsmann, and P. Eisert. Kinematic ICP for Articulated Template Fitting. In Proc. International Workshop on Vision, Modeling and Visualization (VMV'12), Magdeburg, Germany, 12--14 November 2012.

[9]

Y. Furukawa and J. Ponce. Carved Visual Hulls for Image-Based Modeling. International Journal of Computer Vision, 81:53--67, 2009.

Digital Library

[10]

M. Gillies and D. Ballin. Integrating Autonomous Behavior and User Control for Believable Agents. In Proc. International Joint Conference on Autonomous Agents and Multi-agent Systems, volume I, pages 336--343. IEEE, 2004.

Digital Library

[11]

J. Gratch and S. Marsella. A Domain-independent Framework for Modeling Emotion. Journal of Cognitive Systems Research, 5(4):269--306, 2004.

Digital Library

[12]

D. Herrera, J. Kannala, and J. Heikkila. Joint Depth and Color Camera Calibration with Distortion Correction. IEEE Trans Pattern Anal Mach Intell., 34, 2012.

Digital Library

[13]

A. Hilsmann, P. Fechteler, and P. Eisert. Pose Space Image Based Rendering. Computer Graphics Forum (Proc. Eurographics), 32(2), 6--10 May 2013.

[14]

Z. Huang, A. Arefin, P. Agarwal, K. Nahrstedt, and W. Wu. Towards the Understanding of Human Perceptual Quality in Tele-Immersive Shared Activity. In Proc. ACM Conference on Multimedia Systems, pages 29--34. ACM, 2012.

Digital Library

[15]

B. Jovanova, M. Preda, and F. Preteux. MPEG-4 Part 25: A graphics compression framework for XML-based scene graph formats. Signal Processing: Image Communication, 24(1-2), 2009.

Digital Library

[16]

K. Mamou and T. Zaharia and F. Preteux. TFAN: A low complexity 3D mesh compression algorithm. Computer Animation and Virtual Worlds, 20(2--3), 2009.

Digital Library

[17]

M. Korytkowski, R. Nowicki, L., Rutkowski, and R. Scherer. Merging Ensemble of Neuro-Fuzzy Systems. In Proc. International Conference on Fuzzy Systems, pages 1957--1957. IEEE, 2006.

[18]

H. Li, M. Li, and B. Prabhakaran. Middleware for Streaming 3D Progressive Meshes over Lossy Networks. ACM Transactions on Multimedia Computing, Communications, and Applications, 2(4), 2006.

Digital Library

[19]

M. Luby, A. Shokrollahi, M. Watson, and T. Stockhammer. Raptor Forward Error Correction Scheme for Object Delivery. RFC 5053 (Proposed Standard), Oct. 2007.

[20]

A. Maimone and H. Fuchs. Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, 2011.

Digital Library

[21]

R. Mekuria, M. Sanna, S. Asioli, E. Izquierdo, D. Bulterman, and P. Cesar. A 3D Tele-Immersion System based on Live Captured Mesh Geometry. In Proc. ACM Multimedia Systems Conference. ACM, 2013.

Digital Library

[22]

K. Osberg. But What's Behind Door Number 4??? Ethics and Virtual Reality: A Discussion. Human Interface Technology Lab Technical Report R-97-16, 1997.

[23]

S. P. Parker, G. Eberle, R. L. Martin, and K. I. McAnally. Construction of 3-D Audio Systems: Background, Research and General Requirements. Technical report, Victoria: Defence Science and Technology Organisation, 2000.

[24]

REal and Virtual Engagement in Realistic Immersive Environments (REVERIE). Project web site: www.reveriefp7.eu.

[25]

J. Steuer. Defining Virtual Reality: Dimensions Determining Telepresence. Journal of Communication, 42(4):73--93, 1992.

[26]

R. Vasudevan, G. Kurillo, E. Lobaton, T. Bernardin, O. Kreylos, R. Bajcsy, and K. Nahrstedt. High-Quality Visualization for Geographically Distributed 3-D Teleimmersive Applications. IEEE Transactions on Multimedia, 13(3), June 2011.

Digital Library

[27]

V. Vinayagamoorthy, M. Gillies, A. Steed, E. Tanguy, X. Pan, C. Loscos, and M. Slater. Building Expression into Virtual Characters. In Eurographics Conference State of the Art Reports, Vienna, Austria, 4--8 September 2006.

[28]

E. Werner. Manual of Visual Fields. New York, Churchill Livingstone, 1991.

[29]

W. A. Yost. Fundamentals of Hearing: An Introduction. Academic press London, 1994.

Cited By

Doumanis IEconomou D(2020)Evaluating the Impact of Multimodal Collaborative Virtual Environments on User’s Spatial Knowledge and Experience of Gamified Educational Tasks2020 6th International Conference of the Immersive Learning Research Network (iLRN)10.23919/iLRN47897.2020.9155165(185-193)Online publication date: Jun-2020
https://doi.org/10.23919/iLRN47897.2020.9155165
Doumanis IEconomou D(2019)Affective Communication between ECAs and Users in Collaborative Virtual Environments: The REVERIE European Parliament Use CaseMultimodal Technologies and Interaction10.3390/mti30100073:1(7)Online publication date: 10-Feb-2019
https://doi.org/10.3390/mti3010007
Doumanis IEconomou D(2019)Using Cognitive Walkthrough and Hybrid Prototyping to Gather User Requirements in Early Design Virtual Reality PrototypesImmersive Learning Research Network10.1007/978-3-030-23089-0_18(234-246)Online publication date: 16-Jun-2019
https://doi.org/10.1007/978-3-030-23089-0_18
Show More Cited By

Index Terms

A framework for realistic 3D tele-immersion

Recommendations

Virtual Reality and Tele-Immersion in Health Care Introduction to Minitrack
HICSS '00: Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 5 - Volume 5

Overview of FieldThis minitrack focuses on the impact on the healthcare domain of two rapidly emerging, advanced imaging technologies - virtual reality and tele-immersion. Virtual reality is an artificial environment created with computer hardware and ...
Read More
Biomedical Modeling in Tele-Immersion
Digital Human Modeling

The major goal of this research is to develop a networked collaborative surgical system for tele-immersive consultation, surgical pre-planning, implant design, post operative evaluation and education. Tele-immersion enables users in different locations ...
Read More
Adding immersion to collaborative tools
VRML '00: Proceedings of the fifth symposium on Virtual reality modeling language (Web3D-VRML)

While three dimensional collaborative environments have been used for industrial design or interactive games, workgroup collaboration has largely remained in the two-dimensional realm. In this paper, we examine the collaborative capabilities of the ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MIRAGE '13: Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications

June 2013

137 pages

ISBN:9781450320238

DOI:10.1145/2466715

Conference Chairs:
Peter Eisert
Fraunhofer HHI / Humboldt-Universitát zu Berlin
,
André Gagalowicz
Inria Paris - Rocquencourt, France

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Humboldt Univ.: Humboldt-Universität zu Berlin
FHHI: Fraunhofer Heinrich Hertz Institute

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

MIRAGE '13

Sponsor:

Humboldt Univ.
FHHI

MIRAGE '13: 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications

June 6 - 7, 2013

Berlin, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
259
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Doumanis IEconomou D(2020)Evaluating the Impact of Multimodal Collaborative Virtual Environments on User’s Spatial Knowledge and Experience of Gamified Educational Tasks2020 6th International Conference of the Immersive Learning Research Network (iLRN)10.23919/iLRN47897.2020.9155165(185-193)Online publication date: Jun-2020
https://doi.org/10.23919/iLRN47897.2020.9155165
Doumanis IEconomou D(2019)Affective Communication between ECAs and Users in Collaborative Virtual Environments: The REVERIE European Parliament Use CaseMultimodal Technologies and Interaction10.3390/mti30100073:1(7)Online publication date: 10-Feb-2019
https://doi.org/10.3390/mti3010007
Doumanis IEconomou D(2019)Using Cognitive Walkthrough and Hybrid Prototyping to Gather User Requirements in Early Design Virtual Reality PrototypesImmersive Learning Research Network10.1007/978-3-030-23089-0_18(234-246)Online publication date: 16-Jun-2019
https://doi.org/10.1007/978-3-030-23089-0_18
Alexiadis DChatzitofis AZioulis NZoidi OLouizis GZarpalas DDaras P(2017)An Integrated Platform for Live 3D Human Reconstruction and Motion CapturingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.257692227:4(798-813)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1109/TCSVT.2016.2576922
Michael NDrakou MLanitis A(2017)Model-based generation of personalized full-body 3D avatars from uncalibrated multi-view photographsMultimedia Tools and Applications10.1007/s11042-016-3808-176:12(14169-14195)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1007/s11042-016-3808-1
Economou DDoumanis IArgyriou LGeorgalas N(2017)User experience evaluation of human representation in collaborative virtual environmentsPersonal and Ubiquitous Computing10.1007/s00779-017-1075-421:6(989-1001)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s00779-017-1075-4
Ebara Y(2016)Fundamental Consideration on Possibility of Meta Realistic Sensation Communication Technology2016 19th International Conference on Network-Based Information Systems (NBiS)10.1109/NBiS.2016.68(405-409)Online publication date: Sep-2016
https://doi.org/10.1109/NBiS.2016.68
Lin CSun PYu FScacchi WWhitehead J(2015)Space connectionProceedings of the Fourth International Workshop on Games and Software Engineering10.5555/2820144.2820151(22-28)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2820144.2820151
Furch JHilsmann AEisert P(2015)A framework for image-based asset generation and animation2015 IEEE International Conference on Image Processing (ICIP)10.1109/ICIP.2015.7351141(1950-1954)Online publication date: Sep-2015
https://doi.org/10.1109/ICIP.2015.7351141
Lin CSun PYu F(2015)Space ConnectionProceedings of the 2015 IEEE/ACM 4th International Workshop on Games and Software Engineering10.1109/GAS.2015.12(22-28)Online publication date: 18-May-2015
https://dl.acm.org/doi/10.1109/GAS.2015.12
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents