demonstration

Dive into Remote Events: Omnidirectional Video Streaming with Acoustic Immersion

Authors:

Akira KojimaAuthors Info & Claims

MM '15: Proceedings of the 23rd ACM international conference on Multimedia

Pages 737 - 738

https://doi.org/10.1145/2733373.2807963

Published: 13 October 2015 Publication History

Get Access

Abstract

We propose a system that can provide the physical presence of remote events through a head mount display (HMD) and a headphone. It can stream omnidirectional video within a limited network bandwidth at a high bitrate without sending regions that users are not viewing. It can also reproduce binaural sounds by convoluting head related transfer functions and angular region-wise separated signals. Technical demos of the system using an Oculus Rift HMD with a headphone will be performed to enable users to experience the visual and acoustic immersion it provides.

References

[1]

D. Ochi, S. Iwaki, Y. Kunita, J. Hirose, K. Fujii, and A. Kojima, HMD Viewing Spherical Streaming System, Proc: ACM MM 2014, November 2014.

Digital Library

Google Scholar

[2]

D. Ochi, S. Iwaki, K. Akio, Y. Kunita, and A. Kojima, Live Streaming System for Omnidirectional Video, Proc: IEEE VR 2015, March 2015.

Crossref

Google Scholar

[3]

Y. Hioka, K. Furuya, K. Kobayashi, K. Niwa, and Y. Haneda, Underdetermined sound source separation using power spectrum density estimated by combination of directivity gain, IEEE trans: on Audio; Speech; and Language, Vol.21, No.6, pp.1240--1250, 2013.

Digital Library

Google Scholar

[4]

K. Niwa, T. Nishino, and K. Takeda, Encoding large array signals into a 3D sound field representation for selective listening point audio based on blind source separation, Proc: ICASSP 2008, 181--184, 2008.

Crossref

Google Scholar

[5]

Nagoya University, Head Related Transfer Functions, http://www:sp:m:is:nagoya-u:ac:jp/HRTF/.

Google Scholar

Cited By

View all

Margetis GSykianaki EChatzakis ISfakaki AApostolakis KPaparoulis GNtoa SMarkopoulos IStephanidis C(2024)Immersive Experience Design of (e)sports EventsHCI International 2024 – Late Breaking Posters10.1007/978-3-031-78561-0_24(239-248)Online publication date: 30-Dec-2024
https://doi.org/10.1007/978-3-031-78561-0_24
Aiordăchioae APamparău CVatavu R(2021)Lifelogging meets alternate and cross-realities: an investigation into broadcasting personal visual realities to remote audiencesMultimedia Tools and Applications10.1007/s11042-021-11310-383:15(46707-46730)Online publication date: 14-Aug-2021
https://doi.org/10.1007/s11042-021-11310-3
Niwa KHioka YUematsu H(2018)Efficient Audio Rendering Using Angular Region-Wise Source Enhancement for 360$^{\circ }$ VideoIEEE Transactions on Multimedia10.1109/TMM.2018.282918720:11(2871-2881)Online publication date: Nov-2018
https://doi.org/10.1109/TMM.2018.2829187
Show More Cited By

Index Terms

Dive into Remote Events: Omnidirectional Video Streaming with Acoustic Immersion

Recommendations

HMD Viewing Spherical Video Streaming System
MM '14: Proceedings of the 22nd ACM international conference on Multimedia

We propose a video streaming system that lets users view their favorite sections through an HMD (head mount display) from a video recorded by a spherical (360-degree) camera. Although spherical video streaming tends to consume a lot of bitrate for its ...
Super wide viewer using catadioptrical optics
VRST '03: Proceedings of the ACM symposium on Virtual reality software and technology

Many applications have used a Head-Mounted Display (HMD), such as in virtual and mixed realities, and tele-presence. The advantage of HMD systems is the ease of feeling a 3D world in the display of animation or movies. However, the field of view (FOV) ...
A waveform generation model-based approach for segregation of monaural mixed sound

The present paper describes a novel method for segregating monaural concurrent sounds. In a real environment, there exist several types of sounds, including periodic, aperiodic and impulsive sounds, and several sounds will usually occur simultaneously. ...

Comments

Information & Contributors

Information

Published In

MM '15: Proceedings of the 23rd ACM international conference on Multimedia

October 2015

1402 pages

ISBN:9781450334594

DOI:10.1145/2733373

General Chairs:
Xiaofang Zhou
The University of Queensland, Australia
,
Alan F. Smeaton
Dublin City University, Ireland
,
Qi Tian
The University of Texas at San Antonio, USA
,
Program Chairs:
Dick C.A. Bulterman
FXPAL, USA
,
Heng Tao Shen
The University of Queensland, Australia
,
Ketan Mayer-Patel
The University of North Carolina, USA
,
Shuicheng Yan
National University of Singapore, Singapore

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2015

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MM '15

Sponsor:

SIGMM

MM '15: ACM Multimedia Conference

October 26 - 30, 2015

Brisbane, Australia

Acceptance Rates

MM '15 Paper Acceptance Rate 56 of 252 submissions, 22%;

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
254
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Margetis GSykianaki EChatzakis ISfakaki AApostolakis KPaparoulis GNtoa SMarkopoulos IStephanidis C(2024)Immersive Experience Design of (e)sports EventsHCI International 2024 – Late Breaking Posters10.1007/978-3-031-78561-0_24(239-248)Online publication date: 30-Dec-2024
https://doi.org/10.1007/978-3-031-78561-0_24
Aiordăchioae APamparău CVatavu R(2021)Lifelogging meets alternate and cross-realities: an investigation into broadcasting personal visual realities to remote audiencesMultimedia Tools and Applications10.1007/s11042-021-11310-383:15(46707-46730)Online publication date: 14-Aug-2021
https://doi.org/10.1007/s11042-021-11310-3
Niwa KHioka YUematsu H(2018)Efficient Audio Rendering Using Angular Region-Wise Source Enhancement for 360$^{\circ }$ VideoIEEE Transactions on Multimedia10.1109/TMM.2018.282918720:11(2871-2881)Online publication date: Nov-2018
https://doi.org/10.1109/TMM.2018.2829187
Adão TPádua LFonseca MAgrellos LSousa JMagalhães LPeres E(2018)A rapid prototyping tool to produce 360° video-based immersive experiences enhanced with virtual/multimedia elementsProcedia Computer Science10.1016/j.procs.2018.10.062138(441-453)Online publication date: 2018
https://doi.org/10.1016/j.procs.2018.10.062
Ochi DKameda ATakahashi KMakiguchi MTakeuchi K(2016)VR technologies for rich sports experienceACM SIGGRAPH 2016 Emerging Technologies10.1145/2929464.2949030(1-2)Online publication date: 24-Jul-2016
https://dl.acm.org/doi/10.1145/2929464.2949030
Niwa KKoizumi YKobayashi KUematsu H(2016)Binaural sound generation corresponding to omnidirectional video view using angular region-wise source enhancement2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2016.7472198(2852-2856)Online publication date: Mar-2016
https://doi.org/10.1109/ICASSP.2016.7472198

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

HMD Viewing Spherical Video Streaming System

Super wide viewer using catadioptrical optics

A waveform generation model-based approach for segregation of monaural mixed sound

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations