Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3355355.3361880acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
abstract

Live 6DoF Video Production with Stereo Camera

Published: 17 November 2019 Publication History

Abstract

We propose a light-weight 6DoF video production pipeline which uses only one stereo camera as input. The subject can move freely in any direction (lateral and depth) as the stereo camera follows to keep the subject within the frame. DeepKeying, our own proprietary keying method based on deep learning, helps with ease of live shooting with no need for green screen. The live video stream is processed in real time to provide 6DoF video experience. Our method enables a sense of immersion at production quality.

References

[1]
T. Kanade, P. J. Narayanan, and P. W. Rander. 1995. Virtualized reality: concepts and early results. In Proceedings IEEE Workshop on Representation of Visual Scenes. IEEE, Cambridge, MA, USA, USA, 69–76.
[2]
A. Serrano, I. Kim, Z. Chen, S. DiVerdi, D. Gutierrez, A. Hertzmann, and B. Masia. 2019. Motion parallax for 360° RGBD video. IEEE Transactions on Visualization and Computer Graphics (2019), 1817–1827.

Cited By

View all
  • (2024)Integrating Depth-Based and Deep Learning Techniques for Real-Time Video Matting without Green ScreensElectronics10.3390/electronics1316318213:16(3182)Online publication date: 12-Aug-2024
  • (2021)Deep authoring - an AI Tool set for creating immersive MultiMedia experiencesMultimedia Tools and Applications10.1007/s11042-020-10275-z80:20(31105-31134)Online publication date: 1-Aug-2021

Index Terms

  1. Live 6DoF Video Production with Stereo Camera
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SA '19: SIGGRAPH Asia 2019 XR
        November 2019
        47 pages
        ISBN:9781450369473
        DOI:10.1145/3355355
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 17 November 2019

        Check for updates

        Author Tags

        1. 6DoF
        2. VR
        3. contents creation
        4. deep learning
        5. keying
        6. live action
        7. real-time processing
        8. stereo camera
        9. visual effects (VFX)

        Qualifiers

        • Abstract
        • Research
        • Refereed limited

        Conference

        SA '19
        Sponsor:
        SA '19: SIGGRAPH Asia 2019
        November 17 - 20, 2019
        QLD, Brisbane, Australia

        Acceptance Rates

        Overall Acceptance Rate 178 of 869 submissions, 20%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)10
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 22 Sep 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Integrating Depth-Based and Deep Learning Techniques for Real-Time Video Matting without Green ScreensElectronics10.3390/electronics1316318213:16(3182)Online publication date: 12-Aug-2024
        • (2021)Deep authoring - an AI Tool set for creating immersive MultiMedia experiencesMultimedia Tools and Applications10.1007/s11042-020-10275-z80:20(31105-31134)Online publication date: 1-Aug-2021

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media