Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Modified 2D-Ghost-Free Stereoscopic Display with Depth-of-Field Effects

Published: 23 January 2023 Publication History

Abstract

Backward-compatible stereoscopic display, a novel display technique that can simultaneously present satisfying 3D effects to viewers with stereo glasses and clear 2D contents to viewers without, aims at helping the people who are unsuitable for watching 3D movies for a long time. In this article, we introduce two versions of backward-compatible stereoscopic display: the simpler version is far simpler than Hidden Stereo (the state-of-the-art method) while preserving competitive 2D–3D effects; the advanced version, which we call 2D-Ghost-Free Stereoscopic Display, overcomes the limitation that Hidden Stereo and the simpler version are both confined to small absolute disparity. 2D-Ghost-Free Stereoscopic Display improves tolerable disparity range by adding depth-of-field in the regions with large disparity, so that it can be applied to more scenes of 3D movies. User experiments and theoretical analysis both demonstrate the superiority of the 2D-Ghost-Free Stereoscopic Display over the state-of-the-art method and our simpler version. In addition, to make the user experiments double-blind and automatic, we developed a user study system that can automatically present 3D images and videos in NVIDIA 3D Vision 2 and collect corresponding votes of subjects on stimuli, whereas the previous researchers did not state that their user experiments were double-blind.

References

[1]
Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, and Hans-Peter Seidel. 2011. A perceptual model for disparity. ACM Transactions on Graphics30, 4 (2011), 1–10. DOI:
[2]
Piotr Didyk, Tobias Ritschel, Elmar Eisemann, Karol Myszkowski, and Hans-Peter Seidel. 2012. Apparent stereo: The cornsweet illusion can enhance perceived depth. In Proceedings of the IS&T/SPIE Symposium on Electronic Imaging Human Vision and Electronic Imaging XVII. 1–12.
[3]
Piotr Didyk, Pitchaya Sitthi-Amorn, William Freeman, Frédo Durand, and Wojciech Matusik. 2013. Joint view expansion and filtering for automultiscopic 3D displays. ACM Transactions on Graphics 32, 6 (2013), 1–8.
[4]
Andrew T. Duchowski, Donald H. House, Jordan Gestring, Rui I. Wang, Krzysztof Krejtz, Izabela Krejtz, Radosław Mantiuk, and Bartosz Bazyluk. 2014. Reducing visual discomfort of 3D stereoscopic displays with gaze-contingent depth-of-field. In Proceedings of the ACM Symposium on Applied Perception. 39–46.
[5]
Wataru Fujimura, Yukua Koide, Robert Songer, Takahiro Hayakawa, Akihiko Shirai, and Kazuhisa Yanaka. 2012. 2x3D: Real time shader for simultaneous 2D/3D hybrid theater. In Proceedings of the SIGGRAPH Asia 2012 Emerging Technologies. 1. DOI:
[6]
Taiki Fukiage, Takahiro Kawabe, and Shin’ya Nishida. 2017. Hiding of phase-based stereo disparity for ghost-free viewing without glasses.ACM Transactions on Graphics 36, 4 (2017), 1–16. DOI:
[7]
Rafael C. Gonzalez and Richard E. Woods. 2018. Digital Image Processing, 4th Edition. Pearson.
[8]
Sid Henriksen and Jenny C. A. Read. 2016. Visual perception: A novel difference channel in binocular vision. Current Biology 26, 12 (2016), R500–R503. DOI:
[9]
David M. Hoffman, Ahna R. Girshick, Kurt Akeley, and Martin S. Banks. 2008. Vergence–accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3 (2008), 1–30.
[10]
Asmaa Hosni, Christoph Rhemann, Michael Bleyer, Carsten Rother, and Margrit Gelautz. 2012. Fast cost-volume filtering for visual correspondence and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 2 (2012), 504–511.
[11]
Shinobu Ishihara. 1987. Test for Colour-blindness. Kanehara Tokyo, Japan.
[12]
Youngjin Jo, Seungjae Lee, Dongheon Yoo, Suyeon Choi, Dongyeon Kim, and Byoungho Lee. 2019. Tomographic projector: Large scale volumetric display with uniform viewing experiences. ACM Transactions on Graphics38, 6 (2019), 1–13.
[13]
Petr Kellnhofer, Piotr Didyk, Karol Myszkowski, Mohamed M. Hefeeda, Hans-Peter Seidel, and Wojciech Matusik. 2016. GazeStereo3D: Seamless disparity manipulations. ACM Transactions on Graphics 35, 4 (2016), 1–13. DOI:
[14]
Petr Kellnhofer, Piotr Didyk, Szu-Po Wang, Pitchaya Sitthi-Amorn, William Freeman, Fredo Durand, and Wojciech Matusik. 2017. 3DTV at home: Eulerian-lagrangian stereo-to-multiview conversion. ACM Transactions on Graphics 36, 4 (2017), 1–13. DOI:
[15]
Frederick A. A. Kingdom. 2012. Binocular vision: The eyes add and subtract. Current Biology 22, 1 (2012), R22–R24. DOI:
[16]
Marc Lambooij, Marten Fortuin, Ingrid Heynderickx, and Wijnand IJsselsteijn. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology 53, 3 (2009), 30201–1–30201–14. DOI:
[17]
Manuel Lang, Alexander Hornung, Oliver Wang, Steven Poulakos, Aljoscha Smolic, and Markus Gross. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM Transactions on Graphics 29, 4 (2010), 1–10. DOI:
[18]
Zhaoping Li and Joseph J. Atick. 1994. Efficient stereo coding in the multiscale representation. Network: Computation in Neural Systems 5, 2 (1994), 157–174. DOI:
[19]
Keith A. May and Li Zhaoping. 2016. Efficient coding theory predicts a tilt aftereffect from viewing untilted patterns. Current Biology 26, 12 (2016), 1571–1576. DOI:
[20]
Simone Meyer, Oliver Wang, Henning Zimmer, Max Grosse, and Alexander Sorkine-Hornung. 2015. Phase-based frame interpolation for video. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1410–1418.
[21]
Thomas Oskam, Alexander Hornung, Huw Bowles, Kenny Mitchell, and Markus H. Gross. 2011. OSCAM-optimized stereoscopic camera control for interactive 3D.ACM Transactions on Graphics 30, 6 (2011), 189.
[22]
Stephen E. Palmer. 1999. Vision Science: Photons to Phenomenology. MIT press.
[23]
Soon-gi Park, Jiwoon Yeom, Youngmo Jeong, Ni Chen, Jong-Young Hong, and Byoungho Lee. 2014. Recent issues on integral imaging and its applications. Journal of Information Display 15, 1 (2014), 37–46.
[24]
Javier Portilla and Eero P. Simoncelli. 2000. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 1 (2000), 49–70.
[25]
René Ranftl, Katrin Lasinger, David Hafner, Konrad Schindler, and Vladlen Koltun. 2020. Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020).
[26]
Whitman Richards. 1971. Anomalous stereoscopic depth perception. Journal of the Optical Society of America 61, 3 (1971), 410–414.
[27]
Steven Scher, Jing Liu, Rajan Vaish, Prabath Gunawardane, and James Davis. 2013. 3D+2DTV: 3D displays with no ghosting for viewers without glasses. ACM Transactions on Graphics32, 3 (2013), 1–10. DOI:
[28]
Eero P. Simoncelli and William T. Freeman. 1995. The steerable pyramid: A flexible architecture for multi-scale derivative computation. In Proceedings of the International Conference on Image Processing. 444–447.
[29]
Neal Wadhwa, Michael Rubinstein, Frédo Durand, and William T. Freeman. 2013. Phase-based video motion processing. ACM Transactions on Graphics 32, 4 (2013), 1–10.
[30]
Koki Wakunami, Po-Yuan Hsieh, Ryutaro Oi, Takanori Senoh, Hisayuki Sasaki, Yasuyuki Ichihashi, Makoto Okui, Yi-Pai Huang, and Kenji Yamamoto. 2016. Projection-type see-through holographic three-dimensional display. Nature Communications 7, 1 (2016), 1–7.
[31]
Suttisak Wizadwongsa, Pakkapon Phongthawee, Jiraphon Yenphraphai, and Supasorn Suwajanakorn. 2021. NeX: Real-time view synthesis with neural basis expansion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
[32]
Xiaolin Wu and Guangtao Zhai. 2012. Backward compatible stereoscopic displays via temporal psychovisual modulation. In Proceedings of the SIGGRAPH Asia 2012 Emerging Technologies. 4. DOI:
[33]
Lei Xiao, Anton Kaplanyan, Alexander Fix, Matt Chapman, and Douglas Lanman. 2018. Deepfocus: Learned image synthesis for computational display. In Proceedings of the ACM SIGGRAPH 2018 Talks. 1–2.
[34]
Charles M. Zaroff, Magosha Knutelska, and Thomas E. Frumkes. 2003. Variation in stereoacuity: Normative description, fixation disparity, and the roles of aging and gender. Investigative Ophthalmology & Visual Science 44, 2 (2003), 891–900. DOI:
[35]
Zhoutong Zhang, Yebin Liu, and Qionghai Dai. 2015. Light field from micro-baseline image pair. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3800–3809.
[36]
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely. 2018. Stereo magnification: Learning view synthesis using multiplane images. ACM Transactions on Graphics 37, 65 (2018), 1–12.

Cited By

View all
  • (2024)A Low-Density Parity-Check Coding Scheme for LoRa NetworkingACM Transactions on Sensor Networks10.1145/366592820:4(1-29)Online publication date: 8-Jul-2024
  • (2024)Spatiotemporal Inconsistency Learning and Interactive Fusion for Deepfake Video DetectionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3664654Online publication date: 13-May-2024
  • (2024)Blind Quality Assessment of Dense 3D Point Clouds with Structure Guided ResamplingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366419920:8(1-21)Online publication date: 13-Jun-2024
  • Show More Cited By

Index Terms

  1. Modified 2D-Ghost-Free Stereoscopic Display with Depth-of-Field Effects

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 19, Issue 1s
      February 2023
      504 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/3572859
      • Editor:
      • Abdulmotaleb El Saddik
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 January 2023
      Online AM: 12 May 2022
      Accepted: 01 May 2022
      Received: 15 September 2021
      Published in TOMM Volume 19, Issue 1s

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Backward-compatible stereoscopic display
      2. stereoscopy
      3. perception

      Qualifiers

      • Research-article
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)55
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 01 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)A Low-Density Parity-Check Coding Scheme for LoRa NetworkingACM Transactions on Sensor Networks10.1145/366592820:4(1-29)Online publication date: 8-Jul-2024
      • (2024)Spatiotemporal Inconsistency Learning and Interactive Fusion for Deepfake Video DetectionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3664654Online publication date: 13-May-2024
      • (2024)Blind Quality Assessment of Dense 3D Point Clouds with Structure Guided ResamplingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366419920:8(1-21)Online publication date: 13-Jun-2024
      • (2024)Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation LearningACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366357020:8(1-19)Online publication date: 13-Jun-2024
      • (2024)Progressive Adapting and Pruning: Domain-Incremental Learning for Saliency PredictionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366131220:8(1-243)Online publication date: 13-Jun-2024
      • (2024)Dual Dynamic Threshold Adjustment StrategyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365604720:7(1-18)Online publication date: 15-May-2024
      • (2024)Backdoor Two-Stream Video Models on Federated LearningACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3651307Online publication date: 7-Mar-2024
      • (2024)Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video GenerationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/364836820:6(1-18)Online publication date: 26-Mar-2024
      • (2024)Head3D: Complete 3D Head Generation via Tri-plane Feature DistillationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/363571720:6(1-20)Online publication date: 8-Mar-2024
      • (2024)Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery DetectionIEEE Transactions on Information Forensics and Security10.1109/TIFS.2023.333221819(1168-1182)Online publication date: 1-Jan-2024
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media