Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3126686.3126692acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Efficient Depth-aware Image Deformation Adaptation for Curved Screen Displays

Published: 23 October 2017 Publication History

Abstract

The curved screen has attracted considerable attentions in recent years, since it enables to enlarge the view angle and to enhance the immersive perception for users. However, existing curved surface projections are frequently prone to geometric distortion or loss of content. This paper presents a content-aware and depth-aware image adaptation solution for curved displays. An efficient optimization approach of image deformation is proposed to preserve local scene content and to minimize scene geometry distortion. To follow the original 3D perception of objects in different depth layers, the depth information is re-mapped for individual content scaling. Objective evaluation results reveal that our approach can effectively preserve foreground objects. We also perform a subjective evaluation of the proposed solution, and compare it to two alternative mapping methods, which are tested on different curvatures on both a traditional screen and an ad-hoc curvature-controllable curved display. Experimental results demonstrate that our approach outperforms other existing mapping methods for immersive display of rectangle images on curved screens.

References

[1]
S. Battiato, G. M. Farinella, G. Puglisi, and D. Ravi. 2014. Saliency-Based Selection of Gradient Vector Flow Paths for Content Aware Image Resizing. IEEE Trans. Image. Process. Vol. 23, 5 (2014), 2081--2095.
[2]
I. Bogdanova, A. Bur, and H. Hugli. 2008. Visual Attention on the Sphere. IEEE Trans. Image. Process. Vol. 17, 11 (2008), 2000--2014.
[3]
ITU-R Rec. BT.500-13. 2012. Methodology for the subjective assessment of the quality of television pictures. Technical Report.
[4]
Robert Carroll, Aseem Agarwala, and Maneesh Agrawala. 2010. Image warps for artistic perspective manipulation. ACM Trans. Graph., Vol. 29, 4 (2010), 127:1--9.
[5]
Robert Carroll, Maneesh Agrawal, and Aseem Agarwala. 2009. Optimizing content-preserving projections for wide-angle images. ACM Trans. Graph. Vol. 28 (2009), 43:1--10.
[6]
Che-Han Chang and Yung-Yu Chuang. 2012. A line-structure-preserving approach to image resizing Proc. IEEE Int. Conf. CVPR. 1075--1082.
[7]
Che-Han Chang, Min-Chun Hu, Wen-Huang Cheng, and Yung-Yu Chuang. 2012. Rectangling Stereographic Projection for Wide-Angle Image Visualization Proc. IEEE Int. Conf. ICCV. 2824--2831.
[8]
Wang Chen, Irene Cheng, Zihui Xiong, Anup Basu, and Maojun Zhang. 2011. A 2-point algorithm for 3D reconstruction of horizontal lines from a single omni-directional image. Pattern Recognition Letters Vol. 32, 3 (2011), 524--531.
[9]
C. W. Deng, W. S. Lin, and J. F. Cai. 2012. Content-Based Image Compression for Arbitrary-Resolution Display Devices. IEEE Trans. Multimedia Vol. 14, 4 (2012), 1127--1139.
[10]
Y. M. Fang, W. S. Lin, B. S. Lee, C. T. Lau, Z. Z. Chen, and C. W. Lin. 2012. Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum. IEEE Trans. Multimedia Vol. 14, 1 (2012), 187--198.
[11]
Yanwen Guo, Feng Liu, Jian Shi, Zhi-Hua Zhou, and Michael Gleicher. 2009. Image retargeting using mesh parametrization. IEEE Trans. Multimedia Vol. 11, 5 (2009), 856--867.
[12]
Kaiming He, Huiwen Chang, and Jian Sun. 2013. Rectangling panoramic images via warping. ACM Trans. Graph., Vol. 32, 4 (2013), 79:1--9.
[13]
Ken-Yi Lee, Cheng-Da Chung, and Yung-Yu Chuang. 2012. Scene warping: Layer-based stereoscopic image resizing Proc. IEEE Int. Conf. CVPR. 49--56.
[14]
Bruno Levy, Sylvain Petitjean, Nicolas Ray, and Jrome Maillot. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. Vol. 21 (2002), 362--371.
[15]
Dongping Li, Kaiming He, Jian Sun, and Kun Zhou. 2015. A Geodesic-Preserving Method for Image Warping. In Proc. IEEE Int. Conf. CVPR. 213--221.
[16]
Feng Liu, Michael Gleicher, Hailin Jin, and Aseem Agarwala. 2009. Content-preserving warps for 3D video stabilization. ACM Trans. Graph. Vol. 28 (2009), 44:1--9. Issue 3.
[17]
Shao-Ping Lu, Song-Hai Zhang, Jin Wei, Shi-Min Hu, and Ralph R. Martin. 2013. Timeline Editing of Objects in Video. IEEE Trans. Visual. Comput. Graphics Vol. 19, 7 (2013), 1218--1227.
[18]
A. Mansfield, P. Gehler, L. Van Gool, and C. Rother. 2010 a. Scene carving: Scene consistent image retargeting. Proc. Int. Conf. ECCV. 143--156.
[19]
A. Mansfield, P. Gehler, L. Van Gool, and C. Rother. 2010 b. Visibility maps for improved seam carving. In Proc. Int. Conf. ECCV. workshop.
[20]
Rufael Mekuria, Michele Sanna, Stefano Asioli, Ebroul Izquierdo, Dick C. A. Bulterman, and Pablo Cesar. 2013. A 3D Tele-immersion System Based on Live Captured Mesh Geometry Proc. 4th ACM Multimedia Systems Conference. 24--35.
[21]
Kaloian Petkov, Charilaos Papadopoulos, Min Zhang, Arie E. Kaufman, and Xianfeng Gu. 2012. Interactive visibility retargeting in VR using conformal visualization. IEEE Trans. Visual. Comput. Graphics Vol. 18, 7 (2012), 1027--1040.
[22]
Shaoyu Qi and Jeffrey Ho. 2012. Seam segment carving: retargeting images to irregularly-shaped image domains Proc. IEEE Int. Conf. ECCV. 314--326.
[23]
Ramesh Raskar, Jeroen Baar, Thomas Willwacher, and Srinivas Rao. 2004. Quadric transfer for immersive curved screen displays. Comput. Graph. Forum, Vol. 23, 3 (2004), 451--460.
[24]
Michael Rubinstein, Ariel Shamir, and Shai Avidan. 2008. Improved seam carving for video retargeting. ACM Trans. Graph. Vol. 27 (2008), 16:1--9.
[25]
Behzad Sajadi and Aditi Majumder. 2011. Autocalibrating tiled projectors on piecewise smooth vertically extruded surfaces. IEEE Trans. Visual. Comput. Graphics Vol. 17, 9 (2011), 1209--1222.
[26]
Olaf Schenk, Matthias Bollhöfer, and Rudolf A Römer. 2008. On Large-Scale Diagonalization Techniques for the Anderson Model of Localization. SIAM Rev. Vol. 50, 1 (2008), 91--112.
[27]
Shai Avidan Shamir and Ariel. 2007. Seam carving for content-aware image resizing. ACM Trans. Graph., Vol. 26, 3 (2007), 1--10.
[28]
Jianbing Shen, Dapeng Wang, and Xuelong Li. 2013. Depth-Aware Image Seam Carving. IEEE Trans. Cybernetics Vol. 43, 5 (2013), 1453--1461.
[29]
Y. Wang, C. Tai, O. Sorkine, and T. Lee. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. Graph., Vol. 27, 5 (2008), 8:1--8.
[30]
Yu-Shuen Wang, Hongbo Fu, Olga Sorkine, Tong-Yee Lee, and Hans-Peter Seidel. 2009. Motion-aware temporal coherence for video resizing. ACM Trans. Graph., Vol. 28, 5 (2009), 127:136.
[31]
Jin Wei, Chen-Feng Li, Shi-Min Hu, Ralph R. Martin, and Chiew-Lan Tai. 2012. Fisheye video correction. IEEE Trans. Visual. Comput. Graphics Vol. 18, 10 (2012), 1771--1783.
[32]
Guo-Xin Zhang, Ming-Ming Cheng, Shi-Min Hu, and Ralph R. Martin. 2012. A Shape-Preserving Approach to Image Resizing. Comput. Graph. Forum Vol. 28 (2012), 1897--1906.
[33]
J. Y. Zhang, S. W. Li, and C. C. J. Kuo. 2014. Compressed-Domain Video Retargeting. IEEE Trans. Image. Process. Vol. 23, 2 (2014), 797--809.

Cited By

View all
  • (2020)Reading on 3D Surfaces in Virtual Environments2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581590322523(721-728)Online publication date: Mar-2020
  • (2020)Building stereoscopic zoomer via global and local warping optimizationIEEE Transactions on Computational Imaging10.1109/TCI.2020.3042891(1-1)Online publication date: 2020
  • (2019)Immersiveness and Perceptibility of Convex and Concave DisplaysProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131963114163:1(396-400)Online publication date: 20-Nov-2019
  • Show More Cited By

Index Terms

  1. Efficient Depth-aware Image Deformation Adaptation for Curved Screen Displays

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      Thematic Workshops '17: Proceedings of the on Thematic Workshops of ACM Multimedia 2017
      October 2017
      558 pages
      ISBN:9781450354165
      DOI:10.1145/3126686
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 October 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. curved screens
      2. depth maps
      3. image adaptation
      4. immersive effect

      Qualifiers

      • Research-article

      Funding Sources

      • Fonds Wetenschappelijk Onderzoek (FWO)
      • Vlaanderen

      Conference

      MM '17
      Sponsor:
      MM '17: ACM Multimedia Conference
      October 23 - 27, 2017
      California, Mountain View, USA

      Upcoming Conference

      MM '24
      The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)22
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 26 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2020)Reading on 3D Surfaces in Virtual Environments2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581590322523(721-728)Online publication date: Mar-2020
      • (2020)Building stereoscopic zoomer via global and local warping optimizationIEEE Transactions on Computational Imaging10.1109/TCI.2020.3042891(1-1)Online publication date: 2020
      • (2019)Immersiveness and Perceptibility of Convex and Concave DisplaysProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118131963114163:1(396-400)Online publication date: 20-Nov-2019
      • (2019)HoverInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2019.03.012129:C(95-107)Online publication date: 1-Sep-2019

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media