Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Handling occluders in transitions from panoramic images: A perceptual study

Published: 06 October 2009 Publication History

Abstract

Panoramic images are very effective at conveying a visual sense of presence at very low cost and great ease of authoring. They are, however, limited in the navigation options they offer, unlike 3D representations. It is therefore desirable to provide pleasing transitions from one panorama to another, or from a panorama to a 3D model. We focus on motions where the viewers move toward an area of interest, and on the problem of dealing with occluders in their path. We discuss existing transition approaches, with emphasis on the additional information they require and on the constraints they place on the authoring process. We propose a compromise approach based on faking the parallax effect with occluder mattes. We conduct a user study to determine whether additional information does in fact increase the visual appeal of transitions. We observe that the creation of occluder mattes alone is only justified if the fake parallax effect can be synchronized with the camera motion (but not necessarily consistent with it), and if viewpoint discrepancies at occlusion boundaries are small. The faster the transition, the less perceptual value there is in creating mattes. Information on view alignment is always useful, as a dissolve effect is always preferred to fading to black and back.

References

[1]
Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. In Proceedings of the Siggraph Computer Graphics Conference, K. Akeley, Ed. ACM Press/Addison Wesley Longman, 417--424.
[2]
Chiang, C.-C., Huang, A., Wang, T.-S., Huang, M., Chen, Y.-Y., Hsieh, J.-W., Chen, J.-W., and Cheng, T. 1997. Panovr sdk—A software development kit for integrating photo-realistic panoramic images and 3-d graphical objects into virtual worlds. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST'97). ACM, New York, 147--154.
[3]
Cohen, J. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd Ed.). Lawrence Erlbaum.
[4]
Criminisi, A., Reid, I., and Zisserman, A. 2000. Single view metrology. Int. J. Comput. Vis. V40, 2, 123--148.
[5]
Frueh, C., Sammon, R., and Zakhor, A. 2004. Automated texture mapping of 3d city models with oblique aerial imagery. In Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'04). IEEE Computer Society, Los Alamitos, CA, 396--403.
[6]
Gledhill, D., Tian, G., Taylor, D., and Clarke, D. 2003. Panoramic imaging—A review. Comput. Graph. 27, 435--445.
[7]
Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: Using a spidery mesh interface to make animation from a single image. In Proceedings of the 24th Annual SIGGRAPH Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing, New York, 225--232.
[8]
Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proceedings of the 4th Eurographics Symposium on Geometry Processing (SGP'06). Eurographics Association, 61--70.
[9]
Lowe, D. G. 1999. Object recognition from local scale-invariant features. In Proceedings of the International Conference on Computer Vision (ICCV). 1150--1157.
[10]
McMillan, L. and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. In Proceedings of the SIGGRAPH'95 Computer Graphics Conference. 39--46.
[11]
Müller, P., Zeng, G., Wonka, P., and Van Gool, L. 2007. Image-Based procedural modeling of facades. ACM Trans. Graph. 26, 3.
[12]
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S. J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., and Towles, H. 2008. Detailed real-time urban 3d reconstruction from video. Int. J. Comput. Vis. 78, 2-3, 143--167.
[13]
Snavely, N., Garg, R., Seitz, S. M., and Szeliski, R. 2008. Finding paths through the world's photos. In Proceedings of ACM SIGGRAPH Papers. ACM, New York, 1--11.
[14]
Snavely, N., Seitz, S. M., and Szeliski, R. 2007. Modeling the world from Internet photo collections. In Int. J. Comput. Vis. to appear.
[15]
Stich, T., Linz, C., Wallraven, C., Cunningham, D., and Magnor, M. 2008. Perception-Motivated interpolation of image sequences. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (APGV'08). ACM, New York, 97--106.
[16]
Vaina, L. M., Beardsley, S. A., and Rushton, S. K., Eds. 2004. Optic Flow and Beyond. Kluwer Academic Publishers, Norwell, MA.
[17]
Vincent, L. 2007. Taking online maps down to street level. Comput. 40, 12, 118--120.
[18]
Watanabe, M. and Nayar, S. K. 1998. Rational filters for passive depth from defocus. Int. J. Comput. Vis. 27, 3, 203--225.
[19]
Zhu, Z. and Hanson, A. R. 2001. 3d lamp: A new layered panoramic representation. In Proceedings of the International Conference on Computer Vision (ICCV'02), 723.

Cited By

View all
  • (2020)A Smooth Transition Algorithm for Adjacent Panoramic Viewpoints Using Matched Delaunay Triangular PatchesISPRS International Journal of Geo-Information10.3390/ijgi91005969:10(596)Online publication date: 10-Oct-2020
  • (2018)The Effect of Transition Type in Multi-View 360° MediaIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.279356124:4(1564-1573)Online publication date: 1-Apr-2018
  • (2017)Towards a Quality Metric for Dense Light Fields2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.396(3720-3729)Online publication date: Jul-2017
  • Show More Cited By

Index Terms

  1. Handling occluders in transitions from panoramic images: A perceptual study

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Applied Perception
      ACM Transactions on Applied Perception  Volume 6, Issue 4
      September 2009
      63 pages
      ISSN:1544-3558
      EISSN:1544-3965
      DOI:10.1145/1609967
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 06 October 2009
      Accepted: 01 August 2009
      Received: 01 July 2009
      Published in TAP Volume 6, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. User study
      2. content mixing
      3. occlusion
      4. panorama
      5. transitioning

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 03 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2020)A Smooth Transition Algorithm for Adjacent Panoramic Viewpoints Using Matched Delaunay Triangular PatchesISPRS International Journal of Geo-Information10.3390/ijgi91005969:10(596)Online publication date: 10-Oct-2020
      • (2018)The Effect of Transition Type in Multi-View 360° MediaIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.279356124:4(1564-1573)Online publication date: 1-Apr-2018
      • (2017)Towards a Quality Metric for Dense Light Fields2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.396(3720-3729)Online publication date: Jul-2017
      • (2013)Preference and artifact analysis for video transitions of placesACM Transactions on Applied Perception10.1145/250160110:3(1-19)Online publication date: 19-Aug-2013
      • (2013)Perception of perspective distortions in image-based renderingACM Transactions on Graphics10.1145/2461912.246197132:4(1-12)Online publication date: 21-Jul-2013
      • (2012)VideoscapesACM Transactions on Graphics10.1145/2185520.218556431:4(1-12)Online publication date: 1-Jul-2012
      • (2011)Perception of visual artifacts in image-based rendering of façadesProceedings of the Twenty-second Eurographics conference on Rendering10.1111/j.1467-8659.2011.01983.x(1241-1250)Online publication date: 27-Jun-2011
      • (2011)MetropolisProceedings of the 2011 Third International Conference on Games and Virtual Worlds for Serious Applications10.1109/VS-GAMES.2011.9(1-7)Online publication date: 4-May-2011

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media