research-article

Optimizing content-preserving projections for wide-angle images

Authors:

Robert Carroll,

Maneesh Agrawal,

Aseem AgarwalaAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 28, Issue 3

Article No.: 43, Pages 1 - 9

https://doi.org/10.1145/1531326.1531349

Published: 27 July 2009 Publication History

Abstract

Any projection of a 3D scene into a wide-angle image unavoidably results in distortion. Current projection methods either bend straight lines in the scene, or locally distort the shapes of scene objects. We present a method that minimizes this distortion by adapting the projection to content in the scene, such as salient scene regions and lines, in order to preserve their shape. Our optimization technique computes a spatially-varying projection that respects user-specified constraints while minimizing a set of energy terms that measure wide-angle image distortion. We demonstrate the effectiveness of our approach by showing results on a variety of wide-angle photographs, as well as comparisons to standard projections.

Supplementary Material

JPG File (tps032_09.jpg)

Download
6.99 KB

Zip (43-423.zip)

supplemental.zip contains a directory with a website (html and images) of additional results from the paper.

Download
81.65 MB

MP4 File (tps032_09.mp4)

Download
88.92 MB

References

[1]

Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., and Szeliski, R. 2006. Photographing long scenes with multi-viewpoint panoramas. ACM Trans. on Graph. 25, 3 (July), 853--861.

Digital Library

[2]

Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Trans. on Graph. 26, 3 (July), 10:1--10:9.

Digital Library

[3]

Bradski, G., and Kaehler, A. 2008. Learning OpenCV: Computer Vision with the OpenCV Library. O'Reilly, Cambridge, MA.

[4]

Brown, M., and Lowe, D. G. 2003. Recognising panoramas. In International Conference on Computer Vision (ICCV), 1218--1227.

Digital Library

[5]

Durand, F. 2002. An invitation to discuss computer depiction. In NPAR 2002: Second International Symposium on Non Photorealistic Rendering, 111--124.

Digital Library

[6]

Flocon, A., and Barre, A. 1988. Curvilinear Perspective: From Visual Space to the Constructed Image. UC Press.

[7]

Forsyth, D. A., and Ponce, J. 2002. Computer Vision: A Modern Approach. Prentice Hall, August.

Digital Library

[8]

Gal, R., Sorkine, O., and Cohen-Or, D. 2006. Feature-aware texturing. In Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, 297--304.

Digital Library

[9]

Heckbert, P. S. 1989. Fundamentals of texture mapping and image warping. Tech. Rep. UCB/CSD-89-516, EECS Department, University of California, Berkeley, Jun.

Digital Library

[10]

Hilbert, D., and Cohn-Vossen, S. 1952. Geometry and the Imagination. Chelsea, New York.

[11]

Igarashi, T., Moscovich, T., and Hughes, J. F. 2005. As-rigid-as-possible shape manipulation. ACM Trans. on Graph. 24, 3 (Aug.), 1134--1141.

Digital Library

[12]

Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 11, 1254--1259.

Digital Library

[13]

Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Trans. on Graph. 26, 3 (July), 93:1--93:10.

Digital Library

[14]

Kubovy, M. 1986. The psychology of perspective and renaissance art. Cambridge University Press.

[15]

L&#233;vy, B., Petitjean, S., Ray, N., andMaillot, J. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. 21, 3, 362--371.

Digital Library

[16]

Longfellow, W. 1901. Applied Perspective for Architects and Painters. The Riverside Press.

[17]

Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. The MIT Press.

[18]

Sadourny, R., Arakawa, A., and Mintz, Y. 1968. Integration of the non-divergent barotropic vorticity equation with an icosahedral-hexagonal grid for the sphere. Monthly Weather Review 96 (June), 351--356.

[19]

Schaefer, S., McPhail, T., and Warren, J. 2006. Image deformation using moving least squares. ACM Trans. on Graph. 25, 3 (July), 533--540.

Digital Library

[20]

Schenk, O., and G&#228;rtner, K. 2004. Solving unsymmetric sparse systems of linear equations with pardiso. Journal of Future Generation Computer Systems 20, 3, 475--487.

Digital Library

[21]

Sheffer, A., Praun, E., and Rose, K. 2006. Mesh parameterization methods and their applications. Found. Trends. Comput. Graph. Vis. 2, 2, 105--171.

Digital Library

[22]

Snyder, J. P. 1985. Computer-assisted map projection research: U.S. Geological Survey Bulletin 1629. U.S. Gov. Printing Office.

[23]

Snyder, J. P. 1987. Map Projections -- A Working Manual: U.S. Geological Survey Prof. Paper 1395. U.S. Gov. Printing Office.

[24]

Snyder, J. P. 1993. Flattening the Earth, two thousand years of map projections. University of Chicago Press.

[25]

Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2003. Automatic thumbnail cropping and its effectiveness. In Proc. UIST, 95--104.

Digital Library

[26]

Szeliski, R., and Shum, H.-Y. 1997. Creating full view panoramic mosaics and environment maps. In Proc. SIGGRAPH, 251--258.

Digital Library

[27]

Viola, P., and Jones, M. J. 2004. Robust real-time face detection. International Journal of Computer Vision 57, 2, 137--154.

Digital Library

[28]

Vishwanath, D., Girshick, A., and Banks, M. 2005. Why pictures look right when viewed from the wrong place. Naure Neuroscience 8, 10, 1401.

[29]

Wang, Y.-S., Tai, C.-L., Sorkine, O., and Lee, T.-Y. 2008. Optimized scale-and-stretch for image resizing. ACM Trans. on Graph. 27, 5 (Dec.), 118:1--118:8.

Digital Library

[30]

Wolf, L., Guttmann, M., and Cohen-Or, D. 2007. Non-homogeneous content-driven video-retargeting. In IEEE International Conference on Computer Vision.

[31]

Zeki, S. 2001. Artistic creativity and the brain. Science 293, 5527, 51--52.

[32]

Zelnik-Manor, L., Peters, G., and Perona, P. 2005. Squaring the circles in panoramas. In IEEE International Conference on Computer Vision (ICCV), vol. 2, 1292--1299.

Digital Library

[33]

Zorin, D., and Barr, A. H. 1995. Correction of geometric perceptual distortion in pictures. In Proc. SIGGRAPH, 257--264.

Digital Library

Cited By

Hertzmann A(2024)Toward a theory of perspective perception in picturesJournal of Vision10.1167/jov.24.4.2324:4(23)Online publication date: 25-Apr-2024
https://doi.org/10.1167/jov.24.4.23
Lee SYoon JHo Lee J(2024)Modeling Practical Multi-Center-of-Projection Using EllipsoidIEEE Access10.1109/ACCESS.2024.345150212(122328-122339)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3451502
Jabar FAscenso JQueluz M(2024)Globally and Locally Optimized Pannini Projection for High FoV Rendering of 360° ImagesSignal Processing: Image Communication10.1016/j.image.2024.117190(117190)Online publication date: Aug-2024
https://doi.org/10.1016/j.image.2024.117190
Show More Cited By

Index Terms

Optimizing content-preserving projections for wide-angle images
1. Computing methodologies
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry
    2. Random projections and metric embeddings

Recommendations

Optimizing content-preserving projections for wide-angle images
SIGGRAPH '09: ACM SIGGRAPH 2009 papers

Any projection of a 3D scene into a wide-angle image unavoidably results in distortion. Current projection methods either bend straight lines in the scene, or locally distort the shapes of scene objects. We present a method that minimizes this ...
Enhanced Locality Preserving Projections
CSSE '08: Proceedings of the 2008 International Conference on Computer Science and Software Engineering - Volume 01

In pattern recognition, feature extraction techniques are widely employed to reduce the dimensionality of data. In this paper, a new manifold learning algorithm, called Enhanced Locality Preserving Projections, to identify the underlying manifold ...
Locality Preserving Projections
NIPS'03: Proceedings of the 16th International Conference on Neural Information Processing Systems

Many problems in information processing involve some form of dimensionality reduction. In this paper, we introduce Locality Preserving Projections (LPP). These are linear projective maps that arise by solving a variational problem that optimally ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 28, Issue 3

August 2009

750 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1531326

Issue’s Table of Contents

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2009

Published in TOG Volume 28, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

90
Total Citations
View Citations
2,046
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hertzmann A(2024)Toward a theory of perspective perception in picturesJournal of Vision10.1167/jov.24.4.2324:4(23)Online publication date: 25-Apr-2024
https://doi.org/10.1167/jov.24.4.23
Lee SYoon JHo Lee J(2024)Modeling Practical Multi-Center-of-Projection Using EllipsoidIEEE Access10.1109/ACCESS.2024.345150212(122328-122339)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3451502
Jabar FAscenso JQueluz M(2024)Globally and Locally Optimized Pannini Projection for High FoV Rendering of 360° ImagesSignal Processing: Image Communication10.1016/j.image.2024.117190(117190)Online publication date: Aug-2024
https://doi.org/10.1016/j.image.2024.117190
Chen QWei ZTan XShen HMeng C(2023)A New Method for WFOV Camera Distortion Correction2023 WRC Symposium on Advanced Robotics and Automation (WRC SARA)10.1109/WRCSARA60131.2023.10261831(21-26)Online publication date: 19-Aug-2023
https://doi.org/10.1109/WRCSARA60131.2023.10261831
Hold-Geoffroy YPiché-Meunier DSunkavalli KBazin JRameau FLalonde J(2023)A Perceptual Measure for Deep Single Image Camera and Lens CalibrationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.326964145:9(10603-10614)Online publication date: 1-Sep-2023
https://doi.org/10.1109/TPAMI.2023.3269641
Zhang QLi HWang Q(2023)Wide-Angle Rectification via Content-Aware Conformal Mapping2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01665(17357-17365)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01665
Hertzmann A(2022)The choices hidden in photographyJournal of Vision10.1167/jov.22.11.1022:11(10)Online publication date: 17-Oct-2022
https://doi.org/10.1167/jov.22.11.10
Liu SAgrawala MDiVerdi SHertzmann A(2022)ZoomShop: Depth‐Aware Editing of Photographic CompositionComputer Graphics Forum10.1111/cgf.1445841:2(57-70)Online publication date: 24-May-2022
https://doi.org/10.1111/cgf.14458
Lai WShih YLiang CYang M(2022)Correcting Face Distortion in Wide-Angle VideosIEEE Transactions on Image Processing10.1109/TIP.2021.313104731(366-378)Online publication date: 2022
https://doi.org/10.1109/TIP.2021.3131047
Hu XAn YShao CHu H(2022)Distortion Convolution Module for Semantic Segmentation of Panoramic Images Based on the Image-Forming PrincipleIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2021.313971071(1-12)Online publication date: 2022
https://doi.org/10.1109/TIM.2021.3139710
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents