Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Image-Based Rendering from Uncalibrated Lightfields with Scalable Geometry

  • Conference paper
  • First Online:
Multi-Image Analysis

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2032))

Abstract

We combine uncalibrated Structure-from-Motion, lightfield rendering and view-dependent texture mapping to model and render scenes from a set of images that are acquired from an uncalibrated handheld video camera. The camera is simply moved by hand around the 3D scene of interest. The intrinsic camera parameters like focal length and the camera positions are automatically calibrated with a Structure-From-Motion approach. Dense and accurate depth maps for each camera viewpoint are computed with multi-viewpoint stereoscopic matching. The set of images, their calibration parameters and the depth maps are then utilized for depth-compensated image-based rendering. The rendering utilizes a scalable geometric approximation that is tailored to the needs of the rendering hardware.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. Beardsley, P. Torr and A. Zisserman: 3D Model Acquisition from Extended Image Sequences. ECCV 96, LNCS 1064, vol.2, pp.683–695. Springer 1996. 66 R. Koch, B. Heigl, and M. Pollefeys

    Google Scholar 

  2. P. Debevec, Y. Yu, G. Borshukov: E-cient View-Dependent Image-Based Rendering with Projective Texture Mapping. Proceedings SIGGRAPH’ 98, ACM Press, New York, 1998.

    Google Scholar 

  3. L. Falkenhagen: Hierarchical Block-Based Disparity Estimation Considering Neighborhood Constraints. Intern. Workshop on SNHC and 3D Imaging, Rhodes, Greece, Sept. 1997.

    Google Scholar 

  4. O. Faugeras: What can be seen in three dimensions with an uncalibrated stereo rig. Proc. ECCV’92, pp.563–578.

    Google Scholar 

  5. S. Gortler, R. Grzeszczuk, R. Szeliski, M. F. Cohen: The Lumigraph. Proceedings SIGGRAPH’ 96, pp 43–54, ACM Press, New York, 1996.

    Chapter  Google Scholar 

  6. R. Hartley: Estimation of relative camera positions for uncalibrated cameras. ECCV’92, pp.579–587.

    Google Scholar 

  7. R. Koch, M. Pollefeys, and L. Van Gool: Multi Viewpoint Stereo from Uncalibrated Video Sequences. Proc. ECCV’98, Freiburg, June 1998.

    Google Scholar 

  8. R. Koch, M. Pollefeys, B. Heigl, L. Van Gool, H. Niemann: Calibration of Handheld Camera Sequences for Plenoptic Modeling. Proc. of ICCV’99, Korfu, Greece, Sept. 1999.

    Google Scholar 

  9. R. Koch, M. Pollefeys and L. Van Gool: Robust Calibration and 3D Geometric Modeling from Large Collections of Uncalibrated Images. Proceedings DAGM’99, Bonn, Sept. 1999.

    Google Scholar 

  10. M. Levoy, P. Hanrahan: Light-field Rendering. Proceedings SIGGRAPH’ 96, pp 31–42, ACM Press, New York, 1996.

    Chapter  Google Scholar 

  11. L. McMillan and G. Bishop, “Plenoptic modeling: An image-based rendering system”, Proc. SIGGRAPH’95, pp. 39–46, 1995.

    Google Scholar 

  12. M. Pollefeys, R. Koch, M. Vergauwen and L. Van Gool: Metric 3D Surface Reconstruction from Uncalibrated Image Sequences. In: 3D Structure from Multiple Images of Large Scale Environments. LNCS Series Vol. 1506, pp. 139–154. Springer-Verlag, 1998.

    Chapter  Google Scholar 

  13. M. Pollefeys, R. Koch and L. Van Gool: Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters. Int. Journal of Computer Vision 32(1), 7–27 (1999), Kluver 1999.

    Article  Google Scholar 

  14. P.H.S. Torr: Motion Segmentation and Outlier Detection. PhD thesis, University of Oxford, UK, 1995.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Koch, R., Heigl, B., Pollefeys, M. (2001). Image-Based Rendering from Uncalibrated Lightfields with Scalable Geometry. In: Klette, R., Gimel’farb, G., Huang, T. (eds) Multi-Image Analysis. Lecture Notes in Computer Science, vol 2032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45134-X_4

Download citation

  • DOI: https://doi.org/10.1007/3-540-45134-X_4

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42122-1

  • Online ISBN: 978-3-540-45134-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics