Abstract
In this contribution we focus on plenoptic scene modeling and rendering from long image sequences taken with a hand-held camera. The image sequence is calibrated with a structure-from-motion approach that considers the special viewing geometry of plenoptic scenes. By applying a stereo matching technique, dense depth maps are recovered locally for each viewpoint.
View-dependent rendering can be accomplished by mapping all images onto a common plane of mean geometry and weighting them in dependence on the actual position of a virtual camera. To improve accuracy, approximating planes are defined locally in a hierarchical refinement process. Their pose is calculated from the local depth maps associated with each view without requiring a consistent global representation of scene geometry. Extensive experiments with ground truth data and hand-held sequences confirm performance and accuracy of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
L. Falkenhagen. Hierarchical block-based disparity estimation considering neighborhood constraints. In Intern. Workshop on SNHC and 3D Imaging, Rhodes, Greece, 1997.
O. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig. In Proceedings ECCV’92, pages 563–578. Springer, 1992.
O. Faugeras, Q.-T. Luong, and S. Maybank. Camera self-calibration - theory and experiments. In Proceedings ECCV’92, pages 321–334. Springer, 1992.
S. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Proceedings SIGGRAPH’96, pages 43–54. ACM Press, 1996.
R. Hartley. Estimation of relative camera positions for uncalibrated cameras. In Proceedings ECCV’92, pages 579–587, 1992.
R. Koch, M. Pollefeys, and L. Van Gool. Multi viewpoint stereo from uncalibrated video sequences. In Proceedings ECCV’981998.
R. Koch, M. Pollefeys, and L. Van Gool. Robust calibration and 3d geometric modeling from large collections of uncalibrated images. In Mustererkennung’99, 1999.
R. Koch, M. Pollefeys, B. Heigl, L. Van Gool, and H. Niemann. Calibration of hand-held camera sequences for plenoptic modeling. In Proceedings ICCV’99, 1999. to appear.
M. Levoy and P. Hanrahan. Lightfield rendering. In Proceedings SIGGRAPH ’96, pages 31–42. ACM Press, 1996.
L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In Proceedings SIGGRAPH’95, pages 39 - 46, 1995.
M. Pollefeys, R. Koch, and L. Van Gool. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. In Proceedings ICCV’98, Bombay, India, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Heigl, B., Koch, R., Pollefeys, M., Denzler, J., Van Gool, L. (1999). Plenoptic Modeling and Rendering from Image Sequences Taken by a Hand-Held Camera. In: Förstner, W., Buhmann, J.M., Faber, A., Faber, P. (eds) Mustererkennung 1999. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-60243-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-60243-6_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66381-2
Online ISBN: 978-3-642-60243-6
eBook Packages: Springer Book Archive