Article

Open access

Plenoptic modeling: an image-based rendering system

Authors:

Leonard McMillan,

Gary BishopAuthors Info & Claims

SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques

Pages 39 - 46

https://doi.org/10.1145/218380.218398

Published: 15 September 1995 Publication History

Abstract

Image-based rendering is a powerful new approach for generating real-time photorealistic computer graphics. It can provide convincing animations without an explicit geometric representation. We use the "plenoptic function" of Adelson and Bergen to provide a concise problem statement for image-based rendering paradigms, such as morphing and view interpolation. The plenoptic function is a parameterized function for describing everything that is visible from a given point in space. We present an image-based rendering system based on sampling, reconstructing, and resampling the plenoptic function. In addition, we introduce a novel visible surface algorithm and a geometric invariant for cylindrical projections that is equivalent to the epipolar constraint defined for planar projections.

Supplementary Material

PS File (p39-mcmillan.ps)

Download
3.80 MB

References

[1]

Adelson, E. H., and J. R. Bergen, "The Plenoptic Function and the Elements of Early Vision," Computational Models of Visual Proeessing, Chapter 1, Edited by Michael Landy and J. Anthony Movshon. The MIT Press, Cambridge, Mass. 1991.

[2]

Anderson, D., "Hidden Line Elimination in Projected Grid Surfaces," ACM Transactions on Graphics, October 1982.

Digital Library

[3]

Barnard, S.T. "A Stochastic Approach to Stereo Vision," SRI International, Technical Note 373, April 4, 1986.

[4]

Beier, T. and S. Neely, "Feature-Based Image Metamorphosis," Computer Graphics (SIGGRAPH'92 Proceedings), Vol. 26, No. 2, pp. 35-42, July 1992.

Digital Library

[5]

Blinn, J. F. and M. E. Newell, "Texture and Reflection in Computer Generatedlmages," Communications oftheACM, vol. 19, no. 10, pp. 542-547, October 1976.

Digital Library

[6]

Bolles, R. C., H. H. Baker, and D. H. Marimont, "Epipolar-Plane Image Analysis: An Approach to Determining Structure from Motion," International Journal of Computer Vision, Vol. 1, 1987.

[7]

Catmull, E., "A Subdivision Algorithm for Computer Display of Curved Surfaces" (Ph. D. Thesis), Department of Computer Science, University of Utah, Tech. Report UTEC-CSc-74-133, December 1974.

[8]

Chen, S. E. and L. Williams. "View Interpolation for Image Synthesis," Computer Graphics (SIGGRAPH'93 Proceedings), pp. 279-288, July 1993.

Digital Library

[9]

Faugeras, O., Three-dimensional Computer Vision: A Geometric Viewpoint, The MIT Press, Cambridge, Massachusetts, 1993.

Digital Library

[10]

Greene, N., "Environment Mapping and Other Applications of World Projections," IEEE Computer Graphics and Applications, November 1986.

Digital Library

[11]

Hartley, R.I., "Self-Calibration from Multiple Views with a Rotating Camera," Proceedings of the European Conference on Computer Vision, May 1994.

Digital Library

[12]

Heckbert, P. S., "Fundamentals of Texture Mapping and Image Warping," Masters Thesis, Dept. of EECS, UCB, Technical Report No. UCB/CSD 89/516, June 1989.

[13]

Horn, B., and B.G. Schunck, "Determining Optical Flow," Artificial Intelligence, Vol. 17, 1981.

Digital Library

[14]

Kanatani, K., "Transformation of Optical Flow by Camera Rotation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 10, No. 2, March 1988.

Digital Library

[15]

Laveau, S. and O. Faugeras, "3-D Scene Representation as a Collection of Images and Fundamental Matrices," INRIA, Technical Report No. 2205, February, 1994.

[16]

Lenz, R. K. and R. Y. Tsai, "Techniques for Calibration ofthe Scale Factor and Image Center for High Accuracy 3D Machine Vision Metrology," Proceedings of IEEE International Conference on Robotics and Automation, March 31 - April 3, 1987.

[17]

Lippman, A., "Movie-Maps: An Application of the Optical Videodisc to Computer Graphics," SIGGRAPH '80 Proceedings, 1980.

Digital Library

[18]

Longuet-Higgins, H. C., "A Computer Algorithm for Reconstructing a Scene from Two Projections," Nature, Vol. 293, September 1981.

[19]

Longuet-Higgins, H. C., "The Reconstruction of a Scene From Two Projections - Configurations That Defeat the 8-Point Algorithm," Proceedings of the First IEEE Conference on Artificial Intelligence Applications, Dec 1984.

[20]

Lucas, B., and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, 1981.

[21]

McMillan, Leonard, "A List-Priority Rendering Algorithm for Redisplaying Projected Surfaces," Department of Computer Science, UNC, Technical Report TR95-005, 1995.

Digital Library

[22]

Mann, S. and R. W. Picard, "Virtual Bellows: Constructing High Quality Stills from Video," Proceedings of the First IEEE International Conference on Image Processing, November 1994.

[23]

Press, W. H., B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes in C, Cambridge University Press, Cambridge, Massachusetts, pp. 309-317, 1988.

[24]

Regan, M., and R. Pose, "Priority Rendering with a Virtual Reality Address Recalculation Pipeline," SIGGRAPH'94 Proceedings, 1994.

Digital Library

[25]

Szeliski, R., "Image Mosaicing for Tele-Reality Applications," DEC and Cambridge Research Lab Technical Report, CRL 94/ 2, May 1994.

[26]

Tomasi, C., and T. Kanade, "Shape and Motion from Image Streams: a Factorization Method; Full Report on the Orthographic Case," Technical Report, CMU-CS-92-104, Carnegie Mellon University, March 1992.

Digital Library

[27]

Tsai, R. Y., "A Versatile Camera Calibration Technique for High- Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Cameras and Lenses," IEEE Journal of Robotics and Automation, Vol. RA-3, No. 4, August 1987.

[28]

Westover, L. A., "Footprint Evaluation for Volume Rendering," SIGGRAPH'90 Proceedings, August 1990.

Digital Library

[29]

Wolberg, G., Digital Image Warping, IEEE Computer Society Press, Los Alamitos, CA, 1990.

Digital Library

Cited By

ZHANG Runnan 张ZHOU Ning 周ZHOU Zihao 周DU Heheng 杜CHEN Qian 陈ZUO Chao 左(2024)光场表征及其分辨率提升技术：文献综述及最新进展(特邀)Infrared and Laser Engineering10.3788/IRLA2024034753:9(20240347)Online publication date: 2024
https://doi.org/10.3788/IRLA20240347
Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Jiang KFu YVarma T MBelhe YWang XSu HRamamoorthi R(2024)A Construct-Optimize Approach to Sparse View Synthesis without Camera PoseACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657427(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657427
Show More Cited By

Index Terms

Plenoptic modeling: an image-based rendering system
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Image manipulation
    2. Rendering
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Random projections and metric embeddings

Recommendations

Plenoptic Modeling: An Image-Based Rendering System
Seminal Graphics Papers: Pushing the Boundaries, Volume 2

Image-based rendering is a powerful new approach for generating real-time photorealistic computer graphics. It can provide convincing animations without an explicit geometric representation. We use the "plenoptic function" of Adelson and Bergen to ...
Plenoptic sampling
SIGGRAPH '00: Proceedings of the 27th annual conference on Computer graphics and interactive techniques

This paper studies the problem of plenoptic sampling in image-based rendering (IBR). From a spectral analysis of light field signals and using the sampling theorem, we mathematically derive the analytical functions to determine the minimum sampling rate ...
Plenoptic Layer-Based Modeling for Image Based Rendering

Image based rendering is an attractive alternative to model based rendering for generating novel views because of its lower complexity and potential for photo-realistic results. To reduce the number of images necessary for alias-free rendering, some ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '95: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques

September 1995

520 pages

ISBN:0897917014

DOI:10.1145/218380

Editors:
Susan G. Mair
Univ. of British Columbia, Vancouver, Canada
,
Robert Cook

Seminal Graphics Papers: Pushing the Boundaries, Volume 2
August 2023
893 pages
ISBN:9798400708978
DOI:10.1145/3596711
Editor:
Mary C. Whitton
Department of Computer Science, UNC Chapel Hill, USA

Copyright © 1995 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 1995

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Seminal Paper

Qualifiers

Article

Conference

SIGGRAPH95

Sponsor:

SIGGRAPH

SIGGRAPH95: 22nd International ACM Conference on Computer Graphics and Interactive Techniques

Acceptance Rates

SIGGRAPH '95 Paper Acceptance Rate 56 of 257 submissions, 22%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

691
Total Citations
View Citations
5,683
Total Downloads

Downloads (Last 12 months)337
Downloads (Last 6 weeks)59

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

ZHANG Runnan 张ZHOU Ning 周ZHOU Zihao 周DU Heheng 杜CHEN Qian 陈ZUO Chao 左(2024)光场表征及其分辨率提升技术：文献综述及最新进展(特邀)Infrared and Laser Engineering10.3788/IRLA2024034753:9(20240347)Online publication date: 2024
https://doi.org/10.3788/IRLA20240347
Guindy MKara P(2024)Lessons Learned from Implementing Light Field Camera Animation: Implications, Limitations, Potentials, and Future Research EffortsMultimodal Technologies and Interaction10.3390/mti80800688:8(68)Online publication date: 1-Aug-2024
https://doi.org/10.3390/mti8080068
Jiang KFu YVarma T MBelhe YWang XSu HRamamoorthi R(2024)A Construct-Optimize Approach to Sparse View Synthesis without Camera PoseACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657427(1-11)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657427
Georgiou YLoizou MKelly TAverkiou M(2024)FacadeNet: Conditional Facade Synthesis via Selective Editing2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00530(5372-5381)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00530
Chalmers AZaman FRhee T(2024)Avatar360: Emulating 6-DoF Perception in 360°Panoramas through Avatar-Assisted Navigation2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00083(630-638)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00083
Popescu VSacks ECui JAshok R(2024)Efficient and Robust From-Point VisibilityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329113830:8(5313-5327)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3291138
Wang HHu WZhu LLau R(2024)Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01890(19999-20008)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.01890
Kara PSimon A(2023)The Good News, the Bad News, and the Ugly Truth: A Review on the 3D Interaction of Light Field DisplaysMultimodal Technologies and Interaction10.3390/mti70500457:5(45)Online publication date: 27-Apr-2023
https://doi.org/10.3390/mti7050045
Fink LStrobel SFranke LStamminger M(2023)Efficient Rendering for Light Field Displays using Tailored Projective MappingsProceedings of the ACM on Computer Graphics and Interactive Techniques10.1145/35854986:1(1-17)Online publication date: 16-May-2023
https://dl.acm.org/doi/10.1145/3585498
Mühlhausen MKappel MKassubeck MWöhler LGrogorick SCastillo SEisemann MMagnor M(2023)Immersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo VideoComputer Graphics Forum10.1111/cgf.1479642:6Online publication date: 14-Apr-2023
https://doi.org/10.1111/cgf.14796
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents