research-article

Virtual Cinematography: Relighting through Computation

Author:

Paul DebevecAuthors Info & Claims

Computer, Volume 39, Issue 8

Pages 57 - 65

https://doi.org/10.1109/MC.2006.285

Published: 01 August 2006 Publication History

Abstract

Recording how scenes transform incident illumination into radiant light is an active topic in computational photography. Such techniques make it possible to create virtual images of a person or place from new viewpoints and in any form of illumination.

References

[1]

S.K. Nayar, "Omnidirectional Vision," Proc. 8th Int'l Symp. Robotics Research, Springer, 1998, pp. 195–202;

[2]

E.H. Adelson and J.R. Bergen, "The Plenoptic Function and the Elements of Early Vision," M. Landy and J.A. Movshon, eds., Computational Models of Visual Processing, MIT Press, 1991, pp. 3–20.

[3]

L. McMillan and G. Bishop, "Plenoptic Modeling: An Image-Based Rendering System," Proc. 22nd Ann. Conf. Computer Graphics and Interactive Techniques, ACM Press, 1995, pp. 39–46.

Digital Library

[4]

M. Levoy, "Light Fields and Computational Imaging," Computer, Aug. 2006, pp. 46–55.

Digital Library

[5]

M. Levoy and P. Hanrahan, "Light Field Rendering," Proc. 23rd Ann. Conf. Computer Graphics and Interactive Techniques, ACM Press, 1996, pp. 31–42.

Digital Library

[6]

O. Bimber, "The Ultimate Display—What Will It Be?" Computer, Aug. 2005, pp. 28–29.

[7]

P. Haeberli, "Synthetic Lighting for Photography," Grafica Obscura, Jan. 1992;

[8]

IEEE Computer Graphics and Applications, vol. 15, no. 2, 1995, pp. 26–36.

Digital Library

[9]

P. Debevec et al., "Acquiring the Reflectance Field of a Human Face," Proc. 27th Ann. Conf. Computer Graphics and Interactive Techniques, ACM Press, 2000, pp. 145–156.

Digital Library

[10]

Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, Paul Debevec, Performance relighting and reflectance transformation with time-multiplexed illumination, ACM Transactions on Graphics (TOG), v.24 n.3, July 2005

[11]

A. Jones et al. "Performance Geometry Capture for Spatially Varying Relighting," tech. sketch, Proc. 32nd Int'l Conf. Computer Graphics and Interactive Techniques, 2005;

Digital Library

[12]

P. Einarsson et al., "Relighting Human Locomotion with Flowed Reflectance Fields," Proc. 17th Eurographics Symp. Rendering, Springer-Verlag, 2006.

Digital Library

[13]

P. Debevec et al., Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination, tech. report ICT-TR-06-2004, USC ICT, 2004;

[14]

Y.Y. Schechner, S.K. Nayar, and P. Belhumeur, "A Theory of Multiplexed Illumination," Proc. 9th Int'l Conf. Computer Vision, IEEE CS Press, 2003, pp. 808–815.

Digital Library

[15]

P. Peers and P. Dutré, "Inferring Reflectance Functions from Wavelet Noise," Proc. Eurographics Symp. Rendering Techniques, Eurographics Assoc., 2005, pp. 173–182.

Digital Library

[16]

P. Sen et al., "Dual Photography," ACM Trans. Graphics, vol. 24, no. 3, 2005, pp. 745–755.

Digital Library

Cited By

Philip JMorgenthaler SGharbi MDrettakis G(2021)Free-viewpoint Indoor Neural Relighting from Multi-view StereoACM Transactions on Graphics10.1145/346984240:5(1-18)Online publication date: 24-Sep-2021
https://dl.acm.org/doi/10.1145/3469842
Rakkolainen IRaisamo RTurk MHöllerer TMorishima SItoh YShiratori TYue YLindeman R(2018)Illumination for 360 degree camerasProceedings of the 24th ACM Symposium on Virtual Reality Software and Technology10.1145/3281505.3281589(1-2)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3281505.3281589
Tamura HMatsuyama TYokoya NIchikari RNobuhara SSato T(2010)Computer vision technology applied to MR-based pre-visualization in filmmakingProceedings of the 2010 international conference on Computer vision - Volume part II10.5555/2040739.2040741(1-10)Online publication date: 8-Nov-2010
https://dl.acm.org/doi/10.5555/2040739.2040741
Show More Cited By

Index Terms

Virtual Cinematography: Relighting through Computation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
2. Mathematics of computing
  1. Continuous mathematics
    1. Topology
      1. Geometric topology

Recommendations

Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics

Holograms display a 3D image in high resolution and allow viewers to focus freely as if looking through a virtual window, yet computer generated holography (CGH) hasn't delivered the same visual quality under plane wave illumination and due to heavy ...
Virtual Mirrors: Non-Line-of-Sight Imaging Beyond the Third Bounce

Non-line-of-sight (NLOS) imaging methods are capable of reconstructing complex scenes that are not visible to an observer using indirect illumination. However, they assume only third-bounce illumination, so they are currently limited to single-corner ...
A perceptually validated model for surface depth hallucination

Capturing detailed surface geometry currently requires specialized equipment such as laser range scanners, which despite their high accuracy, leave gaps in the surfaces that must be reconciled with photographic capture for relighting applications. Using ...

Comments

Information & Contributors

Information

Published In

cover image Computer

Computer Volume 39, Issue 8

August 2006

90 pages

ISSN:0018-9162

Issue’s Table of Contents

Copyright © 2006.

Publisher

IEEE Computer Society Press

Washington, DC, United States

Publication History

Published: 01 August 2006

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Philip JMorgenthaler SGharbi MDrettakis G(2021)Free-viewpoint Indoor Neural Relighting from Multi-view StereoACM Transactions on Graphics10.1145/346984240:5(1-18)Online publication date: 24-Sep-2021
https://dl.acm.org/doi/10.1145/3469842
Rakkolainen IRaisamo RTurk MHöllerer TMorishima SItoh YShiratori TYue YLindeman R(2018)Illumination for 360 degree camerasProceedings of the 24th ACM Symposium on Virtual Reality Software and Technology10.1145/3281505.3281589(1-2)Online publication date: 28-Nov-2018
https://dl.acm.org/doi/10.1145/3281505.3281589
Tamura HMatsuyama TYokoya NIchikari RNobuhara SSato T(2010)Computer vision technology applied to MR-based pre-visualization in filmmakingProceedings of the 2010 international conference on Computer vision - Volume part II10.5555/2040739.2040741(1-10)Online publication date: 8-Nov-2010
https://dl.acm.org/doi/10.5555/2040739.2040741
Chalmers AFerko AMyszkowski K(2008)Levels of realismProceedings of the 24th Spring Conference on Computer Graphics10.1145/1921264.1921272(19-25)Online publication date: 21-Apr-2008
https://dl.acm.org/doi/10.1145/1921264.1921272
Aliaga DHaines EMcGuire M(2008)Digital inspectionProceedings of the 2008 symposium on Interactive 3D graphics and games10.1145/1342250.1342258(53-60)Online publication date: 15-Feb-2008
https://dl.acm.org/doi/10.1145/1342250.1342258
Wang HLin SYe XGu W(2008)Separating corneal reflections for illumination estimationNeurocomputing10.1016/j.neucom.2007.07.03971:10-12(1788-1797)Online publication date: 1-Jun-2008
https://dl.acm.org/doi/10.1016/j.neucom.2007.07.039

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents