Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Spatially varying image based lighting by light probe sequences

Capture, processing and rendering

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can capture the full dynamic range of the lighting incident at each point in space at video frame rates, while being moved through a scene. The real-time light probe uses a digital imaging system which we have programmed to capture high quality, photometrically accurate color images of 512×512 pixels with a dynamic range of 10000000:1 at 25 frames per second.

By tracking the position and orientation of the light probe, it is possible to transform each light probe into a common frame of reference in world coordinates, and map each point and direction in space along the path of motion to a particular frame and pixel in the light probe sequence. We demonstrate our technique by rendering synthetic objects illuminated by complex real world lighting, first by using traditional image based lighting methods and temporally varying light probe illumination, and second an extension to handle spatially varying lighting conditions across large objects and object motion along an extended path.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Adelson, E.H., Bergen, J.R.: Computational Models of Visual Processing, The Plenoptic Function and the Elements of Early Vision, chap. 1. MIT Press, Cambridge, MA (1991)

  2. Blinn, J.F.: Texture and reflection in computer generated images. Commun. ACM 19(10), 542–547 (1976)

    Article  Google Scholar 

  3. Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of SIGGRAPH 98 (1998)

  4. Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: Proceedings of SIGGRAPH 2000, pp. 145–156 (2000)

  5. Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of SIGGRAPH 97, pp. 369–378 (1997)

  6. Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. In: Proceedings of SIGGRAPH 96, pp. 43–54 (1996)

  7. Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. ACM Trans. Graph. 22(3), 319–325 (2003)

    Article  Google Scholar 

  8. Krawczyk, G., Goesele, M., Seidel, H.P.: Photometric Calibration of High Dynamic Range Cameras. Tech. Rep. Research Report MPI-I-2005-4-005 (2005)

  9. Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH 96, pp. 31–42 (1996)

  10. Madden, B.C.: Extended Intensity Range Imaging. Tech. Rep., GRASP Laboratory, University of Pennsylvania (1993)

  11. Mann, S., Picard, R.W.: Being undigital with digital cameras: Extending dynamic range by combining differently exposed pictures. In: Proceedings of IS&T 46th Annual Conference, pp. 422–428 (1995)

  12. Masselus, V., Peers, P., Dutre, P., Willems, Y.D.: Relighting with 4D incident light fields. ACM Trans. Graph. 22(3), 613–620 (2003)

    Article  Google Scholar 

  13. Miller, G.S., Hoffman, C.R.: Illumination and reflection maps: Simulated objects in simulated and real environments. In: SIGGRAPH 84 Course Notes for Advanced Computer Graphics Animation (1984)

  14. Mitsunaga, T., Nayar, S.: Radiometric self calibration. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 374–380 (1999)

  15. Nayar, S., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 472–479 (2000)

  16. Reinhard, E., Ward, G., Pattanaik, S., Debevec, P.: High Dynamic Range Imaging, Acquisition, Display and Image-Based Lighting. Morgan Kaufmann, San Francisco, CA (2006)

    Google Scholar 

  17. Robertson, M.A., Borman, S., Stevenson, R.L.: Dynamic range improvement through multiple exposures. In: IEEE International Conference on Image Processing, pp. 159–163 (1999)

  18. Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Visual. Comput. Graph. 5(1), 1–12 (1999)

    Article  Google Scholar 

  19. Swaminathan, R., Grossberg, M.D., Nayar, S.K.: Non-single viewpoint catadioptric cameras: geometry and analysis. Int. J. Comput. Vision 66(3), 211–229 (2006)

    Article  Google Scholar 

  20. Unger, J., Gustavson, S.: High-dynamic-range video for photometric measurement of illumination. In: Proceedings of Sensors, Cameras and Systems for Scientific/Industrial Applications X, IS&T/SPIE 19th International Symposium on Electronic Imaging, vol. 6501 (2007)

  21. Unger, J., Gustavson, S., Ollila, M., Johannesson, M.: A real time light probe. In: Proceedings of the 25th Eurographics Annual Conference, vol. Short Papers and Interactive Demos, pp. 17–21 (2004)

  22. Unger, J., Gustavson, S., Ynnerman, A.: Densely sampled light probe sequences for image based lighting. In: In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, vol. Conference Proceedings (2006)

  23. Unger, J., Wenger, A., Hawkins, T., Gardner, A., Debevec, P.: Capturing and rendering with incident light fields. In: EGRW ’03: Proceedings of the 14th Eurographics Workshop on Rendering, pp. 141–149. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2003)

  24. Waese, J., Debevec, P.: A real-time high dynamic range light probe. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques: Conference Abstracts and Applications, p. 247. ACM/Addison-Wesley, New York (2002)

  25. Ward, G.: Real pixels. In: Graphics Gems II, pp. 80–83 (1991)

Download references

Author information

Authors and Affiliations

  1. Visual Information Technology and Applications, VITA, Department of Science and Technology, Linköpings Universitet, Luntgatan 2, 60174, Norrköping, Sweden

    Jonas Unger, Stefan Gustavson & Anders Ynnerman

Authors
  1. Jonas Unger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefan Gustavson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anders Ynnerman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jonas Unger.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Unger, J., Gustavson, S. & Ynnerman, A. Spatially varying image based lighting by light probe sequences. Visual Comput 23, 453–465 (2007). https://doi.org/10.1007/s00371-007-0127-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-007-0127-6

Keywords

Search

Navigation