Article

Optimized image sampling for view and light interpolation

Authors:

Prabath Gunawardane,

Tom MalzbenderAuthors Info & Claims

VAST'09: Proceedings of the 10th International conference on Virtual Reality, Archaeology and Cultural Heritage

Pages 93 - 100

Published: 22 September 2009 Publication History

Abstract

Accurate virtual reconstruction of real world objects has long been a desired goal of image-based computer graphics. Usually this involves a lengthy capture process where an object is photographed from different viewpoints and illumination conditions. Using this collection of input images, we can now re-render the object from any viewing angle or lighting condition. However, acquiring a dense sampling of both the lighting and view space is time consuming. We carry out an analysis on this combined lighting and view space to find the optimal sampling given a restricted image budget. We also analyze the order of interpolation and find that improved results are obtained by interpolating first in viewpoint and second in lighting, the reverse of the usual order.

References

[1]

AVIDAN S., SHASHUA A.: Novel view synthesis in tensor space. In CVPR (1997). 1

Digital Library

[2]

BUEHLER C., BOSSE M., MCMILLAN, GORTLER S., COHEN M.: Unstructured lumigraph rendering. In Siggraph (2001). 2

Digital Library

[3]

CHAI J.-X., CHAN S.-C., SHUM H.-Y., TONG X.: Plenoptic sampling. In Siggraph (2000). 1

Digital Library

[4]

CHEN S. E., WILLIAMS L.: View interpolation for image synthesis. In Siggraph (1993). 1

Digital Library

[5]

DEBEVEC P., BOSHOKOV G., YU Y.: Efficient view-dependent image-based rendering with projective texturemapping. In Eurographics Rendering Workshop (1998). 1

Digital Library

[6]

DEBEVEC P., HAWKINS T., TCHOU C., DUIKER H.- P., SAROKIN W., SAGAR M.: Acquiring the reflectance field of a human face. In Siggraph (2000). 2

Digital Library

[7]

EINARSSON P., CHABERT C. F., JONES A., MA W. C., LAMOND B., HAWKINS T., BOLAS M., SYLWAN S., DEBEVEC P.: Relighting human locomotion with flowed reflectance fields. In Eurographics Workshop on Rendering (2006). 1, 2, 3, 5

Digital Library

[8]

FUCHS M., LENSCH H. P. A., BLANZ V., SEIDEL H. P.: Superresolution reflectance fields: Synthesizing images for intermediate light directions. Comp. Graph. Forum (2007). 2

[9]

GORTLER S. J., GRZESZCZUK R., SZELISKI R., COHEN M. F.: The lumigraph. In Siggraph (1996). 2

Digital Library

[10]

GARG G., TALVALA E.-V., LEVOY M., LENSCH H.: Symmetric photography: Exploiting data-sparseness in reflectanec fields. In Eurographics Symposium on Rendering (2006). 2

Digital Library

[11]

GEORGIEV T., ZHENG K. C., CURLESS B., SALESIN D., NAYAR S., INTWALA C.: Spatio-angular resolution tradeoffs in integral photography. In EurographicsWorkshop on Rendering (2006). 1

Digital Library

[12]

HERTZMANN A., SEITZ S. M.: Example-based photometric stereo: Shape reconstruction with general, varying BRDFs. IEEE Transactions on Pattern Analysis and Machine Intelligence (2005). 2

Digital Library

[13]

LEVOY M., HANRAHAN P.: Light field rendering. In Siggraph (1996). 1

Digital Library

[14]

LENSCH H. P. A., KAUTZ J., GOESELE M., HEIDRICH W., SEIDEL H.-P.: Image-based reconstruction of spatial appearance and geometric detail. ACM Trans. Graph. (2003). 2

Digital Library

[15]

LIN Z., WONG T.-T., SHUM H.-Y.: Relighting with the reflected irradiance field: Representation, sampling and reconstruction. Int. J. Comput. Vision (2002). 2

Digital Library

[16]

MALZBENDER T., GELB D., WOLTERS H.: Polynomial texture maps. In Siggraph (2001). 2

Digital Library

[17]

MATSUSHITA Y., KANG S. B., LIN S., SHUM H.-Y., TONG X.: Lighting interpolation by shadow morphing using intrinsic lumigraphs. In Pacific Conference on Computer Graphics and Applications (2002). 2

Digital Library

[18]

MÜLLER G., MESETH J., SATTLER M., SARLETTE R., KLEIN R.: Acquisition, synthesis and rendering of bidirectional texture functions. Computer Graphics Forum (2005). 2

[19]

MASSELUS V., PEERS P., DUTRÉ P., WILLEMS Y. D.: Smooth reconstruction and compact representation of reflectance functions for image-based relighting. In Eurographics Workshop on Rendering (2004). 2

[20]

MATUSIK W., PFISTER H., NGAN A., BEARDSLEY P., ZIEGLER R., MCMILLAN L.: Image-based 3D photography using opacity hulls. ACM Trans. Graph. (2002). 2, 5

Digital Library

[21]

MARSCHNER S. R., WESTIN S. H., LAFORTUNE E. P., TORRANCE K. E., GREENBERG D. P.: Image-based brdf measurement including human skin. In Eurographics Workshop on Rendering (1999). 2

Digital Library

[22]

NG R., RAMAMOORTHI R., HANRAHAN P.: Triple product wavelet integrals for all-frequency relighting. In Siggraph (2004). 2

Digital Library

[23]

OGALE A. S., ALOIMONOS Y.: Shape and the stereo correspondence problem. Int. J. Comput. Vision (2005). 3

Digital Library

[24]

RAMAMOORTHI R., ENRIQUE S., BELHUMEUR P. N.: Reflectance sharing: Predicting appearance from a sparse set of images of a known shape. IEEE Trans. Pattern Anal. Mach. Intell. (2006). 2

Digital Library

[25]

SEITZ S. M., DYER C. R.: Physically-Valid View Synthesis by Image Interpolation. In Workshop on Representation of Visual Scenes (1995). 1

Digital Library

[26]

SEITZ S., DYER C.: Photorealistic scene reconstruction by voxel coloring. Int. J. Comput. Vision (1999). 1

Digital Library

[27]

SHUM H., KANG S.: A review of image-based rendering techniques. In IEEE/SPIE Visual Communications and Image Processing (2000). 1

[28]

SLOAN P.-P., KAUTZ J., SNYDER J.: Precomputed radiance transfer for real-time rendering in dynamic, lowfrequency lighting environments. ACM Trans. Graph. (2002). 2

Digital Library

[29]

VOGIATZIS G., HERNANDEZ C., CIPOLLA R.: Reconstruction in the round using photometric normals and silhouettes. In CVPR (2006). 2

Digital Library

[30]

WOOD D. N., AZUMA D. I., ALDINGER K., CURLESS B., DUCHAMP T., SALESIN D. H., STUETZLE W.: Surface light fields for 3D photography. In Siggraph (2000). 2

Digital Library

[31]

WANG Z., BOVIK A., SHEIKH H., SIMONCELLI E.: Image quality assessment: From error measurement to structural similarity. IEEE Trans. Image Processing (2004). 4

Digital Library

[32]

WENGER A., GARDNER A., TCHOU C., UNGER J., HAWKINS T., DEBEVEC P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. (2005). 2

Digital Library

[33]

WANG R., TRAN J., LUEBKE D.: All-frequency interactive relighting of translucent objects with single and multiple scattering. ACM Trans. Graph. (2005). 2

Digital Library

[34]

YU T., XU N., AHUJA N.: Shape and view independent reflectance map from multiple views. Int. J. Comp. Vision (2007). 2

Digital Library

[35]

ZHANG Z.: Flexible camera calibration by viewing a plane from unknown orientations. ICCV (1999). 2

[36]

ZITNICK C. L., KANG S. B., UYTTENDAELE M., WINDER S., SZELISKI R.: High-quality video view interpolation using a layered representation. ACM Trans. Graph. (2004). 1

Digital Library

Cited By

Pintus RPal KYang YWeyrich TGobbetti ERushmeier H(2016)A Survey of Geometric Analysis in Cultural HeritageComputer Graphics Forum10.1111/cgf.1266835:1(4-31)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1111/cgf.12668
Pintus RPal KYang YWeyrich TGobbetti ERushmeier HFellner DScopigno R(2014)Geometric analysis in cultural heritageProceedings of the Eurographics Workshop on Graphics and Cultural Heritage10.5555/2854922.2854940(117-133)Online publication date: 6-Oct-2014
https://dl.acm.org/doi/10.5555/2854922.2854940
Schwartz CRuiters RWeinmann MKlein R(2013)WebGL-based streaming and presentation of objects with bidirectional texture functionsJournal on Computing and Cultural Heritage 10.1145/2499931.24999326:3(1-21)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1145/2499931.2499932
Show More Cited By

Index Terms

Optimized image sampling for view and light interpolation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition

Recommendations

Light Field Sampling
Opacity light fields: interactive rendering of surface light fields with view-dependent opacity
I3D '03: Proceedings of the 2003 symposium on Interactive 3D graphics

We present new hardware-accelerated techniques for rendering surface light fields with opacity hulls that allow for interactive visualization of objects that have complex reflectance properties and elaborate geometrical details. The opacity hull is a ...
Multi-view ambient occlusion with importance sampling
I3D '13: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games

Screen-space ambient occlusion and obscurance (AO) techniques have become de-facto methods for ambient light attenuation and contact shadows in real-time rendering. Although extensive research has been conducted to improve the quality and performance of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VAST'09: Proceedings of the 10th International conference on Virtual Reality, Archaeology and Cultural Heritage

September 2009

148 pages

ISBN:9783905674187

Editors:
Kurt Debattista
University of Warwick
,
Cinzia Perlingieri
University of California at Berkeley
,
Denis Pitzalis
The Cyprus Institute - STARC
,
Sandro Spina
University of Malta

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
EPOCH: EU IST NoE "EPOCH"
EUROGRAPHICS: The European Association for Computer Graphics
UM: University of Malta
Heritage Malta: Heritage Malta

Publisher

Eurographics Association

Goslar, Germany

Publication History

Published: 22 September 2009

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pintus RPal KYang YWeyrich TGobbetti ERushmeier H(2016)A Survey of Geometric Analysis in Cultural HeritageComputer Graphics Forum10.1111/cgf.1266835:1(4-31)Online publication date: 1-Feb-2016
https://dl.acm.org/doi/10.1111/cgf.12668
Pintus RPal KYang YWeyrich TGobbetti ERushmeier HFellner DScopigno R(2014)Geometric analysis in cultural heritageProceedings of the Eurographics Workshop on Graphics and Cultural Heritage10.5555/2854922.2854940(117-133)Online publication date: 6-Oct-2014
https://dl.acm.org/doi/10.5555/2854922.2854940
Schwartz CRuiters RWeinmann MKlein R(2013)WebGL-based streaming and presentation of objects with bidirectional texture functionsJournal on Computing and Cultural Heritage 10.1145/2499931.24999326:3(1-21)Online publication date: 5-Aug-2013
https://dl.acm.org/doi/10.1145/2499931.2499932
Schwartz CRuiters RWeinmann MKlein R(2011)WebGL-based streaming and presentation framework for bidirectional texture functionsProceedings of the 12th International conference on Virtual Reality, Archaeology and Cultural Heritage10.5555/2384495.2384514(113-120)Online publication date: 18-Oct-2011
https://dl.acm.org/doi/10.5555/2384495.2384514
Schwartz CWeinmann MRuiters RKlein R(2011)Integrated high-quality acquisition of geometry and appearance for cultural heritageProceedings of the 12th International conference on Virtual Reality, Archaeology and Cultural Heritage10.5555/2384495.2384500(25-32)Online publication date: 18-Oct-2011
https://dl.acm.org/doi/10.5555/2384495.2384500
Aliaga DBertino EValtolina S(2011)DECHO—a framework for the digital exploration of cultural heritage objectsJournal on Computing and Cultural Heritage 10.1145/1921614.19216193:3(1-26)Online publication date: 11-Feb-2011
https://dl.acm.org/doi/10.1145/1921614.1921619

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

Media

Figures

Other

Tables

View Table of Contents