article

Flash photography enhancement via intrinsic relighting

Authors:

Elmar Eisemann,

Frédo DurandAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 23, Issue 3

Pages 673 - 678

https://doi.org/10.1145/1015706.1015778

Published: 01 August 2004 Publication History

Abstract

We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral filter to decompose the images into detail and large scale. We reconstruct the image using the large scale of the available lighting and the detail of the flash. We detect and correct flash shadows. This combines the advantages of available illumination and flash photography.

Supplementary Material

MOV File (pps056.mov)

Download
11.66 KB

References

[1]

AKERS, LOSASSO, KLINGNER, AGRAWALA, RICK, AND HANRAHAN. 2003. Conveying shape and features with image-based relighting. In Visualization.

Digital Library

[2]

ASHIKHMIN. 2002. A tone mapping algorithm for high contrast images. In Eurographics Workshop on Rendering, 145--156.

Digital Library

[3]

BARROW, AND TENENBAUM. 1978. Recovering intrinsic scene characteristics from images. In Computer Vision Systems. Academic Press.

Digital Library

[4]

CHIU, HERF, SHIRLEY, SWAMY, WANG, AND ZIMMERMAN. 1993. Spatially nonuniform scaling functions for high contrast images. In Graphics Interface.

[5]

CHOUDHURY, AND TUMBLIN. 2003. The trilateral filter for high contrast images and meshes. In Eurographics Symposium on Rendering.

Digital Library

[6]

COHEN, COLBURN, AND DRUCKER. 2003. Image stacks. Tech. Rep. 40, MSR.

[7]

DEBEVEC, AND MALIK. 1997. Recovering high dynamic range radiance maps from photographs. In Proc. SIGGRAPH.

Digital Library

[8]

DICARLO, J., AND WANDELL, B. 2000. Rendering high dynamic range images. Proc. SPIE: Image Sensors 3965, 392--401.

[9]

DICARLO, J. M., XIAO, F., AND WANDELL, B. A. 2001. Illuminating illumination. In 9th Color Imaging Conference, 27--34.

[10]

DURAND, AND DORSEY. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. on Graphics 21, 3.

Digital Library

[11]

GAUBATZ, AND ULICHNEY. 2002. Automatic red-eye detection and correction. In IEEE Int. Conf. on Image Processing.

[12]

HOPPE, AND TOYAMA. 2003. Continuous flash. Tech. Rep. 63, MSR.

[13]

JOBSON, RAHMAN, AND WOODELL. 1997. A multi-scale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. on Image Processing 6, 965--976.

Digital Library

[14]

KANG, UYTTENDAELE, WINDER, AND SZELISKI. 2003. High dynamic range video. ACM Trans. on Graphic 22, 3.

Digital Library

[15]

MANN, AND PICARD. 1995. Being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proc. IS&T 46th ann. conference.

[16]

MARSCHNER, AND GREENBERG. 1997. Inverse lighting for photography. In Proc. IS&T/SID 5th Color Imaging Conference.

[17]

OH, CHEN, DORSEY, AND DURAND. 2001. Image-based modeling and photo editing. In Proc. SIGGRAPH.

Digital Library

[18]

PETSCHNIGG, AGRAWALA, HOPPE, SZELISKI, COHEN, AND TOYAMA. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. on Graphics in this volume.

Digital Library

[19]

RASKAR, ILIE, AND YU. 2004. Image fusion for context enhancement. In Proc. NPAR.

Digital Library

[20]

REINHARD, STARK, SHIRLEY, AND FERWERDA. 2002. Photographic tone reproduction for digital images. ACM Trans. on Graphics, 21, 3.

Digital Library

[21]

SATO, SATO, AND IKEUCHI. 1999. Illumination distribution from brightness in shadows: Adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In ICCV.

[22]

SMITH, S. M., AND BRADY, J. M. 1997. SUSAN - a new approach to low level image processing. IJCV 23, 45--78.

Digital Library

[23]

TAPPEN, M. F., FREEMAN, W. T., AND ADELSON, E. H. 2003. Recovering intrinsic images from a single image. In NIPS.

[24]

TOMASI, C., AND MANDUCHI, R. 1998. Bilateral filtering for gray and color images. In ICCV, 836--846.

Digital Library

[25]

TUMBLIN, AND TURK. 1999. Lcis: A boundary hierarchy for detail-preserving contrast reduction. In Proc. SIGGRAPH.

Digital Library

[26]

TUMBLIN, HODGINS, AND GUENTER. 1999. Two methods for display of high contrast images. ACM Trans. on Graphics 18, 1.

Digital Library

[27]

WARD. 2004. Fast, robust image registration for compositing high dynamic range photographs from handheld exposures. J. of Graphics Tools 8, 2.

[28]

WEISS. 2001. Deriving intrinsic images from image sequences. In ICCV.

[29]

YU, DEBEVEC, MALIK, AND HAWKINS. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs from. In Proc. SIGGRAPH.

Digital Library

[30]

ZHANG, AND LENDERS. 2000. Knowledge-based eye detection for human face recognition,. In Conf. on Knowledge-based Intelligent Systems and Allied Technologies.

Cited By

He Tianyue 贺Kou Tingdong 寇Zhang Qican 张Chen Wenjing 陈Shen Junfei 申(2024)计算成像技术在信息复原及增强中的研究进展（特邀）Laser & Optoelectronics Progress10.3788/LOP23252561:2(0211033)Online publication date: 2024
https://doi.org/10.3788/LOP232525
Lo CVandewalle P(2024)Expanding Sparse Radar Depth Based on Joint Bilateral Filter for Radar-Guided Monocular Depth EstimationSensors10.3390/s2406186424:6(1864)Online publication date: 14-Mar-2024
https://doi.org/10.3390/s24061864
Nogami HKanetaka YNaganawa YMaeda YFukushima N(2024)Decomposed Multilateral Filtering for Accelerating Filtering with Multiple Guidance ImagesSensors10.3390/s2402063324:2(633)Online publication date: 19-Jan-2024
https://doi.org/10.3390/s24020633
Show More Cited By

Recommendations

Digital photography with flash and no-flash image pairs

Digital photography has made it possible to quickly and easily take a pair of images of low-light environments: one with flash to capture detail and one without flash to capture ambient illumination. We present a variety of applications that analyze and ...
Flash photography enhancement via intrinsic relighting
SIGGRAPH '04: ACM SIGGRAPH 2004 Papers

We enhance photographs shot in dark environments by combining a picture taken with the available light and one taken with the flash. We preserve the ambiance of the original lighting and insert the sharpness from the flash image. We use the bilateral ...
Interactive relighting with dynamic BRDFs

We present a technique for interactive relighting in which source radiance, viewing direction, and BRDFs can all be changed on the fly. In handling dynamic BRDFs, our method efficiently accounts for the effects of BRDF modification on the reflectance ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 23, Issue 3

August 2004

684 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1015706

Editor:
John C. Hart

Issue’s Table of Contents

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2004

Published in TOG Volume 23, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

472
Total Citations
View Citations
3,005
Total Downloads

Downloads (Last 12 months)160
Downloads (Last 6 weeks)5

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

He Tianyue 贺Kou Tingdong 寇Zhang Qican 张Chen Wenjing 陈Shen Junfei 申(2024)计算成像技术在信息复原及增强中的研究进展（特邀）Laser & Optoelectronics Progress10.3788/LOP23252561:2(0211033)Online publication date: 2024
https://doi.org/10.3788/LOP232525
Lo CVandewalle P(2024)Expanding Sparse Radar Depth Based on Joint Bilateral Filter for Radar-Guided Monocular Depth EstimationSensors10.3390/s2406186424:6(1864)Online publication date: 14-Mar-2024
https://doi.org/10.3390/s24061864
Nogami HKanetaka YNaganawa YMaeda YFukushima N(2024)Decomposed Multilateral Filtering for Accelerating Filtering with Multiple Guidance ImagesSensors10.3390/s2402063324:2(633)Online publication date: 19-Jan-2024
https://doi.org/10.3390/s24020633
FUKATSU MYOSHIZAWA STAKEMURA HYOKOTA H(2024)Fast Scale-Aware Image Filtering via Half-Box Regions半矩形領域を用いた高速スケール対応画像フィルタJournal of the Japan Society for Precision Engineering10.2493/jjspe.90.31390:3(313-320)Online publication date: 5-Mar-2024
https://doi.org/10.2493/jjspe.90.313
Gu ZYang EDavis A(2024)Filter-Guided Diffusion for Controllable Image GenerationACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657489(1-10)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657489
Naganawa YKamei HKanetaka YNogami HMaeda YFukushima N(2024)SIMD-Constrained Lookup Table for Accelerating Variable-Weighted Convolution on x86/64 CPUsIEEE Access10.1109/ACCESS.2024.335472012(15800-15819)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3354720
P. AE.P. J(2024)Edge preserving infrared and visible image fusion with three layer decomposition based on multi-level co-occurrence filteringInfrared Physics & Technology10.1016/j.infrared.2024.105336(105336)Online publication date: May-2024
https://doi.org/10.1016/j.infrared.2024.105336
Hou YNie LLin CGuo BZhao Y(2024)Digging into depth-adaptive structure for guided depth super-resolutionDisplays10.1016/j.displa.2024.10275284(102752)Online publication date: Sep-2024
https://doi.org/10.1016/j.displa.2024.102752
Bao ZFu GChen ZXiao C(2024)Illuminator: Image-based illumination editing for indoor scene harmonizationComputational Visual Media10.1007/s41095-023-0397-6Online publication date: 5-Jul-2024
https://doi.org/10.1007/s41095-023-0397-6
Liu WZhang PQin HHuang XYang JNg M(2024)Fast Global Image Smoothing via Quasi Weighted Least SquaresInternational Journal of Computer Vision10.1007/s11263-024-02105-8Online publication date: 13-Jul-2024
https://doi.org/10.1007/s11263-024-02105-8
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents