research-article

A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation

Authors:

Xiao-Ping Zhang,

Xinghao DingAuthors Info & Claims

IEEE Transactions on Image Processing, Volume 24, Issue 12

Pages 4965 - 4977

https://doi.org/10.1109/TIP.2015.2474701

Published: 01 December 2015 Publication History

Abstract

In this paper, a new probabilistic method for image enhancement is presented based on a simultaneous estimation of illumination and reflectance in the linear domain. We show that the linear domain model can better represent prior information for better estimation of reflectance and illumination than the logarithmic domain. A maximum a posteriori (MAP) formulation is employed with priors of both illumination and reflectance. To estimate illumination and reflectance effectively, an alternating direction method of multipliers is adopted to solve the MAP problem. The experimental results show the satisfactory performance of the proposed method to obtain reflectance and illumination with visually pleasing enhanced results and a promising convergence rate. Compared with other testing methods, the proposed method yields comparable or better results on both subjective and objective assessments.

References

[1]

E. H. Land and J. J. McCann, “Lightness and Retinex theory,” J. Opt. Soc. Amer., vol. 61, no. 1, pp. 1–11, 1971.

[2]

Z.-U. Rahman, D. J. Jobson, and G. A. Woodell, “Retinex processing for automatic image enhancement,” J. Electron. Imag., vol. 13, no. 1, pp. 100–110, 2004.

[3]

D. J. Jobson, Z.-U. Rahman, and G. A. Woodell, “Properties and performance of a center/surround Retinex,” IEEE Trans. Image Process., vol. 6, no. 3, pp. 451–462, Mar. 1997.

Digital Library

[4]

Y.-O. Nam, D.-Y. Choi, and B. C. Song, “Power-constrained contrast enhancement algorithm using multiscale Retinex for OLED display,” IEEE Trans. Image Process., vol. 23, no. 8, pp. 3308–3320, Aug. 2014.

[5]

S. Wang, J. Zheng, H.-M. Hu, and B. Li, “Naturalness preserved enhancement algorithm for non-uniform illumination images,” IEEE Trans. Image Process., vol. 22, no. 9, pp. 3538–3548, Sep. 2013.

Digital Library

[6]

H. Ahn, B. Keum, D. Kim, and H. S. Lee, “Adaptive local tone mapping based on Retinex for high dynamic range images,” in Proc. IEEE Int. Conf. Consum. Electron., Jan. 2013, pp. 153–156.

[7]

B. Gu, W. Li, M. Zhu, and M. Wang, “Local edge-preserving multiscale decomposition for high dynamic range image tone mapping,” IEEE Trans. Image Process., vol. 22, no. 1, pp. 70–79, Jan. 2013.

Digital Library

[8]

L. Meylan and S. Susstrunk, “High dynamic range image rendering with a Retinex-based adaptive filter,” IEEE Trans. Image Process., vol. 15, no. 9, pp. 2820–2830, Sep. 2006.

Digital Library

[9]

S. Pan, X. An, and H. He, “Adapting iterative Retinex computation for high-dynamic-range tone mapping,” J. Electron. Imag., vol. 22, no. 2, pp. 023006-1–023006-10, 2013.

[10]

B. J. Lee and B. C. Song, “Local tone mapping using sub-band decomposed multi-scale Retinex for high dynamic range images,” in Proc. IEEE Int. Conf. Consum. Electron., Jan. 2014, pp. 125–128.

[11]

X. Lan, H. Shen, L. Zhang, and Q. Yuan, “A spatially adaptive Retinex variational model for the uneven intensity correction of remote sensing images,” Signal Process., vol. 101, pp. 19–34, Aug. 2014.

Digital Library

[12]

C. Li, F. Li, C.-Y. Kao, and C. Xu, “Image segmentation with simultaneous illumination and reflectance estimation: An energy minimization approach,” in Proc. IEEE 12th Int. Conf. Comput. Vis., Kyoto, Japan, Sep./Oct. 2009, pp. 702–708.

[13]

Y. Liu, R. R. Martin, L. de Dominicis, and B. Li, “Using Retinex for point selection in 3D shape registration,” Pattern Recognit., vol. 47, no. 6, pp. 2126–2142, 2014.

Digital Library

[14]

C. Jung, T. Sun, and L. Jiao, “Eye detection under varying illumination using the Retinex theory,” Neurocomputing, vol. 113, pp. 130–137, Aug. 2013.

Digital Library

[15]

E. H. Land, “The Retinex,” Amer. Sci., vol. 52, no. 2, pp. 247–253 and 255–264, 1964.

[16]

E. H. Land, “The Retinex theory of color vision,” Sci. Amer., vol. 237, no. 6, pp. 108–128, Dec. 1977.

[17]

E. Provenzi, L. De Carli, A. Rizzi, and D. Marini, “Mathematical definition and analysis of the Retinex algorithm,” J. Opt. Soc. Amer. A, vol. 22, no. 12, pp. 2613–2621, 2005.

[18]

E. H. Land, “Recent advances in Retinex theory and some implications for cortical computations: Color vision and the natural image,” Proc. Nat. Acad. Sci., vol. 80, no. 16, pp. 5163–5169, 1983.

[19]

E. H. Land, “Recent advances in Retinex theory,” Vis. Res., vol. 26, no. 1, pp. 7–21, 1986.

[20]

J. McCann, “Lessons learned from mondrians applied to real images and color gamuts,” in Proc. IS&T/SID 7th Color Imag. Conf., 1999, pp. 1–8.

[21]

B. Funt, F. Ciurea, and J. McCann, “Retinex in MATLAB,” J. Electron. Imag., vol. 13, no. 1, pp. 48–57, 2004.

[22]

B. K. P. Horn, “Determining lightness from an image,” Comput. Graph. Image Process., vol. 3, no. 4, pp. 277–299, 1974.

[23]

A. Hurlbert, “Formal connections between lightness algorithms,” J. Opt. Soc. Amer. A, vol. 3, no. 10, pp. 1684–1693, 1986.

[24]

J. M. Morel, A. B. Petro, and C. Sbert, “A PDE formalization of Retinex theory,” IEEE Trans. Image Process., vol. 19, no. 11, pp. 2825–2837, Nov. 2010.

Digital Library

[25]

A. Blake, “Boundary conditions for lightness computation in Mondrian world,” Comput. Vis., Graph., Image Process., vol. 32, no. 3, pp. 314–327, 1985.

[26]

D. Terzopoulos, “Image analysis using multigrid relaxation methods,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 2, pp. 129–139, Mar. 1986.

Digital Library

[27]

B. V. Funt, M. S. Drew, and M. Brockington, “Recovering shading from color images,” in Proc. 2nd Eur. Conf. Comput. Vis., 1992, pp. 124–132.

[28]

D. J. Jobson, Z.-U. Rahman, and G. A. Woodell, “A multiscale Retinex for bridging the gap between color images and the human observation of scenes,” IEEE Trans. Image Process., vol. 6, no. 7, pp. 965–976, Jul. 1997.

Digital Library

[29]

R. Kimmel, M. Elad, D. Shaked, R. Keshet, and I. Sobel, “A variational framework for Retinex,” Int. J. Comput. Vis., vol. 52, no. 1, pp. 7–23, 2003.

Digital Library

[30]

M. K. Ng and W. Wang, “A total variation model for Retinex,” SIAM J. Imag. Sci., vol. 4, no. 1, pp. 345–365, 2011.

Digital Library

[31]

W. Wang and M. K. Ng, “A nonlocal total variation model for image decomposition: Illumination and reflectance,” Numer. Math., Theory, Methods, Appl., vol. 7, no. 3, pp. 334–355, 2014.

[32]

D. Zosso, G. Tran, and S. Osher, “A unifying Retinex model based on non-local differential operators,” Proc. SPIE, Comput. Imag. XI, pp. 865702-1–865702-16, Feb. 2013.

[33]

D. Zosso, G. Tran, and S. J. Osher, “Non-local Retinex—A unifying framework and beyond,” SIAM J. Imag. Sci., vol. 8, no. 2, pp. 787–826, 2015.

Digital Library

[34]

M. Bertalmío, V. Caselles, and E. Provenzi, “Issues about Retinex theory and contrast enhancement,” Int. J. Comput. Vis., vol. 83, no. 1, pp. 101–119, 2009.

Digital Library

[35]

R. Palma-Amestoy, E. Provenzi, M. Bertalmío, and V. Caselles, “A perceptually inspired variational framework for color enhancement,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 458–474, Mar. 2009.

Digital Library

[36]

M. Bertalmío, V. Caselles, E. Provenzi, and A. Rizzi, “Perceptual color correction through variational techniques,” IEEE Trans. Image Process., vol. 16, no. 4, pp. 1058–1072, Apr. 2007.

Digital Library

[37]

L. Wang, L. Xiao, H. Liu, and Z. Wei, “Variational Bayesian method for Retinex,” IEEE Trans. Image Process., vol. 23, no. 8, pp. 3381–3396, Aug. 2014.

[38]

W. F. Schreiber, Fundamentals of Electronic Imaging Systems. Berlin, Germany: Springer-Verlag, 1986.

[39]

T. Goldstein and S. Osher, “The split Bregman method for L1-regularized problems,” SIAM J. Imag. Sci., vol. 2, no. 2, pp. 323–343, 2009.

Digital Library

[40]

S. Osher, M. Burger, D. Goldfarb, J. Xu, and W. Yin, “An iterative regularization method for total variation-based image restoration,” Multiscale Model. Simul., vol. 4, no. 2, pp. 460–489, 2005.

[41]

R. Hummel, “Image enhancement by histogram transformation,” Comput. Graph. Image Process., vol. 6, no. 2, pp. 184–195, 1977.

[42]

P. Getreuer, “Automatic color enhancement (ACE) and its fast implementation,” Imag. Process. Line, vol. 2, pp. 266–277, Nov. 2012.

[43]

A. A. Michelson, Studies in Optics. Chicago, IL, USA: Chicago Univ. Press, 1995.

[44]

A. Mittal, R. Soundararajan, and A. C. Bovik, “Making a ‘completely blind’ image quality analyzer,” IEEE Signal Process. Lett., vol. 20, no. 3, pp. 209–212, Mar. 2013.

[45]

X. Zhang and B. A. Wandell, “A spatial extension of CIELAB for digital color image reproduction,” in SID Int. Symp. Dig. Tech. Papers, vol. 27. 1996, pp. 731–734.

Cited By

Luo SChen XChen WLi ZWang SPun CWooldridge MDy JNatarajan S(2024)DevignetProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i5.28193(4000-4008)Online publication date: 20-Feb-2024
https://dl.acm.org/doi/10.1609/aaai.v38i5.28193
Yang WGao HZou WLiu THuang SMa JGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Low-Light Image Enhancement via Weighted Low-Rank Tensor Regularized Retinex ModelProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658008(767-775)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658008
Xu RLi YNiu YXu HChen YZhao T(2024)Bilateral Interaction for Local-Global Collaborative Perception in Low-Light Image EnhancementIEEE Transactions on Multimedia10.1109/TMM.2024.341329326(10792-10804)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3413293
Show More Cited By

Index Terms

A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
  2. Computer graphics
    1. Image manipulation
    2. Rendering
2. Mathematics of computing

Index terms have been assigned to the content through auto-classification.

Recommendations

Filtering and Rendering of Resolution-Dependent Reflectance Models

The apparent reflectance of a surface depends upon the resolution at which it is imaged. Conventional reflectance models represent reflection at a single predetermined resolution; however, a low-resolution pixel that views a greater surface area often ...
Contrast enhancement based on reflectance-oriented probabilistic equalization
Abstract
Despite advances in contrast enhancement, it remains difficult to adaptively improve both the global contrast (base structures) and the local contrast (detailed textures) of an image. To solve this problem, we first propose a novel 2D ...
Illumination estimation for nature preserving low-light image enhancement
Abstract
In retinex model, images are considered as a combination of two components: illumination and reflectance. However, decomposing an image into the illumination and reflectance is an ill-posed problem. This paper presents a new approach to estimate ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Image Processing

IEEE Transactions on Image Processing Volume 24, Issue 12

Dec. 2015

1399 pages

ISSN:1057-7149

Issue’s Table of Contents

Copyright © 2015.

Publisher

IEEE Press

Publication History

Published: 01 December 2015

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

97
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Luo SChen XChen WLi ZWang SPun CWooldridge MDy JNatarajan S(2024)DevignetProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i5.28193(4000-4008)Online publication date: 20-Feb-2024
https://dl.acm.org/doi/10.1609/aaai.v38i5.28193
Yang WGao HZou WLiu THuang SMa JGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Low-Light Image Enhancement via Weighted Low-Rank Tensor Regularized Retinex ModelProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658008(767-775)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658008
Xu RLi YNiu YXu HChen YZhao T(2024)Bilateral Interaction for Local-Global Collaborative Perception in Low-Light Image EnhancementIEEE Transactions on Multimedia10.1109/TMM.2024.341329326(10792-10804)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3413293
Wang XHuang LChen HJiang QWeng SShao F(2024)Benchmark Dataset and Pair-Wise Ranking Method for Quality Evaluation of Night-Time Image EnhancementIEEE Transactions on Multimedia10.1109/TMM.2024.339190726(9436-9449)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3391907
Wu KHuang JMa YFan FMa J(2024)Cycle-Retinex: Unpaired Low-Light Image Enhancement via Retinex-Inline CycleGANIEEE Transactions on Multimedia10.1109/TMM.2023.327838526(1213-1228)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3278385
Zhou MWu XWei XXiang TFang BKwong S(2024)Low-Light Enhancement Method Based on a Retinex Model for Structure PreservationIEEE Transactions on Multimedia10.1109/TMM.2023.326886726(650-662)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3268867
Hu CYi WHu KGuo YJing XLiu P(2024)FHSI and QRCPE-Based Low-Light Enhancement With Application to Night Traffic Monitoring ImagesIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2023.334279925:7(6978-6993)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TITS.2023.3342799
Wang HZhang JLiu MWu XZuo W(2024)Learning Diverse Tone Styles for Image RetouchingIEEE Transactions on Image Processing10.1109/TIP.2023.334052233(310-321)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2023.3340522
Sun GXiong ZYuan Y(2024)Detail-Preserving and Diverse Image Translation for Adverse Visual Object DetectionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.339814534:10_Part_1(9139-9152)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1109/TCSVT.2024.3398145
Zhang YTeng BYang DChen ZMa HLi GDing W(2024)Learning a Single Convolutional Layer Model for Low Light Image EnhancementIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.334369634:7(5995-6008)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TCSVT.2023.3343696
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents