NSDIE: Noise Suppressing Dark Image Enhancement Using Multiscale Retinex and Low-Rank Minimization
Article No.: 160, Pages 1 - 22
Abstract
It is inevitable for dark images to have crucial information obscured by low-light conditions, which are worsened by the presence of noise in these images. This work introduces a groundbreaking solution, Noise-Suppressing Dark Image Enhancement for Web Apps (NSDIE), to address the challenging task of enhancing low-light images marred by noise. The proposed work utilizes a low-rank model with simultaneous enhancement of reflectance and illumination components to improve the nighttime scenes while also eradicating the present noise of the image. The reflectance component is further processed using a multiscale retinex model to compensate for the possible color distortions while the illumination component is enhanced using the camera response model to ensure the genuineness of the scene. The proposed work is also tested for a standalone application and is presented to the user through a web portal to aid the concerns of dark image enhancement in the daily life of the user. Rigorous quantitative and qualitative analyses assert NSDIE's superiority over existing techniques, establishing its pivotal role in addressing the critical concern of dark image enhancement.
References
[1]
G. Zhai, W. Sun, X. Min, and J. Zhou. 2021. Perceptual quality assessment of low-light image enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17, 4 (2021), 1–24.
[2]
X. Xu, S. Wang, Z. Wang, X. Zhang, and R. Hu. 2021. Exploring image enhancement for salient object detection in low light images. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 17, 1s (2021), 1–19.
[3]
S. Hao, X. Han, Y. Guo, and M. Wang. 2022. Decoupled low-light image enhancement. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 18, 4 (2022), 1–19.
[4]
M. Zhou, H. Leng, B. Fang, T. Xiang, X. Wei, and W. Jia. 2023. Low-light image enhancement via a frequency-based model with structure and texture decomposition. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 19, 6 (2023), 1–23.
[5]
K. Srinivas and A. K. Bhandari. 2023. Context-based novel histogram bin stretching algorithm for automatic contrast enhancement. ACM Transactions on Multimedia Computing, Communications and Applications 19, 6 (2023), 1–24.
[6]
S. H. Majeed and N. A. M. Isa. 2021. Adaptive entropy index histogram equalization for poor contrast images. In IEEE Access 9 (2021), 6402–6437.
[7]
X. Wu, T. Kawanishi and K. Kashino. 2021. Reflectance-Guided histogram equalization and comparametric approximation. In IEEE Transactions on Circuits and Systems for Video Technology 31, 3 (March 2021), 863–876.
[8]
S. M. Pizer, R. E. Johnston, J. P. Ericksen, B. C. Yankaskas, and K. E. Muller. 1990. Contrast-limited adaptive histogram equalization: Speed and effectiveness. Proc. IEEE Conf. Visual. Biomed.Comput. 337–345.
[9]
Y. Wang, Q. Chen, and B. Zhang. 1999. Image enhancement based on equal area dualistic sub-image histogram equalization method. IEEE Transactions on Consumer Electronics 45, 1 (1999), 68–75.
[10]
Q. Wang and R. K. Ward. 2007. Fast image/video contrast enhancement based on weighted thresholded histogram equalization. IEEE Trans. Consum. Electron. 53, 2 (2007), 757–764.
[11]
X.-Y. Kong, L. Liu, and Y.-S. Qian. 2021. Low-Light image enhancement via poisson noise aware retinex model. In IEEE Signal Processing Letters 28 (2021), 1540–1544.
[12]
D. J. Jobson, Z. Rahman, and G. A. Woodell. 1997. Properties and performance of a center/surround Retinex. IEEE Trans. Image Processing 6, 3 (1997), 451–462.
[13]
D. J. Jobson, Z. Rahman, and G. A. Woodell. 1997. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans. Image Process. 6, 7 (Jul. 1997), 965–976.
[14]
S. C. Agrawal and A. S. Jalal. 2022. Dense haze removal by nonlinear transformation. In IEEE Transactions on Circuits and Systems for Video Technology 32, 2 (Feb. 2022), 593–607.
[15]
X. Fu, D. Zeng, Y. Huang, X.-P. Zhang, and X. Ding. 2016. A weighted variational model for simultaneous reflectance and illumination estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2782–2790. DOI:
[16]
X. Guo, Y. Li, and H. Ling. 2017. Lime: Low-light image enhancement via illumination map estimation. IEEE Transactions on Image Processing 26, 2 (2017), 982–993.
[17]
X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, and J. Paisley. 2016. A fusion- based enhancing method for weakly illuminated images. Signal Process. 129 (Dec. 2016), 82–96.
[18]
M. Li, J. Liu, W. Yang, X. Sun, and Z. Guo. 2018. Structure-revealing lowlight image enhancement via robust retinex model. IEEE Trans. Image Process. 27, 6 (Jun. 2018), 2828–2841.
[19]
S. Mann. 2000. Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans. Image Processing 9, 8 (2000), 1389–1406.
[20]
X. Ren, W. Yang, W.-H. Cheng and J. Liu. 2020. LR3M: Robust Low-Light enhancement via low-rank regularized retinex model. IEEE Transactions on Image Processing 29 (2020), 5862–5876. DOI:
[21]
Y. Ren, Z. Ying, T. H. Li, and G. Li. 2019. LECARM: Low-light image enhancement using the camera response model. IEEE Transactions on Circuits and Systems for Video Technology 29, 4 (April 2019), 968–981.
[22]
Z. Ying, G. Li, and W. Gao. 2017. ‘A bio-inspired multi-exposure fusion framework for low-light image enhancement. 2017, arXiv:1711.00591.
[23]
J. Cai, S. Gu, and L. Zhang. 2018. Learning a deep single image contrast enhancer from multi-exposure images. IEEE Transactions on Image Processing 27, 4 (April 2018), 2049–2062.
[24]
W. Yang, W. Wang, H. Huang, S. Wang, and J. Liu. 2021. Sparse gradient regularized deep retinex network for robust low-light image enhancement. IEEE Transactions on Image Processing 30 (2021), 2072–2086. DOI:
[25]
M. Tanaka, T. Shibata, and M. Okutomi. 2019. Gradient-based low-light image enhancement. IEEE International Conference on Consumer Electronics (ICCE), 2019, 1–2. DOI:
[26]
J. Cai, S. Gu and L. Zhang. 2018. Learning a deep single image contrast enhancer from multi-exposure images. IEEE Transactions on Image Processing 27, 4 (April 2018), 2049–2062.
[27]
A. K. Bhandari, S. Shahnawazuddin, and A. K. Meena. 2020. A novel fuzzy clustering-based histogram model for image contrast enhancement. IEEE Trans. on Fuzzy Systems 28, 9 (2020), 2009–2021.
[28]
S. Wang, J. Zheng, H.-M. Hu, and B. Li. 2013. Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE Trans. Image Process. 22, 9 (Sep. 2013), 3538–3548.
[29]
S. Hao, X. Han, Y. Guo, X. Xu, and M. Wang. 2020. Low-Light image enhancement with semi-decoupled decomposition. IEEE Transactions on Multimedia 22, 12 (Dec. 2020), 3025–3038.
[30]
T. Arici, S. Dikbas, and Y. Altunbasak. 2009. A histogram modification framework and its application for image contrast enhancement. IEEE Transactions on Image Processing 18, 9 (Sept. 2009), 1921–1935.
[31]
M. Jha and A. K. Bhandari. 2022. Camera response based nighttime image enhancement using concurrent reflectance. IEEE Transactions on Instrumentation and Measurement 71 (2022), 1–11. DOI:
[32]
Y. Wang, H. Liu, and Z. Fu. 2019. Low-light image enhancement via the absorption light scattering model. IEEE Trans. Image Process. 28, 11 (Nov. 2019), 5679–5690.
[33]
N. Singh and A. K. Bhandari. 2021. Principal component analysis-based low-light image enhancement using reflection model. IEEE Trans. Instrum. Meas. 70 (2021), 1–10.
[34]
Y. P. Loh and C. S. Chan. 2019. Getting to know nighttime scenes with the exclusively dark dataset. Comput. Vis. Image Understanding 178 (2019), 30–42. DOI:
[35]
C. Wei, W. Wang, W. Yang, and J. Liu. 2018. Deep retinex decomposition for low-light enhancement. ArXiv, abs/1808.04560.
[36]
S. Channappayya, A. Bovik, C. Caramanis, and R. Heath. 2008. Design of linear equalizers optimized for the structural similarity index. IEEE Trans. Image Process. 17, 6 (2008), 857–872.
[37]
G. Yue, C. Hou, T. Zhou, and X. Zhang. 2019. Effective and efficient blind quality evaluator for contrast distorted images. IEEE Trans. Instrum. Meas. 68, 8 (Aug. 2019), 2733–2741.
[38]
A. Mittal, R. Soundararajan, and A. C. Bovik. 2012. Making a completely blind image quality analyzer. IEEE Signal Process. Lett. 20, 3 (May 2012), 209–212.
[39]
J. Yan, J. Li, and X. Fu. 2019. No-reference quality assessment of contrastdistorted images using contrast enhancement. arXiv:1904.08879. http://arxiv.org/abs/1904.08879
[40]
M. Kumar and A. K. Bhandari. 2022. Unsupervised enhancement and web tool for perceptually invisible type degraded image. In IEEE Transactions on Consumer Electronics 68, 4 (2022), 401--410. DOI:
Index Terms
- NSDIE: Noise Suppressing Dark Image Enhancement Using Multiscale Retinex and Low-Rank Minimization
Recommendations
An Image Enhancement Approach Using Retinex and YIQ
ITCS '09: Proceedings of the 2009 International Conference on Information Technology and Computer Science - Volume 01On a basis of Retinex and YIQ color space, a new approach of color image enhancement is presented in this paper. The original image in the RGB color space is converted to the YIQ color space, and the multi-scale Retinex (MSR) algorithm is introduced to ...
Low Illumination Color Image Enhancement Based on Improved Retinex Theory
EITCE '20: Proceedings of the 2020 4th International Conference on Electronic Information Technology and Computer EngineeringIn view of the defects of the classical Retinex image enhancement algorithm, such as poor texture detail retention, halo and over enhancement, and abrupt tone, this paper proposes a low illumination color image enhancement algorithm based on Gabor ...
Low illumination color image enhancement based on Gabor filtering and Retinex theory
AbstractAiming at the shortcomings of traditional Retinex image enhancement algorithms, such as poor texture detail retention, halo, over-enhancement and hue mutation, a low-illuminance color image enhancement algorithm based on Gabor filter and Retinex ...
Comments
Information & Contributors
Information
Published In
June 2024
715 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 March 2024
Online AM: 03 January 2024
Accepted: 21 December 2023
Revised: 25 November 2023
Received: 01 July 2023
Published in TOMM Volume 20, Issue 6
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 203Total Downloads
- Downloads (Last 12 months)203
- Downloads (Last 6 weeks)24
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in