Single image defogging via Physical Model and Hyperresolution Reconstruction
Pages 314 - 320
Abstract
Image defogging is an important computer vision method. The current end-to-end defogging method, Convolutional Neural Networks (CNNs), has achieved significant success, and estimating depth information has become a mainstream method. However, depth information only focuses on the type of object, resulting in texture information loss and edge blur issues. To solve this problem.This article introduces a new defogging network (PHD) based on physical and image reconstruction. We first use a depth estimation network to obtain depth information and learn to physically decompose haze images into two components that conform to the scattering model: transmitted images and atmospheric light. In addition, we combine depth information with prior details of the fog map, learn the areas we need to focus on through the designed attention network, and generate weight matrix parameters to guide defogging. In the fine-tuning stage, we use the image hyper variational algorithm to repair its texture details. The experimental results indicate that compared with existing algorithms, this method has good performance.
References
[1]
Earl J. McCartney. Optics of the atmosphere–Scattering by molecules and particles. Wiley, 1976.
[2]
S.G. Narasimhan, S.K. Nayar, Vision and the atmosphere, Int. J. Comput. Vis. 48(3) (2002) 233–254.
[3]
Dana Berman, Tali Treibitz, and Shai Avidan. Non-local image dehazing. In CVPR, pages 1674–1682, 2016.
[4]
Raanan Fattal. Single image dehazing. ACM Transactions on Graphics, 27(3):1–9, 2008.
[5]
Raanan Fattal. Dehazing using color-lines. ACM Transactions on Graphics, 34(1):1–14, 2014
[6]
Kaiming He, Jian Sun, and Xiaoou Tang. Single image haze removal using dark channel prior. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(12):2341–2353,2010.
[7]
Robby T. Tan. Visibility in bad weather from a single image.In CVPR, pages 1–8. IEEE, 2008.
[8]
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao. Dehazenet: An end-to-end system for single image haze removal. IEEE Transactions on Image Processing (TIP), 25(11):5187–5198, 2016.
[9]
Boyi Li, Xiulian Peng, Zhangyang Wang, Jizheng Xu, and Dan Feng. Aod-net: All-in-one dehazing network. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), pages 4770–4778, 2017.
[10]
Wenqi Ren, Si Liu, Hua Zhang, Jinshan Pan, Xiaochun Cao,and Ming-Hsuan Yang. Single image dehazing via multiscale convolutional neural networks. In Proceedings of the European Conference on Computer Vision (ECCV), pages 154–169. Springer, 2016.
[11]
Hang Dong, Jinshan Pan, Lei Xiang, Zhe Hu, Xinyi Zhang,Fei Wang, and Ming-Hsuan Yang. Multi-scale boosted dehazing network with dense feature fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2157–2167, 2020
[12]
Chun-Le Guo, Qixin Yan, Saeed Anwar, Runmin Cong,Wenqi Ren, and Chongyi Li. Image dehazing transformer with transmission-aware 3d position embedding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5812–5820, 2022.
[13]
Xiaohong Liu, Yongrui Ma, Zhihao Shi, and Jun Chen. Griddehazenet: Attention-based multi-scale network for image dehazing. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), pages 7314–7323, 2019.
[14]
Xu Qin, Zhilin Wang, Yuanchao Bai, Xiaodong Xie, and Huizhu Jia. Ffa-net: Feature fusion attention network for single image dehazing. Proceedings of the AAAI Conference on Artificial Intelligence, 34(07), 2020.
[15]
Tian Ye, Mingchao Jiang, Yunchen Zhang, Liang Chen, Erkang Chen, Pen Chen, and Zhiyong Lu. Perceiving and modeling density is all you need for image dehazing. arXiv preprint arXiv:2111.09733, 2021.
[16]
Louis Kratz and Ko Nishino. Factorizing scene albedo and depth from a single foggy image. In 2009 IEEE 12th International Conference on Computer Vision, pages 1701–1708. IEEE, 2009.
[17]
G. Meng, Y. Wang, J. Duan, S. Xiang, and C. Pan, “Efficient image dehazing with boundary constraint and contextual regularization,” in IEEE International Conference on Computer Vision, 2013, pp. 617–624.
[18]
Q. Zhu, J. Mai, and L. Shao, “A fast single image haze removal algorithmusing color attenuation prior,” IEEE transactions on image processing,vol. 24, no. 11, pp. 3522–3533, 2015.
[19]
M. Ju, C. Ding, W. Ren, Y. Yang, D. Zhang, and Y. J. Guo, “Ide:Image dehazing and exposure using an enhanced atmospheric scattering model,” IEEE Transactions on Image Processing, vol. 30, pp. 2180–2192, 2021.
[20]
Q. Wu, W. Ren, and X. Cao, “Learning interleaved cascade of shrinkage.fields for joint image dehazing and denoising,” IEEE Transactions on Image Processing, vol. 29, pp. 1788–1801, 2019.
[21]
W. Ren, S. Liu, H. Zhang, J. Pan, X. Cao, and M.-H. Yang, “Single image dehazing via multi-scale convolutional neural networks,” in European Conference on Computer Vision, 2016, pp. 154–169.
[22]
H. Zhang and V. M. Patel, “Densely connected pyramid dehazing network,” in IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 3194–3203.
[23]
H. Zhang and V. M. Patel, “Densely connected pyramid dehazing network,” in IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 3194–3203.
[24]
B. Li, X. Peng, Z. Wang, J. Xu, and D. Feng, “Aod-net: All-in-one dehazing network,” in IEEE International Conference on Computer Vision, 2017, pp. 4770–4778.
[25]
W. Ren, L. Ma, J. Zhang, J. Pan, X. Cao, W. Liu, and M.-H. Yang,“Gated fusion network for single image dehazing,” in IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 3253–3261
[26]
. Christof Koch Laurent Itti and Ernst Niebur. A model of saliency-based visual attention for rapid scene analysis.PAMI, 1998.
[27]
Jie Hu, Li Shen, and Gang Sun. Squeeze-and-excitation networks. In CVPR, 2018. 2
[28]
Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. Non-local neural networks. In CVPR, 2018.
[29]
Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Image super-resolution using deep convolutional networks. TPAMI, 2016.
[30]
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. Accurate image super-resolution using very deep convolutional networks. In CVPR, 2016
[31]
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. Deeplyrecursive convolutional network for image super-resolution.In CVPR, 2016
[32]
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. Enhanced deep residual networks for single image super-resolution. In CVPRW, 2017.
[33]
Ying Tai, Jian Yang, Xiaoming Liu, and Chunyan Xu. Memnet: A persistent memory network for image restoration. In CVPR, pages 4539–4547, 2017.
[34]
Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. Residual dense network for image super-resolution. In CVPR, 2018.
[35]
Gao Huang, Zhuang Liu, Laurens Van Der Maaten, and Kilian Q Weinberger. Densely connected convolutional networks. In CVPR, 2017
[36]
Ullah H, Muhammad K, Irfan M, Light-DehazeNet: a novel lightweight CNN architecture for single image dehazing[J]. IEEE transactions on image processing, 2021, 30: 8968-8982.
[37]
Chen D, He M, Fan Q, Gated context aggregation network for image dehazing and deraining[C]//2019 IEEE winter conference on applications of computer vision (WACV). IEEE, 2019: 1375-1383.
[38]
Yuanjie Shao, Lerenhan Li, Wenqi Ren, Changxin Gao, and Nong Sang.Domain adaptation for image dehazing. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2808–2817, 2020.
[39]
Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao.Dehazenet: An end-to-end system for single image haze removal. IEEE Transactions on Image Processing, 25(11):5187–5198, 2016.
[40]
Boyi Li, Wenqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhangyang Wang. Benchmarking single-image dehazing and beyond. IEEE Transactions on Image Processing, 28(1):492–505, 2018.
[41]
Yanfu Zhang, Li Ding, and Gaurav Sharma. Hazerd: an outdoor scene dataset and benchmark for single image dehazing. In Image Processing(ICIP), 2017 IEEE International Conference on, pages 3205–3209.IEEE, 2017.
[42]
Yulun Zhang, Kunpeng Li, Kai Li, Lichen Wang, Bineng Zhong, and Yun Fu. Image super-resolution using very deep residual channel attention networks. In ECCV, 2018.
[43]
Codruta O. Ancuti, Cosmin Ancuti, Mateu Sbert, and Radu Timofte. Dense haze: A benchmark for image dehazing with dense-haze and haze-free images. In ICIP, 2019.
Index Terms
- Single image defogging via Physical Model and Hyperresolution Reconstruction
Recommendations
Single Image Dehazing via Image Generating
Image and Video TechnologyAbstractOutdoor images taken in bad weather conditions often suffer from poor visibility. However, single image haze removal is an ill-posed problem, because the number of the equations is smaller than the number of unknowns. In this paper, a deep ...
Adaptive Defogging of a Single Image
ISCID '09: Proceedings of the 2009 Second International Symposium on Computational Intelligence and Design - Volume 01Based on the physical model of fogged images, a new method is proposed to enhance the visibility of a single image adaptively. In order to restrain the edge halation produced by virtual air light defogging method, the concept of neighboring pixel’s ...
Large size single image fast defogging and the real time video defogging FPGA architecture
Since most image defogging methods require complex image filtering computation, they cannot work effectively under large size real time image and video scenarios. In this work, targeting this problem, a large size single image computation acceleration ...
Comments
Information & Contributors
Information
Published In
September 2023
335 pages
ISBN:9798400708039
DOI:10.1145/3655532
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 June 2024
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICRSA 2023
ICRSA 2023: 2023 the 6th International Conference on Robot Systems and Applications
September 22 - 24, 2023
Wuhan, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 4Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format