Infrared and Visible Image Fusion based on Log-domain Decomposition and Information Interaction
Pages 243 - 247
Abstract
In order to better preserve the salient targets and detail information of the infrared and visible images, a novel image fusion method based on log-domain decomposition and information interaction is proposed in this paper. Specifically, the infrared and visible images are first transformed into the logarithmic domain for a two-scale decomposition, which helps to extract more high-contrast information compared to decomposing them directly in image space. A visual saliency strategy is then used to fuse the base layer images. As to detail layers, a combined local visual saliency and detail preservation strategy is proposed to determine the final fusion weights. In addition, it is worth noting that the visible image information is introduced into the infrared detail layer before fusion, which achieves the information complementation and interaction of two source images. The experiment results demonstrate that the proposed method outperforms other fusion methods in both qualitative and quantitative assessments.
Supplementary Material
The updated figure materials of the paper. (Figure of the paper.zip)
- Download
- 14.96 MB
References
[1]
Ma J Y, Xu H, Jiang J J, Mei X G and Zhang X P. 2020. DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion. IEEE Transactions on Image Processing, 29: 4980-4995. https://doi.org/10.1109/TIP.2020.2977573
[2]
Vishwakarma A and Bhuyan M K. 2019. Image fusion using adjustable non-subsampled shearlet transform. IEEE Transactions on Instrumentation and Measurement, 68(9):3367-3378. https://doi.org/10.1109/TIM.2018.2877285
[3]
Bavirisetti D P, Xiao G and Liu G. 2017. Multi-sensor image fusion based on fourth order partial differential equations. 2017 20th International conference on information fusion (Fusion), IEEE: 1-9. https://doi.org/10.23919/ICIF.2017.8009719
[4]
Yang Y, Zhang Y M, Huang S Y, Zuo Y F and Sun J C. 2020. Infrared and visible image fusion using visual saliency sparse representation and detail injection model. IEEE Transactions on Instrumentation and Measurement, 70: 1-15. https://doi.org/10.1109/TIM.2020.3011766
[5]
Xiang T Z, Yan L and Gao R R. 2015. A fusion algorithm for infrared and visible images based on adaptive dual-channel unit-linking PCNN in NSCT domain. Infrared Physics & Technology, 69:53-61. https://doi.org/10.1016/j.infrared.2015.01.002
[6]
Chai Y, Li H F and Qu J F. 2010. Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain. Optics Communications, 283(19):3591-3602. https://doi.org/10.1016/j.optcom.2010.04.100
[7]
Zhang Y, Liu Y, Sun P, Yan H, Zhao X and Zhang L. 2020. IFCNN: A general image fusion framework based on convolutional neural network. Information Fusion, 54:99-118. https://doi.org/10.1016/j.inffus.2019.07.011
[8]
Wang W C and Chang F L. 2011. A multi-focus image fusion method based on Laplacian pyramid. Journal of Computers, 6(12):2559-2566. https://doi.org/10.4304/jcp.6.12.2559-2566
[9]
Jin H Y and Wang Y Y. 2014. A fusion method for visible and infrared images based on contrast pyramid with teaching learning based optimization. Infrared Physics & Technology, 64:134-142. https://doi.org/10.1016/j.infrared.2014.02.013
[10]
Li H, Manjunath B S and Mitra S K. 2002. Multi-sensor image fusion using the wavelet transform. Graphical Models and Image Processing, 57(3):235-245. https://doi.org/10.1109/ICIP.1994.413273
[11]
A. L. Da Cunha, J. Zhou, and M. N. Do. 2006. The nonsubsampled contourlet transform: theory, design, and applications. IEEE transactions on image processing,15(10):3089–3101. https://doi.org/10.1109/TIP.2006.877507
[12]
Tomasi C and Manduchi R. 2002. Bilateral filtering for gray and color images. International Conference on Computer Vision. IEEE, Bombay, India, 839-846. https://doi.org/10.1109/ICCV.1998.710815
[13]
He K M, Sun J and Tang X O. 2012. Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(6):1397-1409. https://doi.org/10.1109/TPAMI.2012.213
[14]
Zhou Z Q, Wang B, Li S and Dong M J. 2016. Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters. Information Fusion, 30:15-26. https://doi.org/10.1016/j.inffus.2015.11.003
[15]
Li S T, Kang X D and Hu J W. 2013. Image fusion with guided filtering. IEEE Transactions on Image Processing, 22(7):2864-2875. https://doi.org/10.1109/TIP.2013.2244222
[16]
Yun Z and Shah M. 2006. Visual attention detection in video sequences using spatiotemporal cues. Proceedings of the 14th ACM International Conference on Multimedia. ACM, Santa Barbara, CA, 815-824. https://doi.org/10.1145/1180639.1180824
[17]
Ma J L, Zhou Z Q, Wang B and Zong H. 2017. Infrared and visible image fusion based on visual saliency map and weighted least square optimization. Infrared Physics & Technology, 82:8-17. https://doi.org/10.1016/j.infrared.2017.02.005
[18]
Ma J Y, Yu W, Liang P W, Li C and Jiang J J. 2019. FusionGAN: A generative adversarial network for infrared and visible image fusion. Information Fusion, 48:11-26. https://doi.org/10.1016/j.inffus.2018.09.004
[19]
Li H and Wu X J. 2018. DenseFuse: A fusion approach to infrared and visible images. IEEE Transactions on Image Processing, 28(5):2614-2623. https://doi.org/10.1109/TIP.2018.2887342
[20]
Li H, Wu X J and Kittler J. 2021. RFN-Nest: An end-to-end residual fusion network for infrared and visible images. Information Fusion, 73: 72-86. https://doi.org/10.1016/j.inffus.2021.02.023
[21]
Li S T, Kang X D, Fang L Y, Hu J W and Yin H T. 2017. Pixel-level image fusion: A survey of the state of the art. information Fusion, 33:100-112. https://doi.org/10.1016/j.inffus.2016.05.004
Index Terms
- Infrared and Visible Image Fusion based on Log-domain Decomposition and Information Interaction
Index terms have been assigned to the content through auto-classification.
Recommendations
Infrared and Visible Image Fusion in Realistic Streetscape
ICRCA '18: Proceedings of the 3rd International Conference on Robotics, Control and AutomationInfrared and visible image fusion plays an important role in military and civilian applications. However, most methods are focus on simple general scene, which only contains one person alone or a few buildings. It is not enough to fully reflect the ...
Infrared and Visible Image Fusion Method Based on Residual Block and Compression Decomposition Network
EITCE '22: Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer EngineeringThe fusion of infrared images and visible images can enrich image information and obtain high-quality target images in complex environments. It has a wide range of applications in target detection, image enhancement and other fields. To solve the ...
Infrared and Visible Image Fusion Based on Multi-scale Gaussian Rolling Guidance Filter Decomposition
Smart MultimediaAbstractWith the development of multi-source detectors, the fusion of infrared and visible light images has received close attention from researchers. Infrared images have the advantages of all-day time, and can clearly image temperature-sensitive targets ...
Comments
Information & Contributors
Information
Published In
October 2022
753 pages
ISBN:9781450397780
DOI:10.1145/3569966
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 20 December 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- National Natural Science Foundation of China
- National Natural Science Foundation of China
Conference
CSSE 2022
CSSE 2022: 2022 5th International Conference on Computer Science and Software Engineering
October 21 - 23, 2022
Guilin, China
Acceptance Rates
Overall Acceptance Rate 33 of 74 submissions, 45%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 18Total Downloads
- Downloads (Last 12 months)11
- Downloads (Last 6 weeks)0
Reflects downloads up to 02 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format