Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Advertisement

Springer Nature Link
Log in

Pyramid feature boosted network for single image dehazing

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

In this paper, a Pyramid Feature Boosted Network is proposed for single image dehazing, which leverages the encoder-decoder structure and benefits from two core modules to achieve high-quality image recovery. Since image detail loss is a common problem in image restoration, we design a Feature Boosted module based on the Strengthen-Operate-Subtract boosting strategy to increase the quality of the image. This module innovatively incorporates multi-scale latent features to replenish the lost signals. In addition, to release the heterogeneous haze, a novel Mixture Attention unit is proposed to reinforce the important information in multiple dimensions and highlight the main object in the image from background. Extensive evaluations and simulation results show the proposed methods outperform the State-Of-The-Art (SOTA) methods on both synthetic datasets and real-world images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

The data that support the findings of this study are available from the corresponding author, Chao Wang, upon reasonable request.

References

  1. Ancuti CO, Ancuti C, Timofte R (2020) NH-HAZE: an image dehazing benchmark with non-homogeneous hazy and haze-free images. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, p 444–445

  2. Berman D, Avidan S et al (2016) Non-local image dehazing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 1674–1682

  3. Cai B, Xu X, Jia K et al (2016) DehazeNet: an end-to-end system for single image haze removal. IEEE Trans Image Process 25(11):5187–5198

    Article  MathSciNet  MATH  Google Scholar 

  4. Charest MR, Elad M, Milanfar P (2006) A general iterative regularization framework for image denoising. In: 2006 40th annual conference on information sciences and systems, IEEE, p 452–457

  5. Chen C, Xiong Z, Tian X et al (2018) Deep boosting for image denoising. In: Proceedings of the European conference on computer vision, pp 3–18

  6. Chen C, Xiong Z, Tian X et al (2019) Real-world image denoising with deep boosting. IEEE Trans Pattern Anal Mach Intell 42(12):3071–3087

    Article  Google Scholar 

  7. Chen D, He M, Fan Q et al (2019) Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE winter conference on applications of computer vision, pp 1375–1383

  8. Chen Z, Wang Y, Yang Y, et al (2021) PSD: principled synthetic-to-real dehazing guided by physical priors. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7180–7189

  9. Deng LJ, Huang TZ, Zhao XL et al (2018) A directional global sparse model for single image rain removal. Appl Math Model 59:662–679

    Article  MathSciNet  MATH  Google Scholar 

  10. Deng Q, Huang Z, Tsai CC, et al (2020) HardGAN: a haze-aware representation distillation GAN for single image dehazing. In: European conference on computer vision, Springer, p 722–738

  11. Dong H, Pan J, Xiang L et al (2020) Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p 2157–2167

  12. Fattal R (2008) Single image dehazing. ACM Trans Graph (TOG) 27(3):1–9

    Article  Google Scholar 

  13. Fattal R (2014) Dehazing using color-lines. ACM Trans Graph (TOG) 34(1):1–14

    Article  Google Scholar 

  14. Fu J, Liu J, Tian H et al (2019) Dual attention network for scene segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 3146–3154

  15. Han S, Meng Z, Khan AS et al (2016) Incremental boosting convolutional neural network for facial action unit recognition. Adv Neural Inf Process Syst 29:109–117

    Google Scholar 

  16. He K, Sun J, Tang X (2010) Single image haze removal using dark chan- nel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353

    Article  Google Scholar 

  17. He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  18. He T, Zhang Z, Zhang H et al (2019) Bag of tricks for image classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 558–567

  19. Johnson J, Alahi A, Fei-Fei L (2016) Perceptual losses for real-time style transfer and super-resolution. In: European conference on computer vision, Springer, p 694–711

  20. Li B, Peng X, Wang Z, et al (2017) AOD-Net: all-in-one dehazing network. In: Proceedings of the IEEE international conference on computer vision, p 4770–4778

  21. Li B, Ren W, Fu D et al (2019) Benchmarking single-image dehazing and beyond. IEEE Trans Image Process 28(1):492–505

    Article  MathSciNet  MATH  Google Scholar 

  22. Liu X, Ma Y, Shi Z et al (2019) GridDehazeNet: attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF international conference on computer vision, p 7314–7323

  23. Liu X, Ma Y, Shi Z et al (2019) GridDehazeNet: attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE international conference on computer vision, p 7314–7323

  24. McCartney EJ (1976) Optics of the atmosphere: scattering by molecules and particles. John Wiley, New York, p 421

    Google Scholar 

  25. Mei K, Jiang A, Li J et al (2018) Progressive feature fusion network for realistic image dehazing. In: Asian conference on computer vision, Springer, p 203–215

  26. Milanfar P (2012) A tour of modern image filtering: new insights and methods, both practical and theoretical. IEEE Signal Process Mag 30(1):106–128

    Article  Google Scholar 

  27. Moghimi M, Belongie SJ, Saberian MJ et al (2016) Boosted convolutional neural networks. In: British machine vision conference, p 6

  28. Osher S, Burger M, Goldfarb D et al (2005) An iterative regularization method for total variation-based image restoration. Multiscale Model Simul 4(2):460–489

    Article  MathSciNet  MATH  Google Scholar 

  29. Qin X, Wang Z, Bai Y et al (2020) FFA-NET: feature fusion attention network for single image dehazing. In: Proceedings of the AAAI conference on artificial intelligence, p 11908–11915

  30. Ren W, Liu S, Zhang H et al (2016) Single image dehazing via multi-scale convolutional neural networks. In: European conference on computer vision, Springer, p 154–169

  31. Romano Y, Elad M (2015) Boosting of image denoising algorithms. SIAM J Imaging Sci 8(2):1187–1219

    Article  MathSciNet  MATH  Google Scholar 

  32. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International conference on learning representations, p 1–14

  33. Tan RT (2008) Visibility in bad weather from a single image. In: 2008 IEEE conference on computer vision and pattern recognition, pp 1–8

  34. Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. In: Advances in neural information processing systems, p 5998–6008

  35. Wang X, Girshick R, Gupta A et al (2018) Non-local neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 7794–7803

  36. Woo S, Park J, Lee JY et al (2018) CBAM: convolutional block attention module. In: Proceedings of the European conference on computer vision, pp 3–19

  37. Wu H, Qu Y, Lin S et al (2021) Contrastive learning for compact single image dehazing. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p 10551–10560

  38. Xu K, Ba J, Kiros R et al (2015) Show, attend and tell: neural image caption generation with visual attention. In: International conference on machine learning, PMLR, p 2048–2057

  39. Yang D, Sun J (2018) Proximal Dehaze-Net: a prior learning-based deep network for single image dehazing. In: Proceedings of the European conference on computer vision, pp 702–717

  40. Zamir SW, Arora A, Khan S et al (2020) Learning enriched features for real image restoration and enhancement. In: Computer vision–ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXV 16, Springer, p 492–511

  41. Zamir SW, Arora A, Khan S et al (2021) Multi-stage progressive image restoration. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, p 14821–14831

  42. Zhang H, Patel VM (2018) Densely connected pyramid dehazing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, p 3194–3203

  43. Zhang Y, Li K, Li K et al (2018) Image super-resolution using very deep residual channel attention networks. In: Proceedings of the European conference on computer vision, pp 286–301

Download references

Acknowledgements

This work is supported by the Basic Public Welfare Research in Zhejiang Province of China (LGG22F020036); National Natural Science Foundation of China under Grants 62076221 and 61976194; Natural Science Research Project of Anhui Universities (KJ2019A0032); Natural Science Foundation of Anhui Province (2008085QF286); General Scientific Research Project of Zhejiang Provincial Education Department (Y202250642); Science and Technology Innovation Activity Plan and New Talents Plan for College Students in Zhejiang Province (2022R411A032).

Author information

Authors and Affiliations

  1. School of Information Engineering, Zhejiang Ocean University, Zhoushan, 316022, China

    Guangrui Hu, Anhui Tan, Haozhen Shen, Chao Wang & Huandi Du

  2. Key Laboratory of Oceanographic Big Data Mining and Application of Zhejiang Province, Zhejiang Ocean University, Zhoushan, 316022, China

    Anhui Tan, Hongming Chen & Chao Wang

  3. School of Mathematical Sciences, Anhui University, Hefei, 230601, China

    Liangtian He

  4. Institute of Intelligent Materials and Sensing Engineering, Shenzhen Research Institute of Nankai University, Shenzhen, 518083, China

    Hongming Chen

Authors
  1. Guangrui Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anhui Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liangtian He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haozhen Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hongming Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Chao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Huandi Du
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chao Wang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, G., Tan, A., He, L. et al. Pyramid feature boosted network for single image dehazing. Int. J. Mach. Learn. & Cyber. 14, 2099–2110 (2023). https://doi.org/10.1007/s13042-022-01748-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-022-01748-8

Keywords

Search

Navigation