Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Underwater Image Enhancement Based on the Fusion of PUIENet and NAFNet

  • Conference paper
  • First Online:
Advances in Computer Graphics (CGI 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14495))

Included in the following conference series:

Abstract

Due to light absorption and scattering in the ocean, underwater images suffer from blur and color bias, and the colors tend to be biased towards blue or green. To enhance underwater images, many underwater image enhancement (UIE) methods have been developed. Probabilistic Network for UIE (PUIENet) is a neural network model that produces good results in processing underwater images. However, it cannot handle underwater images with motion blur, which is caused by camera or object motion. Nonlinear Activation Free Network (NAFNet) is a network model designed to remove image blur by simplifying everything. Inspired by NAFNet, we simplified the convolution, activation function, and channel attention module of PUIENet, resulting in Probabilistic and Nonlinear Activation Hybrid for UIE (PNAH_UIE), which reduced training time by approximately 19\(\%\) and also reduced loss. In this paper, we propose a deep learning-based method for underwater image enhancement, called Probabilistic and Nonlinear Activation Hybrid Network for UIE (PNAHNet_UIE), which integrates the two most advanced network structures, PNAH_UIE and NAFNet, to improve overall image clarity and remove motion blur. The URPC2022 dataset was used in the experiments, which comes from the “CHINA UNDERWATER ROBOT PROFESSIONAL CONTEST.” PNAH_UIE was used to enhance the URPC2022 dataset, and the processed images were checked for motion blur. If the variance of an image was below a certain threshold, the NAFNet network was used to process the image, thus reducing computational pressure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abdul Ghani, A.S., Mat Isa, N.A.: Underwater image quality enhancement through composition of dual-intensity images and rayleigh-stretching. Springerplus 3(1), 1–14 (2014)

    Article  Google Scholar 

  2. Acharya, U.K., Kumar, S.: Image enhancement using exposure and standard deviation-based sub-image histogram equalization for night-time images. In: Bansal, P., Tushir, M., Balas, V.E., Srivastava, R. (eds.) Proceedings of International Conference on Artificial Intelligence and Applications. AISC, vol. 1164, pp. 607–615. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-4992-2_57

    Chapter  Google Scholar 

  3. Al-Jebrni, A.H., et al.: Sthy-net: a feature fusion-enhanced dense-branched modules network for small thyroid nodule classification from ultrasound images. Vis. Comput. 1–15 (2023)

    Google Scholar 

  4. Ancuti, C., Ancuti, C.O., Haber, T., Bekaert, P.: Enhancing underwater images and videos by fusion. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 81–88. IEEE (2012)

    Google Scholar 

  5. Bansal, R., Raj, G., Choudhury, T.: Blur image detection using laplacian operator and open-cv. In: 2016 International Conference System Modeling & Advancement in Research Trends (SMART), pp. 63–67. IEEE (2016)

    Google Scholar 

  6. Chen, J., Wang, X., Guo, Z., Zhang, X., Sun, J.: Dynamic region-aware convolution. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8064–8073 (2021)

    Google Scholar 

  7. Chen, L., Chu, X., Zhang, X., Sun, J.: Simple baselines for image restoration. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T. (eds.) ECCV 2022, Part VII. LNCS, vol. 13667, pp. 17–33. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-20071-7_2

    Chapter  Google Scholar 

  8. Chiang, J.Y., Chen, Y.C.: Underwater image enhancement by wavelength compensation and dehazing. IEEE Trans. Image Process. 21(4), 1756–1769 (2011)

    Article  MathSciNet  Google Scholar 

  9. Ding, X., Wang, Y., Zhang, J., Fu, X.: Underwater image dehaze using scene depth estimation with adaptive color correction. In: OCEANS 2017-Aberdeen, pp. 1–5. IEEE (2017)

    Google Scholar 

  10. Fu, Z., Wang, W., Huang, Y., Ding, X., Ma, K.K.: Uncertainty inspired underwater image enhancement. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G.M., Hassner, T. (eds.) Computer Vision-ECCV 2022, Part XVIII. LNCS, vol. 13678, pp. 465–482. Springer, Chm (2022). https://doi.org/10.1007/978-3-031-19797-0_27

    Chapter  Google Scholar 

  11. Goyal, V., Shukla, A.: An enhancement of underwater images based on contrast restricted adaptive histogram equalization for image enhancement. In: Tiwari, S., Trivedi, M.C., Mishra, K.K., Misra, A.K., Kumar, K.K., Suryani, E. (eds.) Smart Innovations in Communication and Computational Sciences. AISC, vol. 1168, pp. 275–285. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-5345-5_25

    Chapter  Google Scholar 

  12. He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2010)

    Google Scholar 

  13. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  14. Hore, A., Ziou, D.: Image quality metrics: PSNR vs. SSIM. In: 2010 20th International Conference on Pattern Recognition, pp. 2366–2369. IEEE (2010)

    Google Scholar 

  15. Huang, D., Wang, Y., Song, W., Sequeira, J., Mavromatis, S.: Shallow-water image enhancement using relative global histogram stretching based on adaptive parameter acquisition. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10704, pp. 453–465. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73603-7_37

    Chapter  Google Scholar 

  16. Huynh-Thu, Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44(13), 800–801 (2008)

    Article  Google Scholar 

  17. Iqbal, K., Odetayo, M., James, A., Salam, R.A., Talib, A.Z.H.: Enhancing the low quality images using unsupervised colour correction method. In: 2010 IEEE International Conference on Systems, Man and Cybernetics, pp. 1703–1709. IEEE (2010)

    Google Scholar 

  18. Iqbal, K., Salam, R.A., Osman, A., Talib, A.Z.: Underwater image enhancement using an integrated colour model. IAENG Int. J. Comput. Sci. 34(2) (2007)

    Google Scholar 

  19. Li, C.Y., Guo, J.C., Cong, R.M., Pang, Y.W., Wang, B.: Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Trans. Image Process. 25(12), 5664–5677 (2016)

    Article  MathSciNet  Google Scholar 

  20. Li, C., et al.: An underwater image enhancement benchmark dataset and beyond. IEEE Trans. Image Process. 29, 4376–4389 (2019)

    Article  Google Scholar 

  21. Li, C., Guo, J., Guo, C., Cong, R., Gong, J.: A hybrid method for underwater image correction. Pattern Recogn. Lett. 94, 62–67 (2017)

    Article  Google Scholar 

  22. Li, J., Skinner, K.A., Eustice, R.M., Johnson-Roberson, M.: Watergan: unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robot. Autom. Lett. 3(1), 387–394 (2017)

    Google Scholar 

  23. Li, L., Tang, J., Ye, Z., Sheng, B., Mao, L., Ma, L.: Unsupervised face super-resolution via gradient enhancement and semantic guidance. Vis. Comput. 37, 2855–2867 (2021)

    Article  Google Scholar 

  24. Marmolin, H.: Subjective MSE measures. IEEE Trans. Syst. Man Cybern. 16(3), 486–489 (1986)

    Article  Google Scholar 

  25. Panetta, K., Gao, C., Agaian, S.: Human-visual-system-inspired underwater image quality measures. IEEE J. Oceanic Eng. 41(3), 541–551 (2015)

    Article  Google Scholar 

  26. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015, Part III. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  27. Wang, Y., Song, W., Fortino, G., Qi, L.Z., Zhang, W., Liotta, A.: An experimental-based review of image enhancement and image restoration methods for underwater imaging. IEEE access 7, 140233–140251 (2019)

    Article  Google Scholar 

  28. Yang, M., Sowmya, A.: An underwater color image quality evaluation metric. IEEE Trans. Image Process. 24(12), 6062–6071 (2015)

    Article  MathSciNet  Google Scholar 

  29. Zhang, S., Wang, T., Dong, J., Yu, H.: Underwater image enhancement via extended multi-scale retinex. Neurocomputing 245, 1–9 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, Inner Mongolia University, Hohhot, 010000, China

    Chao Li & Bo Yang

Authors
  1. Chao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bo Yang .

Editor information

Editors and Affiliations

  1. Shanghai Jiao Tong University, Shanghai, China

    Bin Sheng

  2. Shanghai Jiao Tong University, Shanghai, China

    Lei Bi

  3. University of Sydney, Sydney, NSW, Australia

    Jinman Kim

  4. MIRALab-CUI, University of Geneve, Carouge, Geneve, Switzerland

    Nadia Magnenat-Thalmann

  5. Swiss Federal Institute of Technology, Lausanne, Switzerland

    Daniel Thalmann

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, C., Yang, B. (2024). Underwater Image Enhancement Based on the Fusion of PUIENet and NAFNet. In: Sheng, B., Bi, L., Kim, J., Magnenat-Thalmann, N., Thalmann, D. (eds) Advances in Computer Graphics. CGI 2023. Lecture Notes in Computer Science, vol 14495. Springer, Cham. https://doi.org/10.1007/978-3-031-50069-5_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-50069-5_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-50068-8

  • Online ISBN: 978-3-031-50069-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation