Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

FastUNet: : Fast hierarchical multi-patch underwater enhancement network for industrial recirculating aquaculture

Published: 21 November 2024 Publication History

Highlights

A fast multi-patch hierarchical network and two datasets are proposed.
Combining underwater imaging models and homology loss to limit network output.
Color loss correction color bias was designed based on the gray world assumption.
The feasibility was verified in application tests in the field of aquaculture.

Abstract

The industrialized aquaculture with recirculating water systems has gained increasing attention and rapid development in recent years. However, the existing underwater enhancement methods are time-consuming and severely hinder their online application in industrialized aquaculture due to the requirement for real-time processing. We found that their main limitations are the insufficient utilization of the hierarchical network approach and valuable prior information in underwater scenarios. To address this problem, we propose a novel architecture called FastUNet and introduce a visual enhancement benchmark dataset specifically designed for industrialized aquaculture with recirculating water systems. Surprisingly, by learning the fast multi-patch hierarchical module and employing prior constraints including color loss and homology loss, FastUNet achieves comparable or even better results than many deep learning methods. In terms of runtime, it is up to 30 times faster than current underwater enhancement methods. The processing time for images with a resolution of 5474 × 3653 is only 0.137s. The real application scenario of factory recirculating aquaculture is considered by FastUNet, and the embedding of prior information under the fast network framework is explored. In this paper, 14 state-of-the-art underwater enhancement methods are compared, and excellent results are obtained on 2 Full-reference datasets and 2 No-referenced datasets. The application test results of SIFT significant point detection, geometric rotation, edge detection, target segmentation and target detection were also presented, which strongly verified the feasibility of FastUNet in the field of factory recirculating aquaculture.

References

[1]
R. Ranjan, S. Megarajan, B. Xavier, et al., Design and performance of recirculating aquaculture system for marine finfish broodstock development, Aquac. Eng. 85 (2019) 90–97.
[2]
H.S. Hammer, Recirculating aquaculture systems (RAS) for zebrafish culture//The Zebrafish, Biomedical Research, Academic Press, 2020, pp. 337–356.
[3]
J. Li, T. Chen, Z. Yang, et al., Development of a buoy-borne underwater imaging system for in situ mesoplankton monitoring of coastal waters, IEEE J. Ocean. Eng. 47 (1) (2021) 88–110.
[4]
F. Alenezi, A. Armghan, K.C. Santosh, Underwater image dehazing using global color features, Eng. Appl. Artif. Intell. 116 (2022).
[5]
M.P. Gopinath, G.S. Tamizharasi, L. Kavisankar, et al., A secure cloud-based solution for real-time monitoring and management of Internet of underwater things (IOUT), Neural Comput. Appl. 31 (2019) 293–308.
[6]
D. Li, X. Li, Q. Wang, et al., Advanced techniques for the intelligent diagnosis of fish diseases: a review, Animals 12 (21) (2022) 2938.
[7]
M. Jahanbakht, W. Xiang, L. Hanzo, et al., Internet of underwater things and big marine data analytics—a comprehensive survey, IEEE Commun. Surv. Tutor. 23 (2) (2021) 904–956.
[8]
S. Liu, H. Fan, S. Lin, et al., Adaptive learning attention network for underwater image enhancement, IEEe Robot. Autom. Lett. 7 (2) (2022) 5326–5333.
[9]
Z. Jiang, Z. Li, S. Yang, et al., Target oriented perceptual adversarial fusion network for underwater image enhancement, IEEE Trans. Circ. Syst. Video Technol. (2022).
[10]
L. Peng, C. Zhu, L. Bian, U-shape transformer for underwater image enhancement, IEEE Trans. Image Process. (2023).
[11]
H. Zhang, Y. Dai, H. Li, et al., Deep stacked hierarchical multi-patch network for image deblurring, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 5978–5986.
[12]
S.D. Das, S. Dutta, Fast deep multi-patch hierarchical network for nonhomogeneous image dehazing, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 482–483.
[13]
P. Zhuang, J. Wu, F. Porikli, et al., Underwater image enhancement with hyper-laplacian reflectance priors, IEEE Trans. Image Process. 31 (2022) 5442–5455.
[14]
Q. Qi, K. Li, H. Zheng, et al., SGUIE-Net: semantic attention guided underwater image enhancement with multi-scale perception, IEEE Trans. Image Process. 31 (2022) 6816–6830.
[15]
G. Hou, J. Li, G. Wang, et al., A novel dark channel prior guided variational framework for underwater image restoration, J. Vis. Commun. Image Represent. 66 (2020).
[16]
P. Drews, E. Nascimento, F. Moraes, et al., Transmission estimation in underwater single images, in: Proceedings of the IEEE International Conference on Computer Vision Workshops, 2013, pp. 825–830.
[17]
W. Song, Y. Wang, D. Huang, et al., Enhancement of underwater images with statistical model of background light and optimization of transmission map, IEEE Trans. Broadcast. 66 (1) (2020) 153–169.
[18]
T.P. Marques, A.B. Albu, L2uwe: a framework for the efficient enhancement of low-light underwater images using local contrast and multi-scale fusion, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2020, pp. 538–539.
[19]
McGlamery B.L. A computer model for underwater camera systems, Ocean Optics VI. SPIE, 1980, 208: 221-231.
[20]
J.S. Jaffe, Computer modeling and the design of optimal underwater imaging systems, IEEE J. Ocean. Eng. 15 (2) (1990) 101–111.
[21]
D. Berman, D. Levy, S. Avidan, et al., Underwater single image color restoration using haze-lines and a new quantitative dataset, IEEe Trans. Pattern. Anal. Mach. Intell. 43 (8) (2020) 2822–2837.
[22]
C. Li, C. Guo, W. Ren, et al., An underwater image enhancement benchmark dataset and beyond, IEEE Trans. Image Process. 29 (2019) 4376–4389.
[23]
J. Yuan, W. Cao, Z. Cai, et al., An underwater image vision enhancement algorithm based on contour bougie morphology, IEEE Trans. Geosci. Remote Sens. 59 (10) (2020) 8117–8128.
[24]
W. Zhang, Y. Wang, C. Li, Underwater image enhancement by attenuated color channel correction and detail preserved contrast enhancement, IEEE J. Ocean. Eng. 47 (3) (2022) 718–735.
[25]
S. Wang, Z. Chen, H. Wang, Multi-weight and multi-granularity fusion of underwater image enhancement, Earth Sci. Inform. 15 (3) (2022) 1647–1657.
[26]
J. Yuan, Z. Cai, W. Cao, TEBCF: real-world underwater image texture enhancement model based on blurriness and color fusion, IEEE Trans. Geosci. Remote Sens. 60 (2021) 1–15.
[27]
J. Xie, G. Hou, G. Wang, et al., A variational framework for underwater image dehazing and deblurring, IEEE Trans. Circ. Syst. Video Technol. 32 (6) (2021) 3514–3526.
[28]
W. Zhang, P. Zhuang, H.H. Sun, et al., Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement, IEEE Trans. Image Process. 31 (2022) 3997–4010.
[29]
Z. Fu, H. Lin, Y. Yang, et al., Unsupervised underwater image restoration: from a homology perspective, in: Proceedings of the AAAI Conference on Artificial Intelligence, 36, 2022, pp. 643–651.
[30]
K. Li, L. Wu, Q. Qi, et al., Beyond single reference for training: underwater image enhancement via comparative learning, IEEE Trans. Circ. Syst. Video Technol. (2022).
[31]
L. Zhang, L. Zhang, A.C. Bovik, A feature-enriched completely blind image quality evaluator, IEEE Trans. Image Process. 24 (8) (2015) 2579–2591.
[32]
A. Mittal, A.K. Moorthy, A.C. Bovik, No-reference image quality assessment in the spatial domain, IEEE Trans. Image Process. 21 (12) (2012) 4695–4708.
[33]
H. Talebi, P. Milanfar, NIMA: neural image assessment, IEEE Trans. Image Process. 27 (8) (2018) 3998–4011.
[34]
A. Mittal, R. Soundararajan, A.C. Bovik, Making a “completely blind” image quality analyzer, IEEe Signal. Process. Lett. 20 (3) (2012) 209–212.
[35]
K. Panetta, C. Gao, S. Agaian, Human-visual-system-inspired underwater image quality measures, IEEE J. Ocean. Eng. 41 (3) (2015) 541–551.
[36]
S. Wang, K. Ma, H. Yeganeh, et al., A patch-structure representation method for quality assessment of contrast changed images, IEEe Signal. Process. Lett. 22 (12) (2015) 2387–2390.
[37]
H.R. Sheikh, A.C. Bovik, Image information and visual quality, IEEE Trans. Image Process. 15 (2) (2006) 430–444.
[38]
K. Ding, K. Ma, S. Wang, et al., Image quality assessment: Unifying structure and texture similarity, IEEe Trans. Pattern. Anal. Mach. Intell. (2020).
[39]
Q. Huynh-Thu, M. Ghanbari, Scope of validity of PSNR in image/video quality assessment, Electron. Lett. 44 (13) (2008) 800–801.
[40]
Z. Wang, A.C. Bovik, H.R. Sheikh, et al., Image quality assessment: from error visibility to structural similarity, IEEE Trans. Image Process. 13 (4) (2004) 600–612.
[41]
Q. Liu, Q. Zhang, W. Liu, et al., WSDS-GAN: a weak-strong dual supervised learning method for underwater image enhancement, Pattern. Recognit. (2023).
[42]
X. Hua, X. Cui, X. Xu, et al., Underwater object detection algorithm based on feature enhancement and progressive dynamic aggregation strategy, Pattern Recognit. 139 (2023).
[43]
X. Xue, Z. Li, L. Ma, et al., Investigating intrinsic degradation factors by multi-branch aggregation for real-world underwater image enhancement, Pattern Recognit. 133 (2023).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Pattern Recognition
Pattern Recognition  Volume 157, Issue C
Jan 2025
967 pages

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 21 November 2024

Author Tags

  1. Recirculating aquaculture
  2. Hierarchical multi-patch
  3. Prior constraint
  4. Underwater enhancement

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Jan 2025

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media