Detection and Analysis of Corrosion on Coated Metal Surfaces Using Enhanced YOLO v5 Algorithm for Anti-Corrosion Performance Evaluation
Abstract
:1. Introduction
2. Materials and Methods
2.1. DATA
2.1.1. Dataset Collection
2.1.2. Dataset Augmentation
2.1.3. Image Annotation
2.2. YOLO v5-GOLD-NWD MODEL
2.2.1. Traditional YOLO v5 Model
2.2.2. GOLD-YOLO Model
2.2.3. NWD Loss Function
2.3. Model Evaluation Metrics
2.4. Evaluation Method of Corrosion Resistance in Coatings
3. Results
3.1. Evaluation of Model Accuracy
3.2. Evaluation of Corrosion Resistance in Coatings
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Abbas, M.; Shafiee, M. An overview of maintenance management strategies for corroded steel structures in extreme marine environments. Mar. Struct. 2020, 71, 102718. [Google Scholar] [CrossRef]
- Lei, Y.; Sheng, N.; Ohtsuka, T. Corrosion and Protection of Marine Engineering Materials; China-South Asia STM Publishing Center: New Delhi, India, 2021. [Google Scholar]
- Chandler, K.A. Marine and Offshore Corrosion: Marine Engineering Series; Elsevier: Amsterdam, The Netherlands, 2014. [Google Scholar]
- James, A.; Bazarchi, E.; Chiniforush, A.A.; Aghdam, P.P.; Hosseini, M.R.; Akbarnezhad, A.; Martek, I.; Ghodoosi, F. Rebar corrosion detection, protection, and rehabilitation of reinforced concrete structures in coastal environments: A review. Constr. Build. Mater. 2019, 224, 1026–1039. [Google Scholar] [CrossRef]
- Neocleous, K.; Christofe, A.; Agapiou, A.; Evagorou, E.; Themistocleous, K.; Hadjimitsis, D. Digital mapping of corrosion risk in coastal urban areas using remote sensing and structural condition assessment: Case study in Cyprus. Open Geosci. 2016, 8, 662–674. [Google Scholar] [CrossRef]
- Hu, J.; Zhang, S.; Chen, E.; Li, W. A review on corrosion detection and protection of existing reinforced concrete (RC) structures. Constr. Build. Mater. 2022, 325, 126718. [Google Scholar] [CrossRef]
- Imran, M.M.H.; Jamaludin, S.; Ayob, A.F.M.; Ali, A.A.I.M.; Ahmad, S.Z.A.S.; Akhbar, M.F.A.; Suhrab, M.I.R.; Zainal, N.; Norzeli, S.M.; Mohamed, S.B. Application of artificial intelligence in marine corrosion prediction and detection. J. Mar. Sci. Eng. 2023, 11, 256. [Google Scholar] [CrossRef]
- Lin, Z.; Zhang, W.; Li, J.; Yang, J.; Han, B.; Xie, P. Application of artificial intelligence (AI) in the area of corrosion protection. Anti-Corros. Methods Mater. 2023, 70, 243–251. [Google Scholar] [CrossRef]
- Ali, A.A.I.M.; Jamaludin, S.; Imran, M.M.H.; Ayob, A.F.M.; Ahmad, S.Z.A.S.; Akhbar, M.F.A.; Suhrab, M.I.R.; Ramli, M.R. Computer Vision and Image Processing Approaches for Corrosion Detection. J. Mar. Sci. Eng. 2023, 11, 1954. [Google Scholar] [CrossRef]
- Jiao, P.; Ye, X.; Zhang, C.; Li, W.; Wang, H. Vision-based real-time marine and offshore structural health monitoring system using underwater robots. Comput.-Aided Civ. Infrastruct. Eng. 2024, 39, 281–299. [Google Scholar] [CrossRef]
- Panda, J.P. Machine learning for naval architecture, ocean and marine engineering. J. Mar. Sci. Technol. 2023, 28, 1–26. [Google Scholar] [CrossRef]
- Idris, S.A.; Jafar, F.A. Image enhancement based on software filter optimization for corrosion inspection. In Proceedings of the 2014 5th International Conference on Intelligent Systems, Modelling and Simulation, Langkawi, Malaysia, 27–29 January 2014. [Google Scholar]
- Son, H.; Hwang, N.; Kim, C.; Kim, C. Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems. Autom. Constr. 2014, 42, 13–24. [Google Scholar] [CrossRef]
- Jahanshahi, M.R.; Masri, S.F. Parametric performance evaluation of wavelet-based corrosion detection algorithms for condition assessment of civil infrastructure systems. J. Comput. Civil Eng. 2013, 27, 345–357. [Google Scholar] [CrossRef]
- Chen, P.H.; Shen, H.K.; Lei, C.Y.; Chang, L.M. Fourier-transform-based method for automated steel bridge coating defect recognition. Proc. Eng. 2011, 14, 470–476. [Google Scholar] [CrossRef]
- Khayatazad, M.; De Pue, L.; De Waele, W. Detection of corrosion on steel structures using automated image processing. Dev. Built Environ. 2020, 3, 100022. [Google Scholar] [CrossRef]
- Xia, D.-H.; Song, S.; Tao, L.; Qin, Z.; Wu, Z.; Gao, Z.; Wang, J.; Hu, W.; Behnamian, Y.; Luo, J.-L. Review-material degradation assessed by digital image processing: Fundamentals, progresses, and challenges. J. Mater. Sci. Technol. 2020, 53, 146–162. [Google Scholar] [CrossRef]
- Bishop, C.M. Pattern Recognition and Machine Learning; Springer: Berlin/Heidelberg, Germany, 2006; pp. 645–678. [Google Scholar]
- Vapnik, V.N. An overview of statistical learning theory. IEEE Trans. Neural Netw. 1999, 10, 988–999. [Google Scholar] [CrossRef] [PubMed]
- Ahuja, S.K.; Shukla, M.K. A survey of computer vision-based corrosion detection approaches. In Information and Communication Technology for Intelligent Systems (ICTIS 2017); Kumar, S., Manoj, A., Shukla, K., Eds.; Springer International Publishing AG: Ahmedabad, India, 2018; Volume 2, pp. 55–63. [Google Scholar]
- Atha, D.J.; Jahanshahi, M.R. Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection. Struct. Health Monit. 2018, 17, 1110–1128. [Google Scholar] [CrossRef]
- Forkan, A.R.M.; Kang, Y.-B.; Jayaraman, P.P.; Liao, K.; Kaul, R.; Morgan, G.; Ranjan, R.; Sinha, S. CorrDetector: A framework for structural corrosion detection from drone images using ensemble deep learning. Expert Syst. Appl. 2022, 193, 116461. [Google Scholar] [CrossRef]
- Cha, Y.J.; Choi, W.; Suh, G.; Mahmoudkhani, S.; Büyüköztürk, O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput.-Aided Civ. Infrastruct. Eng. 2018, 33, 731–747. [Google Scholar] [CrossRef]
- Yao, Y.; Liu, G.J.; Li, S.Z.; Liu, M.; Chen, C.; Huang, T.; Lin, H.; Li, Z.; Liu, Y.; Wang, Z. Research Progress on Corrosion Prediction Model of Metallic Materials for Electrical Equipment. J. Chin. Soc. Corros. Prot. 2023, 43, 983–991. (In Chinese) [Google Scholar]
- Kordijazi, A.; Zhao, T.; Zhang, J.; Alrfou, K.; Rohatgi, P. A review of application of machine learning in design, synthesis, and characterization of metal matrix composites: Current status and emerging applications. JOM 2021, 73, 2060–2074. [Google Scholar] [CrossRef]
- Wang, H.T.; Han, E.-H.; Ke, W. Artificial neural network modeling for atmospheric corrosion of carbon steel and low alloy steel. Corros. Sci. Prot. Technol. 2006, 18, 144. (In Chinese) [Google Scholar]
- Hua, G.R.; Li, W.H.; Guo, Y.Y. Corrosion rate prediction of Q235 steel in Hainan substation grounding grid based on neural network models. Corros. Prot. 2017, 38, 573. (In Chinese) [Google Scholar]
- Zhao, L.; Luo, Z.; Deng, G.; Shi, V. Prediction of corrosion failure probability of buried oil and gas pipeline based on an RBF neural network. Front. Earth Sci. 2023, 11, 1148407. [Google Scholar] [CrossRef]
- Lu, H.; Peng, H.; Xu, Z.D.; Matthews, J.C.; Wang, N.; Iseley, T. A feature selection–based intelligent framework for predicting maximum depth of corroded pipeline defects. J. Perform. Constr. Facil. 2022, 36, 04022044. [Google Scholar] [CrossRef]
- Komijani, H.; Rezaeihassanabadi, S.; Parsaei, M.R.; Maleki, S. Radial basis function neural network for electrochemical impedance prediction at presence of corrosion inhibitor. Period. Polytech. Chem. Eng. 2017, 61, 128–132. [Google Scholar] [CrossRef]
- Liu, S.; Liu, H.; Liu, Z. Quantification of pitting corrosion from thermography using deep neural networks. Rev. Sci. Instrum. 2021, 92, 035116. [Google Scholar] [CrossRef]
- Bastian, B.T.; Jaspreeth, N.; Ranjith, S.K.; Jiji, C.V. Visual inspection and characterization of external corrosion in pipelines using deep neural network. NDT&E Int. 2019, 107, 102134. [Google Scholar]
- Luo, W.; Liu, T.; Li, W.; Luo, M. Pitting corrosion prediction based on electromechanical impedance and convolutional neural networks. Struct. Health Monit. 2023, 22, 1647–1664. [Google Scholar] [CrossRef]
- Idusuyi, N.; Samuel, O.J.; Olugasa, T.T.; Ajide, O.O.; Abu, R. Corrosion modelling using convolutional neural networks: A brief overview. J. Bio-Tribo-Corros. 2022, 8, 72. [Google Scholar] [CrossRef]
- Halama, M.; Kreislova, K.; Van Lysebettens, J. Prediction of atmospheric corrosion of carbon steel using artificial neural network model in local geographical regions. Corrosion 2011, 67, 065004-1. [Google Scholar] [CrossRef]
- Wang, H.; Han, E.; Ke, W. Predictive model for atmospheric corrosion of aluminium alloy by artificial neural network. J. Chin. Soc. Corros. Prot. 2006, 26, 272–274. (In Chinese) [Google Scholar]
- Jin, H.; Wang, M.; Xiang, H.; Liu, X.; Wang, C.; Fu, D. A PSO-RBF prediction method on flow corrosion of heat exchanger using the industrial operations data. Process Saf. Environ. Prot. 2024, 183, 11–23. [Google Scholar] [CrossRef]
- Yang, X.; Jia, L.; Meng, Q. A quantitative detection method for stress corrosion cracks in turbine discs using a BPSO-RBFNN model. Meas. Sci. Technol. 2018, 29, 095014. [Google Scholar] [CrossRef]
- Zhang, S.; Deng, X.; Lu, Y.; Hong, S.; Kong, Z.; Peng, Y.; Luo, Y. A channel attention based deep neural network for automatic metallic corrosion detection. J. Build. Eng. 2021, 42, 103046. [Google Scholar] [CrossRef]
- Barile, C.; Casavola, C.; Pappalettera, G.; Kannan, V.P. Designing a deep neural network for an acousto-ultrasonic investigation on the corrosion behaviour of CORTEN steel. Proc. Struct. Integr. 2022, 37, 307–313. [Google Scholar] [CrossRef]
- Andersen, R.; Nalpantidis, L.; Ravn, O.; Boukas, E. Investigating deep learning architectures towards autonomous inspection for marine classification. In Proceedings of the 2020 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), Abu Dhabi, United Arab Emirates, 4–6 November 2020. [Google Scholar]
- Yao, Y.; Yang, Y.; Wang, Y.; Zhao, X. Artificial intelligence-based hull structural plate corrosion damage detection and recognition using convolutional neural network. Appl. Ocean Res. 2019, 90, 101823. [Google Scholar] [CrossRef]
- Holm, E.; Transeth, A.A.; Knudsen, O.Ø.; Stahl, A. Classification of corrosion and coating damages on bridge constructions from images using convolutional neural networks. In Proceedings of the Twelfth International Conference on Machine Vision (ICMV 2019), Amsterdam, The Netherlands, 16–18 November 2019. [Google Scholar]
- Zhi, Y.; Fu, D.; Zhang, D.; Yang, T.; Li, X. Prediction and Knowledge Mining of Outdoor Atmospheric Corrosion Rates of Low Alloy Steels Based on the Random Forests Approach. Metals 2019, 9, 383. [Google Scholar] [CrossRef]
- Xinsheng, Z.; Baoquan, C. Corrosion prediction of submarine pipelines based on improved random forest model. China Saf. Sci. J. 2021, 31, 69. [Google Scholar]
- Diao, Y.; Yan, L.; Gao, K. Improvement of the machine learning-based corrosion rate prediction model through the optimization of input features. Mater. Des. 2021, 198, 109326. [Google Scholar] [CrossRef]
- Yan, L.; Diao, Y.; Lang, Z.; Gao, K. Corrosion rate prediction and influencing factors evaluation of low-alloy steels in marine atmosphere using machine learning approach. Sci. Technol. Adv. Mater. 2020, 21, 359–370. [Google Scholar] [CrossRef]
- Li, Q.; Xia, X.; Pei, Z.; Cheng, X.; Zhang, D.; Xiao, K.; Wu, J.; Li, X. Long-term corrosion monitoring of carbon steels and environmental correlation analysis via the random forest method. Npj Mater. Degrad. 2022, 6, 1. [Google Scholar] [CrossRef]
- Li, Q.; Wang, J.; Wang, K.; Yuan, J.; Xing, X.; Liu, X.; Hu, W. Determination of corrosion types from electrochemical noise by gradient boosting decision tree method. Int. J. Electrochem. Sci. 2019, 14, 1516–1528. [Google Scholar] [CrossRef]
- Fang, S.F.; Wang, M.P.; Qi, W.H.; Zheng, F. Hybrid genetic algorithms and support vector regression in forecasting atmospheric corrosion of metallic materials. Comput. Mater. Sci. 2008, 44, 647–655. [Google Scholar] [CrossRef]
- Lv, Y.J.; Wang, J.W.; Wang, J.; Xiong, C.; Zou, L.; Li, L.; Li, D.W. Steel corrosion prediction based on support vector machines. Chaos Solitons Fractals 2020, 136, 109807. [Google Scholar] [CrossRef]
- Zhang, W.D.; Shen, B.; Ai, Y.B.; Yang, B. Gas pipeline corrosion prediction based on modified support vector machine and unequal interval model. Appl. Mech. Mater. 2013, 373, 1987–1994. [Google Scholar] [CrossRef]
- Chen, P.H.; Shen, H.K.; Lei, C.Y.; Chang, L.M. Support-vector-machine-based method for automated steel bridge rust assessment. Autom. Constr. 2012, 23, 9–19. [Google Scholar] [CrossRef]
- Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 26 June–1 July 2016. [Google Scholar]
- Jia, Z.; Fu, M.; Zhao, X.; Cui, Z. Intelligent identification of metal corrosion based on Corrosion-YOLOv5s. Displays 2023, 76, 102367. [Google Scholar] [CrossRef]
- Zhang, D.Y.; Wei, P.H.; Tan, M.W.; Chen, C.; Wang, L.; Hong, W. Investigation of aircraft surface defects detection based on YOLO neural network. In Proceedings of the 2020 7th International Conference on Information Science and Control Engineering (ICISCE), Changsha, China, 18–20 December 2020. [Google Scholar]
- Nabizadeh, E.; Parghi, A. Automated corrosion detection using deep learning and computer vision. Asian J. Civ. Eng. 2023, 24, 2911–2923. [Google Scholar] [CrossRef]
- Ameli, Z.; Nesheli, S.J.; Landis, E.N. Deep Learning-Based Steel Bridge Corrosion Segmentation and Condition Rating Using Mask RCNN and YOLOv8. Infrastructures 2023, 9, 3. [Google Scholar] [CrossRef]
- Jocher, G.; Nishimura, K.; Mineeva, T.; Vilariño, R. YOLOv5; GitHub Repository. 2020. Available online: https://github.com/ultralytics/yolov5 (accessed on 15 May 2024).
- Wang, C.; He, W.; Nie, Y.; Guo, J.; Liu, C.; Wang, Y.; Han, K. Gold-YOLO: Efficient object detector via gather-and-distribute mechanism. In Proceedings of the NeurIPS Proceedings 2023, New Orleans, LA, USA, 10–16 December 2023. [Google Scholar]
- Wang, J.; Xu, C.; Yang, W.; Yu, L. A normalized Gaussian Wasserstein distance for tiny object detection. arXiv 2021, arXiv:2110.13389. [Google Scholar]
- Heer, J. Fast & Accurate Gaussian Kernel Density Estimation. In Proceedings of the 2021 IEEE Visualization Conference (VIS), New Orleans, LA, USA, 24–29 October 2021. [Google Scholar]
Coating | Metal Substrate | Coating Composition | Total Coating Thickness |
---|---|---|---|
Powder epoxy coating | Q235 Steel | Powder Epoxy Coating (700 μm) | 700 μm |
Fluorocarbon coating | Q235 Steel | Epoxy Zinc-Rich Primer (70 μm)/Sealer/High-Build Epoxy Asphalt (300 μm)/Fluorocarbon Topcoat (60 μm) | 430 μm |
Epoxy coating | Q235 Steel | Inorganic Zinc-Rich Primer (70 μm)/Epoxy Mastic (150 μm)/Epoxy Topcoat (70 μm) | 290 μm |
Chlorinated rubber | Q235 Steel | Inorganic Zinc-Rich Primer (70 μm)/Sealer/Solvent-Free Ultra-High Build Epoxy Intermediate Coating (430 μm) | 500 μm |
Wuxi anti-fouling coating | Q235 Steel | Epoxy Zinc-Rich Primer (70 μm)/Epoxy Mastic (230 μm)/Wuxi Anti-Fouling Coating (150 μm) | 450 μm |
Model | Precision | Recall | F1 Score | Prediction Probability |
---|---|---|---|---|
YOLO v5 | 0.74 | 0.66 | 0.70 | 0.66 |
YOLO v5-NWD | 0.74 | 0.69 | 0.72 | 0.69 |
YOLO v5-GOLD-NWD | 0.78 | 0.71 | 0.74 | 0.71 |
Metal Substrate | Coating | Symbols | Experimental Period (Months) | Number of Image Data | Number of Corrosion Spots |
---|---|---|---|---|---|
Q235 Steel | Powder epoxy coating | P | 24 | 8 | 11 |
60 | 14 | 19 | |||
Fluorocarbon coating | F | 24 | 8 | 28 | |
60 | 12 | 33 | |||
Epoxy coating | E | 24 | 16 | 162 | |
60 | 24 | 410 | |||
Chlorinated rubber | C | 24 | 2 | 21 | |
60 | 12 | 125 | |||
Wuxi anti-fouling coating | W | 24 | 8 | 129 |
Coating | Tested Samples | |||
---|---|---|---|---|
24 Months | Appearance Description | 60 Months | Appearance Description | |
P | No significant changes | No significant changes | ||
F | Glossy, rust free, covered with 1–4 mm blisters | Glossy, rust free, covered with 1–3 mm blisters | ||
E | No significant changes | There are many bubbles and a few small rust spots | ||
C | No significant changes | Outer layer bulging, surface coating peeling off, with rust spots | ||
W | There is a dissolved coating on the surface and slight corrosion |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Yu, Q.; Han, Y.; Lin, W.; Gao, X. Detection and Analysis of Corrosion on Coated Metal Surfaces Using Enhanced YOLO v5 Algorithm for Anti-Corrosion Performance Evaluation. J. Mar. Sci. Eng. 2024, 12, 1090. https://doi.org/10.3390/jmse12071090
Yu Q, Han Y, Lin W, Gao X. Detection and Analysis of Corrosion on Coated Metal Surfaces Using Enhanced YOLO v5 Algorithm for Anti-Corrosion Performance Evaluation. Journal of Marine Science and Engineering. 2024; 12(7):1090. https://doi.org/10.3390/jmse12071090
Chicago/Turabian StyleYu, Qifeng, Yudong Han, Wuguang Lin, and Xinjia Gao. 2024. "Detection and Analysis of Corrosion on Coated Metal Surfaces Using Enhanced YOLO v5 Algorithm for Anti-Corrosion Performance Evaluation" Journal of Marine Science and Engineering 12, no. 7: 1090. https://doi.org/10.3390/jmse12071090