Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Texture surface defect detection of plastic relays with an enhanced feature pyramid network

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

Deep learning has seen its promising applications in manufacturing processes. In this study, a deep network named Cascade Tri-DFPN based on the two-stage target detection algorithm is proposed for detecting the defects on the texture surface of plastic relays. The network adopts a derivative Resnet-101d as the backbone to obtain a loss-reduced feature extraction. Meanwhile, an enhanced feature pyramid module is put forward to enhance the feature representation of the network by adding a dense connection of feature layers through the self-attentive block. Moreover, the defect region proposals are optimized by introducing a cascade module to obtain high-quality defective proposal boxes. Experimental results on the augmented data set of relays’ surface defect reveal an average accuracy of 88.57% and an average recall rate of 94.58%, much higher than those of traditional RCNN or FPN detectors, demonstrating the remarkable improvement of the proposed network. Robustness of the method is also verified by performing tests with deteriorative image processing, which indicates an eligible defect detection under relatively complex scenarios such as image blurring. The proposed deep network could be used in surface defect detection of plastic relays and other potentially related industrial defect detection fields.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  • Bochkovskiy, A., Wang, C. Y., & Liao, H. Y. M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv:2004.10934.

  • Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017). Soft-NMS—improving object detection with one line of code. In Proceedings of the IEEE international conference computer vision (Vol. 2017-Octob, pp. 5562–5570). https://doi.org/10.1109/ICCV.2017.593.

  • Cai, Z., & Vasconcelos, N. (2018). Cascade R-CNN: Delving into high quality object detection. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 6154–6162). https://doi.org/10.1109/CVPR.2018.00644.

  • Cartucho, J., Ventura, R., & Veloso, M. (2018). Robust object recognition through symbiotic deep learning in mobile robots. In IEEE international conference on intelligent robots and systems (pp. 2336–2341). https://doi.org/10.1109/IROS.2018.8594067.

  • Chen, X., & Zhang, H. (2020). Rail surface defects detection based on faster R-CNN. In Proceedings of the international conference on artificial intelligence and electromechanical automation AIEA 2020 (pp. 819–822). https://doi.org/10.1109/AIEA51086.2020.00179.

  • Chen, H., Pang, Y., Hu, Q., & Liu, K. (2020). Solar cell surface defect inspection based on multispectral convolutional neural network. Journal of Intelligent Manufacturing, 31(2), 453–468. https://doi.org/10.1007/s10845-018-1458-z

    Article  Google Scholar 

  • Dong, H., Song, K., He, Y., Xu, J., Yan, Y., & Meng, Q. (2020). PGA-Net: Pyramid feature fusion and global context attention network for automated surface defect detection. IEEE Transactions on Industrial Informatics, 16(12), 7448–7458. https://doi.org/10.1109/TII.2019.2958826

    Article  Google Scholar 

  • Fu, G., et al. (2019). A deep-learning-based approach for fast and robust steel surface defects classification. Optics and Lasers in Engineering, 121(May), 397–405. https://doi.org/10.1016/j.optlaseng.2019.05.005

    Article  Google Scholar 

  • Gao, R., et al. (2021). Small foreign metal objects detection in X-ray images of clothing products using faster R-CNN and feature pyramid network. IEEE Transactions on Instrumentation and Measurement, 70, 666. https://doi.org/10.1109/TIM.2021.3077666

    Article  Google Scholar 

  • Ghiasi, G., Lin, T. Y., & Le, Q. V. (2019). NAS-FPN: Learning scalable feature pyramid architecture for object detection. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (Vol. 2019-June, pp. 7029–7038). https://doi.org/10.1109/CVPR.2019.00720.

  • Girshick, R. (2015). Fast R-CNN. In Proceedings of the IEEE international conference computer vision (Vol. 2015 Inter, pp. 1440–1448). https://doi.org/10.1109/ICCV.2015.169.

  • Hao, R., Lu, B., Cheng, Y., Li, X., & Huang, B. (2020). A steel surface defect inspection approach towards smart industrial monitoring. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-020-01670-2

    Article  Google Scholar 

  • Hu, B., & Wang, J. (2020). Detection of PCB surface defects with improved faster-RCNN and feature pyramid network. IEEE Access, 8, 108335–108345. https://doi.org/10.1109/ACCESS.2020.3001349

    Article  Google Scholar 

  • Huang, Y., Jing, J., & Wang, Z. (2021). Fabric defect segmentation method based on deep learning. IEEE Transactions on Instrumentation and Measurement. https://doi.org/10.1109/TIM.2020.3047190

    Article  Google Scholar 

  • Jin, C. H., Kim, H. J., Piao, Y., Li, M., & Piao, M. (2020). Wafer map defect pattern classification based on convolutional neural network features and error-correcting output codes. Journal of Intelligent Manufacturing, 31(8), 1861–1875. https://doi.org/10.1007/s10845-020-01540-x

    Article  Google Scholar 

  • Li, Y., & Xu, J. (2020). Electronic product surface defect detection based on a MSSD network. In Proceedings of 2020 IEEE 4th information technology, networking, electronic and automation control conference (ITNEC 2020) (Vol. 1, No. Itnec, pp. 773–777). https://doi.org/10.1109/ITNEC48623.2020.9084756.

  • Li, H., Zhang, H., Liu, L., Zhong, H., Wang, Y., & Jonathan Wu, Q. M. (2020). Integrating deformable convolution and pyramid network in cascade R-CNN for fabric defect detection. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 3029–3036. https://doi.org/10.1109/SMC42975.2020.9282875

    Article  Google Scholar 

  • Lin, T.-Y., Doll’ar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2019). Feature pyramid networks for object detection. In Proc. - 2019 IEEE Intl Conf Parallel Distrib. Process. with Appl. Big Data Cloud Comput. Sustain. Comput. Commun. Soc. Comput. Networking, ISPA/BDCloud/SustainCom/SocialCom 2019 (pp. 1500–1504). https://doi.org/10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00217.

  • Lin, H., Li, B., Wang, X., Shu, Y., & Niu, S. (2019). Automated defect inspection of LED chip using deep convolutional neural network. Journal of Intelligent Manufacturing, 30(6), 2525–2534. https://doi.org/10.1007/s10845-018-1415-x

    Article  Google Scholar 

  • Liu, W. et al. (2016). SSD: Single shot multibox detector, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)'s, vol. 9905 LNCS, pp. 21–37. https://doi.org/10.1007/978-3-319-46448-0_2.

  • Liu, S., Qi, L., Qin, H., Shi, J., & Jia, J. (2018). Path aggregation network for instance segmentation. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 8759–8768). https://doi.org/10.1109/CVPR.2018.00913.

  • Liu, L., Zhu, Y., Ur Rahman, M. R., Zhao, P. & Chen, H. (2019). Surface defect detection of solar cells based on feature pyramid network and GA-faster-RCNN. In Proceedings of the 2nd China Symposium on Cognitive Computing and Hybrid Intelligence, CCHI 2019 (pp. 292–297). https://doi.org/10.1109/CCHI.2019.8901952.

  • Liu, K., Wang, H., Chen, H., Qu, E., Tian, Y., & Sun, H. (2017). Steel Surface defect detection using a new Haar-Weibull-variance model in unsupervised manner. IEEE Transactions on Instrumentation and Measurement, 66(10), 2585–2596. https://doi.org/10.1109/TIM.2017.2712838

    Article  Google Scholar 

  • Padilla, R., Passos, W. L., Dias, T. L. B., Netto, S. L., & Da Silva, E. A. B. (2021). A comparative analysis of object detection metrics with a companion open-source toolkit. Electron, 10(3), 1–28. https://doi.org/10.3390/electronics10030279

    Article  Google Scholar 

  • Pang, J., Chen, K., Shi, J., Feng, H., Ouyang, W., & Lin, D. (2019). Libra R-CNN: Towards balanced learning for object detection. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (Vol. 2019-June, no. 2, pp. 821–830). https://doi.org/10.1109/CVPR.2019.00091.

  • Qiu, L., Wu, X., & Yu, Z. (2019). A high-efficiency fully convolutional networks for pixel-wise surface defect detection. IEEE Access, 7, 15884–15893. https://doi.org/10.1109/ACCESS.2019.2894420

    Article  Google Scholar 

  • Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  • Sheikh, H. R., & Bovik, A. C. (2004). Image information and visual quality. In Proceedings of the ICASSP, IEEE international conference on acoustics, speech and signal processing (ICASSP) (Vol. 3, No. 2, pp. 430–444). https://doi.org/10.1109/icassp.2004.1326643.

  • Song, K., & Yan, Y. (2013). A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Applied Surface Science, 285(PARTB), 858–864. https://doi.org/10.1016/j.apsusc.2013.09.002

    Article  Google Scholar 

  • Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (Vol. 2016-Decem, pp. 2818–2826). https://doi.org/10.1109/CVPR.2016.308.

  • Tan, M., Pang, R., & Le, Q. V. (2020). EfficientDet: Scalable and efficient object detection. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 10778–10787). https://doi.org/10.1109/CVPR42600.2020.01079.

  • Wang, X., Girshick, R., Gupta, A., & He, K. (2018). Non-local neural networks. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (pp. 7794–7803). https://doi.org/10.1109/CVPR.2018.00813.

  • Wang, J., Chen, K., Yang, S., Loy, C. C., & Lin, D. (2019). Region proposal by guided anchoring. In Proceedings of the IEEE computer society conference on computer vision and pattern recognition (Vol. 2019-June, pp. 2960–2969). https://doi.org/10.1109/CVPR.2019.00308.

  • Wang, B., & Huang, F. (2021). A lightweight deep network for defect detection of insert molding based on X-ray imaging. Sensors (switzerland). https://doi.org/10.3390/s21165612

    Article  Google Scholar 

  • Xie, H., & Wu, Z. (2020). A robust fabric defect detection method based on improved refinedet. Sensors (switzerland), 20(15), 1–24. https://doi.org/10.3390/s20154260

    Article  Google Scholar 

  • Yang, L., & Jiang, H. (2021). Weld defect classification in radiographic images using unified deep neural network with multi-level features. Journal of Intelligent Manufacturing, 32(2), 459–469. https://doi.org/10.1007/s10845-020-01581-2

    Article  Google Scholar 

  • Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017). Mixup: Beyond empirical risk minimization (pp. 1–13).

  • Zhang, H., Chen, Y., Song, Y., Xiong, Z., Yang, Y., & Jonathan Wu, Q. M. (2019). Automatic kidney lesion detection for CT images using morphological cascade convolutional neural networks. IEEE Access, 7, 83001–83011. https://doi.org/10.1109/ACCESS.2019.2924207

    Article  Google Scholar 

  • Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., & Ren, D. (2019). Distance-IoU loss: Faster and better learning for bounding box regression (No. 2). https://doi.org/10.1609/aaai.v34i07.6999.

Download references

Funding

This study was funded by Zhejiang Provincial Natural Science Foundation of China (Grant No. LY20E050013).

Author information

Authors and Affiliations

  1. School of Mechanical and Energy Engineering, Zhejiang University of Science and Technology, Hangzhou, China

    Feng Huang & Qi-peng Li

  2. College of Metrology and Measurement Engineering, China Jiliang University, Hangzhou, China

    Feng Huang & Ben-wu Wang

  3. State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, China

    Feng Huang & Jun Zou

Authors
  1. Feng Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ben-wu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qi-peng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jun Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Qi-peng Li or Jun Zou.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, F., Wang, Bw., Li, Qp. et al. Texture surface defect detection of plastic relays with an enhanced feature pyramid network. J Intell Manuf 34, 1409–1425 (2023). https://doi.org/10.1007/s10845-021-01864-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10845-021-01864-2

Keywords

Search

Navigation