research-article

A texture-aware one-stage fabric defect detection network with adaptive feature fusion and multi-task training

Authors:

Biqing HuangAuthors Info & Claims

Journal of Intelligent Manufacturing, Volume 35, Issue 3

Pages 1267 - 1280

https://doi.org/10.1007/s10845-023-02105-4

Published: 29 March 2023 Publication History

Abstract

Fabric defect detection is an indispensable process to guarantee product quality in industrial production. With the proposal of industry 4.0, manufacturing enterprises have been endeavoring to develop automatic fabric defect detection systems to overcome the shortcomings of traditional manual defect detection, and many researchers have been devoting themselves to designing fabric defect detection methods with high effectiveness and strong anti-noise capacity. In the paper, we notice that the perception of the normal fabric textures is beneficial to detecting fabric defects, which is ignored in previous researches for classic one-stage detection network. Based on this finding, we propose a texture-aware one-stage fabric defect detection network (TADet). First, an adaptive feature fusion module is designed to merge and enhance multi-resolution features, where the attention mechanism is employed to make the feature fusion process adaptive to the input fabric images with different textures. Second, a multi-task defect detection head is proposed for forcing the network to distinguish the defect regions and texture regions while classifying and locating defects simultaneously in the training phase. With the defect-texture distinguishing tasks, the network is able to consider the fabric textures explicitly when detecting defects. The experimental results show that the proposed TADet outperforms other two-stage models by 3.7% and one-stage detection models by 9.3% on mAP. Besides, further experiments verify the high efficiency and strong noise-robustness of the proposed TADet, which shows its potential for industrial applications.

References

[1]

Badrinarayanan V, Kendall A, and Cipolla R Segnet: A deep convolutional encoder-decoder architecture for image segmentation IEEE Transactions on Pattern Analysis and Machine Intelligence 2017 39 12 2481-2495

[2]

Ben Gharsallah M and Ben Braiek E A visual attention system based anisotropic diffusion method for an effective textile defect detection The Journal of The Textile Institute 2021 112 12 1925-1939

[3]

Cai, Z., & Vasconcelos, N. (2018). Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 6154–6162).

[4]

Cao J, Yang G, and Yang X A pixel-level segmentation convolutional neural network based on deep feature fusion for surface defect detection IEEE Transactions on Instrumentation and Measurement 2020 70 1-12

[5]

Chen R, Cai D, Hu X, Zhan Z, and Wang S Defect detection method of aluminum profile surface using deep selfattention mechanism under hybrid noise conditions IEEE Transactions on Instrumentation and Measurement 2021 70 1-9

[6]

Chen S-H and Tsai C-C Smd led chips defect detection using a yolov3-dense model Advanced Engineering Informatics 2021 47 101255

[7]

Cheng X and Yu J Retinanet with difference channel attention and adaptively spatial feature fusion for steel surface defect detection IEEE Transactions on Instrumentation and Measurement 2020 70 1-11

[8]

Fang H, Xia M, Liu H, Chang Y, Wang L, and Liu X Automatic zipper tape defect detection using two-stage multi-scale convolutional networks Neurocomputing 2021 422 34-50

[9]

He Y, Song K, Meng Q, and Yan Y An end-to-end steel surface defect detection approach via fusing multiple hierarchical features IEEE Transactions on Instrumentation and Measurement 2019 69 4 1493-1504

[10]

He, Y., Zhu, C., Wang, J., Savvides, M., & Zhang, X. (2019). Bounding box regression with uncertainty for accurate object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2888–2897).

[11]

Hu B and Wang J Detection of pcb surface defects with improved faster-rcnn and feature pyramid network IEEE Access 2020 8 108335-108345

[12]

Hu, G., Yang, Y., Yi, D., Kittler, J., Christmas, W., Li, S.Z., & Hospedales, T. (2015). When face recognition meets with deep learning: an evaluation of convolutional neural networks for face recognition. In Proceedings of the IEEE International Conference on Computer Vision Workshops (pp. 142–150).

[13]

Jing J, Wang Z, Rätsch M, and Zhang H Mobile-unet: An efficient convolutional neural network for fabric defect detection Textile Research Journal 2022 92 1–2 30-42

[14]

Kim J, Ko J, Choi H, and Kim H Printed circuit board defect detection using deep learning via a skip-connected convolutional autoencoder Sensors 2021 21 15 4968

[15]

Kisantal, M., Wojna, Z., Murawski, J., Naruniec, J., & Cho, K. (2019). Augmentation for small object detection. arXiv:1902.07296

[16]

Krizhevsky A, Sutskever I, and Hinton GE Imagenet classification with deep convolutional neural networks Communications of the ACM 2017 60 6 84-90

Digital Library

[17]

Li C, Li J, Li Y, He L, Fu X, and Chen J Fabric defect detection in textile manufacturing: A survey of the state of the art Security and Communication Networks 2021 2021 1-13

[18]

Lin H, Li B, Wang X, Shu Y, and Niu S Automated defect inspection of led chip using deep convolutional neural network Journal of Intelligent Manufacturing 2019 30 6 2525-2534

Digital Library

[19]

Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017). Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2117– 2125).

[20]

Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017). Focal loss for dense object detection. In Proceedings of the IEEE International Conference on Computer Vision (pp. 2980–2988).

[21]

Liu, Z., Liu, S., Li, C., Ding, S., & Dong, Y. (2018). Fabric defects detection based on SSD. In Proceedings of the 2nd International Conference on Graphics and Signal Processing (pp. 74–78)

[22]

Medak D, Posilović L, Subašić M, Budimir M, and Lončarić S Automated defect detection from ultrasonic images using deep learning IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control 2021 68 10 3126-3134

[23]

Peng P, Wang Y, Hao C, Zhu Z, Liu T, and Zhou W Automatic fabric defect detection method using Pran-net Applied Sciences 2020 10 23 8434

[24]

Rebhi A, Benmhammed I, Abid S, and Fnaiech F Fabric defect detection using local homogeneity analysis and neural network Journal of Photonics 2015 2015 1-9

[25]

Redmon, J., & Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv:1804.02767

[26]

Ren R, Hung T, and Tan KC A generic deep-learning-based approach for automated surface inspection IEEE Transactions on Cybernetics 2017 48 3 929-940

[27]

Ren S, He K, Girshick R, and Sun J Faster r-cnn: Towards real-time object detection with region proposal networks Advances in Neural Information Processing Systems 2015 28 91-99

Digital Library

[28]

Shi B, Liang J, Di L, Chen C, and Hou Z Fabric defect detection via lowrank decomposition with gradient information and structured graph algorithm Information Sciences 2021 546 608-626

[29]

Sun, Y., Wang, S., Chen, C., & Xiang, T.-Z. (2022). Boundary-guided camouflaged object detection. arXiv:2207.00794

[30]

Tiwari V and Sharma G Automatic fabric fault detection using morphological operations on bit plane International Journal of Computer Science and Network Security 2015 15 10 30

[31]

Wang H, Li Z, and Wang H Few-shot steel surface defect detection IEEE Transactions on Instrumentation and Measurement 2021 71 1-12

[32]

Xu X, Chen J, Zhang H, and Ng WW D4net: De-deformation defect detection network for non-rigid products with large patterns Information Sciences 2021 547 763-776

[33]

Zeng N, Wu P, Wang Z, Li H, Liu W, and Liu X A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection IEEE Transactions on Instrumentation and Measurement 2022 71 1-14

[34]

Zhang C, Feng S, Wang X, and Wang Y Zju-leaper: A benchmark dataset for fabric defect detection and a comparative study IEEE Transactions on Artificial Intelligence 2020 1 3 219-232

[35]

Zhang, H., Chang, H., Ma, B.,Wang, N., & Chen, X. (2020). Dynamic r-cnn: Towards high quality object detection via dynamic training. In European Conference on Computer Vision (pp. 260–275).

[36]

Zhu, J.-Y., Park, T., Isola, P., & Efros, A.A. (2017). Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE International Conference on Computer Vision (pp. 2223–2232).

Cited By

Liu QLiu MJonathan QShen W(2024)A real-time anchor-free defect detector with global and local feature enhancement for surface defect detectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123199246:COnline publication date: 15-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123199

Recommendations

Fabric Defect Detection via Multi-scale Feature Fusion-Based Saliency
Pattern Recognition and Computer Vision
Abstract
Automatic fabric defect detection plays a key role in controlling product quality. Salient object detection (SOD) based on convolutional neural network has been proven applicable in fabric defect detection, but how to learn powerful features and ...
Read More
Fabric defect detection using local contrast deviations

Defect inspection is a vital step for quality assurance in fabric production. The development of a fully automated fabric defect detection system requires robust and efficient fabric defect detection algorithms. The inspection of real fabric defects is ...
Read More
Fabric Defect Detection Method Based on Gabor Filter Mask
GCIS '09: Proceedings of the 2009 WRI Global Congress on Intelligent Systems - Volume 03

In this paper, a fabric defect detection method based on Gabor filter masks is proposed. In this method, one even symmetric Gabor filter mask and one odd symmetric Gabor filter mask derived from the impulse response of the optimal Gabor filter are used. ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Journal of Intelligent Manufacturing

Journal of Intelligent Manufacturing Volume 35, Issue 3

Mar 2024

458 pages

ISSN:0956-5515

Issue’s Table of Contents

© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 29 March 2023

Accepted: 02 March 2023

Received: 01 July 2022

Author Tags

Qualifiers

Research-article

Funding Sources

National Key R &D Program of China
The Institute for Guo Qiang, Tsinghua University

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Liu QLiu MJonathan QShen W(2024)A real-time anchor-free defect detector with global and local feature enhancement for surface defect detectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123199246:COnline publication date: 15-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123199

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents