Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3497623.3497641acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

Few-shot Steel Surface Defect Detection Based on Meta Learning

Published: 04 February 2022 Publication History
  • Get Citation Alerts
  • Abstract

    The performance of the deep learning-based object detection algorithms mainly relies on the large-scale image sets. However, it is extremely difficult to collect the defect samples in the practical steel production. Few-shot object detection provides an ideal solution for the insufficient training sets. However, the efficient feature extractor is crucial for the few-shot object detection methods. In this paper, a novel few-shot defect detection method on Steel Surface is proposed based on the meta-learning technology. The detection model includes three main components: a meta feature learner, a feature matching module and a bounding box prediction module. The meta features are extracted from the base classes with large-scale sets using the meta feature learner, and it can be generalized to detect the novel steel surface defects. The feature matching module adopts a few support images from the base classes and the novel class to generalize a global feature vector which can be used to adjust the weights of meta features maps for detecting the corresponding defects. The bounding box prediction module is designed to conduct the defect detection on the adjusted feature maps. Experiments on the steel surface defect dataset demonstrate that our proposed method can efficiently localize the defects with only a few annotated samples, and outperform the well-established baseline models.

    References

    [1]
    Peng, K., and Zhang, X. 2009. Classification Technology for Automatic Surface Defects Detection of Steel Strip Based on Improved BP Algorithm. In 2009 Fifth International Conference on Natural Computation, Vol. 1, pp. 110–114.
    [2]
    Amid, E., Aghdam, S. R., and Amindavar, H. 2012. Enhanced Performance for Support Vector Machines as Multiclass Classifiers in Steel Surface Defect Detection. World Academy of Science, Engineering and Technology, International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering, 6(7), 693–697.
    [3]
    Ren, S., He, K., Girshick, R., and Sun, J. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137–1149.
    [4]
    Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. 2016. You Only Look Once: Unified, Real-Time Object Detection. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 779–788).
    [5]
    Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S. E., Fu, C.-Y., and Berg, A. C. 2016. SSD: Single Shot MultiBox Detector. In 14th European Conference on Computer Vision, ECCV 2016 (pp. 21–37).
    [6]
    Chen, H., Wang, Y., Wang, G., and Qiao, Y. 2018. LSTD: A Low-Shot Transfer Detector for Object Detection. In AAAI (pp. 2836–2843).
    [7]
    Wang, X., Huang, T., Gonzalez, J., Darrell, T., and Yu, F. 2020. Frustratingly Simple Few-Shot Object Detection. In ICML 2020: 37th International Conference on Machine Learning, Vol. 1, pp. 9919–9928.
    [8]
    Kim, G., Jung, H.-G., and Lee, S.-W. 2020. Few-Shot Object Detection via Knowledge Transfer. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 3564–3569).
    [9]
    Kang, B., Liu, Z., Wang, X., Yu, F., Feng, J., and Darrell, T. 2019. Few-Shot Object Detection via Feature Reweighting. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 8420–8429).
    [10]
    Li, X., Deng, J., and Fang, Y. 2021. Few-Shot Object Detection on Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, (99), 1–14.
    [11]
    Liu, L., Ma, B., Zhang, Y., Yi, X., and Li, H. 2020. AFD-Net: Adaptive Fully-Dual Network for Few-Shot Object Detection. ArXiv Preprint ArXiv:2011.14667.
    [12]
    Jia, L., Chen, C., Xu, S., and Shen, J. 2020. Fabric defect inspection based on lattice segmentation and template statistics. Information Sciences, 512, 964–984.
    [13]
    Liu, G., and Zheng, X. 2021. Fabric defect detection based on information entropy and frequency domain saliency. The Visual Computer, 37(3), 515–528.
    [14]
    Kang, X., and Zhang, E. 2020. A Universal and Adaptive Fabric Defect Detection Algorithm Based on Sparse Dictionary Learning. IEEE Access, 8, 221808–221830.
    [15]
    Shi, B., Liang, J., Di, L., Chen, C., and Hou, Z. 2021. Fabric defect detection via low-rank decomposition with gradient information and structured graph algorithm. Information Sciences, 546, 608–626.
    [16]
    Hu, G., Huang, J., Wang, Q., Li, J., Xu, Z., and Huang, X. 2020. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network. Textile Research Journal, 90, 247–270.
    [17]
    Liu, J., Wang, C., Su, H., Du, B., and Tao, D. 2020. Multistage GAN for Fabric Defect Detection. IEEE Transactions on Image Processing, 29, 3388–3400.
    [18]
    Yan, X., Chen, Z., Xu, A., Wang, X., Liang, X., and Lin, L. 2019. Meta R-CNN: Towards General Solver for Instance-Level Low-Shot Learning. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 9577–9586).
    [19]
    Xiao, Y., and Marlet, R. 2020. Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wild. In European Conference on Computer Vision (pp. 192–210).
    [20]
    Redmon, J., and Farhadi, A. 2017. YOLO9000: Better, Faster, Stronger. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 6517–6525).
    [21]
    Xian, T., Dapeng, Z., Wenzhi, M., Xilong, L., De, X., and Tao, X. 2018. Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks. Applied Sciences, 8(9), 1575.
    [22]
    Huang, Y., Jing, J., and Wang, Z. 2021. Fabric Defect Segmentation Method Based on Deep Learning. IEEE Transactions on Instrumentation and Measurement, 70(99), 1–15.
    [23]
    Girshick, R. (2015). Fast R-CNN. In 2015 IEEE International Conference on Computer Vision (ICCV) (pp. 1440–1448).
    [24]
    Fu, G., Sun, P., Zhu, W., Yang, J., Cao, Y., Yang, M. Y., and Cao, Y. 2019. A deep-learning-based approach for fast and robust steel surface defects classification. Optics and Lasers in Engineering, 121, 397–405.

    Cited By

    View all
    • (2024)ODNet: A High Real-Time Network Using Orthogonal Decomposition for Few-Shot Strip Steel Surface Defect ClassificationSensors10.3390/s2414463024:14(4630)Online publication date: 17-Jul-2024

    Index Terms

    1. Few-shot Steel Surface Defect Detection Based on Meta Learning
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Other conferences
          ICCPR '21: Proceedings of the 2021 10th International Conference on Computing and Pattern Recognition
          October 2021
          393 pages
          ISBN:9781450390439
          DOI:10.1145/3497623
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 04 February 2022

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. Few-shot detection
          2. Few-shot learning
          3. Object detection
          4. Steel surface defect detection

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Conference

          ICCPR '21

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)72
          • Downloads (Last 6 weeks)2
          Reflects downloads up to 26 Jul 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)ODNet: A High Real-Time Network Using Orthogonal Decomposition for Few-Shot Strip Steel Surface Defect ClassificationSensors10.3390/s2414463024:14(4630)Online publication date: 17-Jul-2024

          View Options

          Get Access

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media