Circuit Manufacturing Defect Detection Using VGG16 Convolutional Neural Networks
Abstract
Manufacturing, one of the most valuable industries in the world, is boundlessly automatable yet still quite stuck in traditionally manual and slow processes. Industry 4.0 is racing to define a new era of digital manufacturing through Internet of Things- (IoT-) connected machines and factory systems, fully comprehensive data gathering, and seamless implementation of data-driven decision-making and action taking. Both academia and industry understand the tremendous value in modernizing manufacturing and are pioneering bleeding-edge strides every day to optimize one of the largest industries in the world. IoT production, functional testing, and fault detection equipment are already being used in today’s maturing smart factory paradigm to superintend intelligent manufacturing equipment and perform automated defect detection in order to enhance production quality and efficiency. This paper presents a powerful and precise computer vision model for automated classification of defect product from standard product. Human operators and inspectors without digital aid must spend inordinate amounts of time poring over visual data, especially in high volume production environments. Our model works quickly and accurately in sparing defective product from entering doomed operations that would otherwise incur waste in the form of wasted worker-hours, tardy disposition, and field failure. We use a convolutional neural network (CNN) with the Visual Geometry Group with 16 layers (VGG16) architecture and train it on the Printed Circuit Board (PCB) dataset with 3175 RBG images. The resultant trained model, assisted by finely tuned optimizers and learning rates, classifies defective product with 97.01% validating accuracy.
References
[1]
G. Büchi, M. Cugno, and R. Castagnoli, “Smart factory performance and Industry 4.0,” Technological Forecasting and Social Change, vol. 150, article 119790, 2020.
[2]
V. Alcácerac and V. Cruz-Machadoab, “Scanning the Industry 4.0: a literature review on technologies for manufacturing systems,” Engineering Science and Technology, An International Journal, vol. 22, pp. 899–919, 2019.
[3]
D. Sinha and R. Roy, “Reviewing cyber-physical system as a part of smart factory in Industry 4.0,” IEEE Engineering Management Review, vol. 48, pp. 103–117, 2020.
[4]
T. Kalsoom, N. Ramzan, S. Ahmed, and M. Ur-Rehman, “Advances in sensor technologies in the era of smart factory and Industry 4.0,” Sensors, vol. 20, p. 6783, 2020.
[5]
T. Czimmermann, G. Ciuti, M. Milazzo, M. Chiurazzi, S. Roccella, C. M. Oddo, and P. Dario, “Visual-based defect detection and classification approaches for industrial applications—a survey,” Sensors, vol. 20, no. 5, p. 1459, 2020.
[6]
L. Wang, M. Törngren, and M. Onori, “Current status and advancement of cyber-physical systems in manufacturing,” Journal of Manufacturing Systems, vol. 37, pp. 517–527, 2015.
[7]
P. Wang, R. X. Gao, and Z. Fan, “Cloud computing for cloud manufacturing: benefits and limitations,” Journal of Manufacturing Science and Engineering, vol. 137, no. 4, pp. 1–10, 2015.
[8]
Y. Lu, X. Xu, and J. Xu, “Development of a hybrid manufacturing cloud,” Journal of Manufacturing Systems, vol. 33, no. 4, pp. 551–566, 2014.
[9]
D. Wu, D. W. Rosen, and D. Schaefer, “Cloud-based design and manufacturing: a new paradigm in digital manufacturing and design innovation,” Computer-Aided Design, vol. 59, pp. 1–14, 2015.
[10]
F. Alenezi and E. Salari, “A fuzzy-based medical image fusion using a combination of maximum selection and gabor filters,” International Journal of Engineering Science, vol. 9, pp. 118–129, 2018.
[11]
M. P. Samy, S. Foong, G. S. Soh, and K. S. Yeo, “Automatic optical & laser-based defect detection and classification in brick masonry walls,” in 2016 IEEE Region 10 Conference (TENCON), pp. 3521–3524, Singapore, 2016.
[12]
F. Alenezi, A. Armghan, S. N. Mohanty, R. H. Jhaveri, and P. Tiwari, “Block-Greedy and CNN based underwater image dehazing for novel depth estimation and optimal ambient light,” Water, vol. 13, no. 23, p. 3470, 2021.
[13]
J. Wang, Y. Ma, L. Zhang, R. X. Gao, and D. Wu, “Deep learning for smart manufacturing: methods and applications,” Journal of Manufacturing Systems, vol. 48, pp. 144–156, 2018.
[14]
F. S. Alenezi and S. Ganesan, “Geometric-pixel guided single-pass convolution neural network with graph cut for image dehazing,” IEEE Access, vol. 9, pp. 29380–29391, 2021.
[15]
X. Tao, Z. H. Wang, Z. T. Zhang, D. P. Zhang, D. Xu, X. Y. Gong, and L. Zhang, “Wire defect recognition of spring-wire socket using multitask convolutional neural networks,” IEEE Transactions on Components, Packaging and Manufacturing Technology, vol. 8, pp. 689–698, 2018.
[16]
F. Alenezi, “Image dehazing based on pixel guided CNN with PAM via graph cut,” Computers, Materials & Continua, vol. 71, no. 2, pp. 3425–3443, 2022.
[17]
V. A. Adibhatla, H.-C. Chih, C.-C. Hsu, J. Cheng, M. F. Abbod, and J.-S. Shieh, “Defect detection in printed circuit boards using you-only-look-once convolutional neural networks,” Electronics, vol. 9, no. 9, p. 1547, 2020.
[18]
E. Zhang, B. Li, P. Li, and Y. Chen, “A deep learning based printing defect classification method with imbalanced samples,” Symmetry, vol. 11, no. 12, p. 1440, 2019.
[19]
J. P. Yun, W. C. Shin, G. Koo, M. S. Kim, C. Lee, and S. J. Lee, “Automated defect inspection system for metal surfaces based on deep learning and data augmentation,” Journal of Manufacturing Systems, vol. 55, pp. 317–324, 2020.
[20]
X. Xie, “A review of recent advances in surface defect detection using texture analysis techniques,” ELCVIA: Electronic Letters on Computer Vision and Image Analysis, vol. 7, pp. 1–22, 2008.
[21]
H. Y. Ngan, G. K. Pang, and N. H. Yung, “Automated fabric defect detection—a review,” Image and Vision Computing, vol. 29, pp. 442–458, 2011.
[22]
P. M. Mahajan, S. R. Kolhe, and P. M. Patil, “A review of automatic fabric defect detection techniques,” Advances in Computational Research, vol. 1, pp. 18–29, 2009.
[23]
I. J. Aldave, P. V. Bosom, L. V. González, I. L. De Santiago, B. Vollheim, L. Krausz, and M. Georges, “Review of thermal imaging systems in composite defect detection,” Infrared Physics & Technology, vol. 61, pp. 167–175, 2013.
[24]
F. Pernkopf, “Detection of surface defects on raw steel blocks using Bayesian network classifiers,” Pattern Analysis and Applications, vol. 7, pp. 333–342, 2004.
[25]
W. Zhang, C. Ye, K. Zheng, J. Zhong, Y. Tang, Y. Fan, M. J. Buehler, S. Ling, and D. L. Kaplan, “Tensan silk-inspired hierarchical fibers for smart textile applications,” ACS Nano, vol. 12, no. 7, pp. 6968–6977, 2018.
[26]
H. Ren, K. Tian, S. Hong, B. Dong, F. Xing, and L. Qin, “Visualized investigation of defect in cementitious materials with electrical resistance tomography,” Construction and Building Materials, vol. 196, pp. 428–436, 2019.
[27]
W. Song, T. Chen, Z. Gu, W. Gai, W. Huang, and B. Wang, “Wood materials defects detection using image block percentile color histogram and eigenvector texture feature,” in Proceedings of the First International Conference on Information Sciences, Machinery, Materials and Energy, pp. 2022–2026, Chongqing, China, 2015.
[28]
P. Prasitmeeboon and H. Yau, “Defect detection of particleboards by visual analysis and machine learning,” in 2019 5th International Conference on Engineering, Applied Sciences and Technology (ICEAST), pp. 1–4, Luang Prabang, Laos, 2019.
[29]
F. Alenezi and K. C. Santosh, “Geometric regularized Hopfield neural network for medical image enhancement,” International Journal of Biomedical Imaging, vol. 2021, 2021.
[30]
J. Ren and X. Huang, “Defect detection using combined deep autoencoder and classifier for small sample size,” in Proceedings of the 2020 IEEE 6th International Conference on Control Science and Systems Engineering (ICCSSE), pp. 32–35, Beijing, China, 2020.
[31]
C. Sampedro, J. Rodriguez-Vazquez, A. Rodriguez-Ramos, A. Carrio, and P. Campoy, “Deep learning-based system for automatic recognition and diagnosis of electrical insulator strings,” IEEE Access, vol. 7, pp. 101283–101308, 2019.
[32]
J. Balzategui, L. Eciolaza, and N. Arana-Arexolaleiba, “Defect detection on polycrystalline solar cells using electroluminescence and fully convolutional neural networks,” in Proceedings of the 2020 IEEE/SICE International Symposium on System Integration (SII), pp. 949–953, Honolulu, HI, USA, 2020.
[33]
X. Gao, M. Jian, M. Hu, M. Tanniru, and S. Li, “Faster multi-defect detection system in shield tunnel using combination of FCN and faster RCNN,” Advances in Structural Engineering, vol. 22, pp. 2907–2921, 2019.
[34]
P. K. R. Maddikunta, Q. V. Pham, B. Prabadevi, N. Deepa, K. Dev, T. R. Gadekallu, R. Ruby, and M. Liyanage, “Industry 5.0: a survey on enabling technologies and potential applications,” Journal of Industrial Information Integration, vol. 26, article 100257, 2021.
[35]
H. Baumgartl, J. Tomas, R. Buettner, and M. Merkel, “A deep learning-based model for defect detection in laser-powder bed fusion using in-situ thermographic monitoring,” Progress in Additive Manufacturing, vol. 5, no. 3, pp. 277–285, 2020.
[36]
M. Alazab, K. Lakshmanna, T. R. G, Q.-V. Pham, and P. K. Reddy Maddikunta, “Multi-objective cluster head selection using fitness averaged rider optimization algorithm for IOT networks in smart cities,” Sustainable Energy Technologies and Assessments, vol. 43, article ???, 2021.
[37]
J. Jayanthi, E. L. Lydia, N. Krishnaraj, T. Jayasankar, R. L. Babu, and R. A. Suji, “An effective deep learning features based integrated framework for iris detection and recognition,” Journal of Ambient Intelligence and Humanized Computing, vol. 12, no. 3, pp. 3271–3281, 2021.
[38]
C. Iwendi, P. K. R. Maddikunta, T. R. Gadekallu, K. Lakshmanna, A. K. Bashir, and M. J. Piran, “A metaheuristic optimization approach for energy efficiency in the IOT networks,” Software: Practice and Experience, vol. 51, no. 12, pp. 2558–2571, 2020.
Index Terms
- Circuit Manufacturing Defect Detection Using VGG16 Convolutional Neural Networks
Index terms have been assigned to the content through auto-classification.
Recommendations
Comments
Information & Contributors
Information
Published In
Copyright © 2022 Sara A. Althubiti et al.
This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Publisher
John Wiley and Sons Ltd.
United Kingdom
Publication History
Published: 01 January 2022
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 28 Dec 2024