Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Automatic detection of defects in electronic plastic packaging using deep convolutional neural networks

  • Research
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

As the mainstream chip packaging technology, plastic-encapsulated chips (PEC) suffer from process defects such as delamination and voids, which seriously impact the chip's reliability. Therefore, it is urgent to detect defects promptly and accurately. However, the current manual detection methods cannot meet the application's requirements, as they are both inaccurate and inefficient. This study utilized the deep convolutional neural network (DCNN) technique to analyze PEC's scanning acoustic microscope (SAM) images and identify their internal defects. First, the SAM technology was used to collect and set up datasets of seven typical PEC defects. Then, according to the characteristics of densely packed PEC and an incredibly tiny size ratio in SAM, a PECNet network was established to detect PEC based on the traditional RetinaNet network, combining the CoTNet50 backbone network and the feature pyramid network structure. Furthermore, a PEDNet was designed to classify PEC defects based on the MobileNetV2 network, integrating cross-local connections and progressive classifiers. The experimental results demonstrated that the PECNet network's chip recognition accuracy reaches 98.6%, and its speed of a single image requires only nine milliseconds. Meanwhile, the PEDNet network's average defect classification accuracy is 97.8%, and the recognition speed of a single image is only 0.0021 s. This method provides a precise and efficient technique for defect detection in PEC.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data Availability

No datasets were generated or analysed during the current study.

References

  1. Cai, J.B., Li, W., Chen, X.L., et al.: Investigation on failures of plastic package devices with unidentifiable defects related to deficient molding process. In: 2020 21st International Conference on Electronic Packaging Technology (ICEPT), Guangzhou, China, pp. 1–5 (2020)

  2. Wang, Z.J., Yi, Z.X., Qin, M., et al.: Low-drift MEMS thermal wind sensor with symmetric packaging using plastic injection molding process. IEEE Trans. Instrum. Meas. 70, 1–8 (2021)

    Article  Google Scholar 

  3. Li, S.: MicroSystem Based on SiP Technology. Springer Nature Singapore, Singapore (2023)

    Google Scholar 

  4. Angelov, G., Rusev, R., Nikolov, D., et al.: Identifying of delamination in integrated circuits using surface acoustic microscopy. In: 2021 XXX International Scientific Conference Electronics (ET), Sozopol, Bulgaria, pp. 1–5. IEEE (2021)

  5. Kravchenko, G., Bohm, C.: A study of chip top delamination in plastic encapsulated packages under temperature loading. In: 2007 9th Electronics Packaging Technology Conference, Singapore, pp. 675–679. IEEE (2007)

  6. Cai, J.B., Chen, X.L., Wu, H.W., et al.: Typical failure mechanisms of plastic encapsulated devices’ internal connection. In: 2016 17th International Conference on Electronic Packaging Technology (ICEPT), Wuhan, China, pp. 1323–1326. IEEE (2016)

  7. Liao, X.Y., Ye, L.Z., Zhang, Y.L.Z.: Study on chip defect detection algorithm based on ultrasonic scanning. In: 2022 23rd International Conference on Electronic Packaging Technology (ICEPT), Dalian, China, pp. 1–6. IEEE (2022)

  8. Zhao, H.L., Zhang, K., Zhou, Z.H., et al.: Effect of environmental factors on ultrasound detection of plastic encapsulated microcircuits. J. Phys. Conf. Ser. 1885(4), 042064 (2021)

    Article  Google Scholar 

  9. Zhao, H.L., Zhang, K., Zhou, Z.H., et al.: Analysis of scanning acoustic microscopy problems for plastic encapsulated microcircuits with complex structure. J. Phys. Conf. Ser. 1885(5), 052054 (2021)

    Article  Google Scholar 

  10. Hullinger, A.K., Duffalo, J.M., Niederkorn, A.J., et al.: Evaluation of a plastic encapsulated package using a scalable thermal mechanical test chip. In: 33rd IEEE International Reliability Physics Symposium, pp. 112‒115. IEEE, Las Vegas, NV (1995)

  11. Liang, Y.F., Zhang, S.J.: A case study of the delamination analysis of plastic encapsulated microcircuits based on scanning acoustic microscope inspection. In: 2014 Prognostics and System Health Management Conference (PHM-2014 Hunan), Zhangiiaijie City, China, pp. 190‒193. IEEE (2014)

  12. Chen, J.W., Liu, Z.G., Wang, H.R., et al.: Automatic defect detection of fasteners on the catenary support device using deep convolutional neural network. IEEE Trans. Instrum. Meas. 67(2), 257–269 (2018)

    Article  Google Scholar 

  13. Huang, S.H., Pan, Y.C.: Automated visual inspection in the semiconductor industry: a survey. Comput. Ind. 66, 1–10 (2015)

    Article  Google Scholar 

  14. Pang, S.L., Chen, M.Y., Ta, S.W., et al.: Void and solder joint detection for chip resistors based on X-ray images and deep neural networks. Microelectron. Reliab. 135, 114587 (2022)

    Article  Google Scholar 

  15. Su, T.J., Chen, Y.F., Cheng, J.C., et al.: An artificial neural network approach for wafer dicing saw quality prediction. Microelectron. Reliab. 91, 257–261 (2018)

    Article  Google Scholar 

  16. Wen, L., Li, X.Y., Gao, L.: A transfer convolutional neural network for fault diagnosis based on ResNet-50. Neural Comput. Appl. 32(10), 6111–6124 (2019)

    Article  Google Scholar 

  17. Xie, X.X., Cheng, G., Wang, J.B., et al.: Oriented R-CNN for object detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3520–3529 (2021)

  18. Zhou, L.L., Rao, X.H., Li, Y.H., et al.: A lightweight object detection method in aerial images based on dense feature fusion path aggregation network. ISPRS Int. J. Geo-Inf. 11(3), 189 (2022)

    Article  Google Scholar 

  19. Zhou, H.P., Guo, W., Zhao, Q.: An anchor-free network for increasing attention to small objects in high resolution remote sensing images. Appl. Sci. 13(4), 2073 (2023)

    Article  Google Scholar 

  20. Wang, T., Chen, Y., Qiao, M.N., et al.: A fast and robust convolutional neural network-based defect detection model in product quality control. Int. J. Adv. Manuf. Technol. 94(9–12), 3465–3471 (2018)

    Article  Google Scholar 

  21. Bhatt, P.M., Malhan, R., Rajendran, P., et al.: Image-based surface defect detection using deep learning: a review. J. Comput. Inf. Sci. Eng. 21(4), 040801 (2021)

    Article  Google Scholar 

  22. Sandler, M., Howard, A., Zhu, M.L., et al.: MobileNetV2: inverted residuals and linear bottlenecks. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4510‒4520. IEEE, Salt Lake City, UT (2018)

  23. Liu S.W., Kong W.M., Chen X.F., et al.: Multi-scale ship detection algorithm based on a lightweight neural network for spaceborne SAR images. Remote Sens. 14, 5, p.1149 (2022)

  24. Ma, R., Wang, J., Zhao, W., et al.: Identification of maize seed varieties using mobileNetV2 with improved attention mechanism CBAM. Agric. BASEL 13(1), 11 (2022)

    Google Scholar 

  25. Vecvanags, A., Aktas, K., Pavlovs, I., et al.: Ungulate detection and species classification from camera trap images using RetinaNet and faster R-CNN. Entropy 24(3), 353 (2022)

    Article  Google Scholar 

  26. Li, Y.H., Yao, T., Pan, Y.W., et al.: Contextual transformer networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 45(2), 1489–1500 (2022)

    Article  Google Scholar 

  27. Wang, C.Y., Zhong, C.M.: Adaptive feature pyramid networks for object detection. IEEE Access. 9, 107024–107032 (2021)

    Article  Google Scholar 

  28. Chen, Q., Wang, Y.M., Yang, T., et al.: You only look one-level feature. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13039–13048 (2021)

  29. Lin, T.Y., Dollar, P., Girshick, R., et al.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)

  30. Qiu, Z., Zhu, X., Liao, C., Shi, D., Qu, W.: Detection of transmission line insulator defects based on an improved lightweight YOLOv4 model. Appl. Sci. BASEL 12(3), 1207 (2022)

    Article  Google Scholar 

  31. Liu, J., Wang, X.W.: Early recognition of tomato gray leaf spot disease based on MobileNetv2-YOLOv3 model. Plant Methods 16(1), 83 (2020)

    Article  Google Scholar 

  32. Koklu, M., Unlersen, M.F., Ozkan, I.A., et al.: A CNN-SVM study based on selected deep features for grapevine leaves classification. Measurement 188, 110425 (2022)

    Article  Google Scholar 

  33. Arouri, Y., Sayyafzadeh, M.: An adaptive moment estimation framework for well placement optimization. Comput. Geosci. 26(4), 957–973 (2022)

    Article  MathSciNet  Google Scholar 

Download references

Funding

Funding was provided by Science and Technology on Electronic Information Control Laboratory (Grant No. 6142105200203).

Author information

Authors and Affiliations

  1. School of Information Engineering, Southwest University of Science and Technology, Mianyang, 621010, China

    Wanchun Ren, Pengcheng Zhu, Yi Huang, Haoran Zhao, Youji Hama, Zhu Yan & Tao Zhou

  2. Robot Technology Used for Special Environment Key Laboratory of Sichuan Province, Mianyang, 621010, China

    Wanchun Ren

  3. MC-Power Semiconductor Co., Ltd., Chengdu, 610299, China

    Shaofeng Cai, Junde Pu & Hongwei Yang

Authors
  1. Wanchun Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pengcheng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shaofeng Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yi Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Haoran Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Youji Hama
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Zhu Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tao Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Junde Pu
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Hongwei Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Wanchun Ren: Writing-original draft preparation, Methodology, Pengcheng Zhu: Visualization, Shaofeng Cai: Supervision, Yi Huang: Investigation, Haoran Zhao: Software, Youji Hama: Data curation, Zhu Yan: Writing-reviewing, Tao Zhou: Editing, Junde Pu: Experiment, Hongwei Yang: Dataset.

Corresponding author

Correspondence to Wanchun Ren.

Ethics declarations

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ren, W., Zhu, P., Cai, S. et al. Automatic detection of defects in electronic plastic packaging using deep convolutional neural networks. J Real-Time Image Proc 21, 152 (2024). https://doi.org/10.1007/s11554-024-01534-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11554-024-01534-5

Keywords

Search

Navigation