Abstract
In the fault diagnosis of rotating machinery, vibration signal or spectrum is usually used. As a data-driven method, deep learning has been introduced into the field of fault diagnosis. But it often confronts with two critical difficulties: few fault cases and single data source. To this end, we employ the prototype network to solve the problem of few fault cases, and use the two-branch technique to combine data sources in time domain and frequency domain. We introduce the two-branch network structure into the framework of the prototype network and develop a two-branch prototype network (TBPN) for fault diagnosis. The TBPN model is constructed through three main steps. First, we extract information from vibration signals in time domain and frequency domain respectively, and feed them into the model as two branches. Second, the prototype representation of each fault in time domain and frequency domain can be learned through metric learners, and the distances between fault prototypes and query faults features are then calculated. Third, the distances in time domain and frequency domain are integrated and incorporated into the softmax function for multi-classification. The performance of TBNP is verified by a real-world application on fault diagnosis of rotating machinery with the case data accumulated by an industrial Internet enterprise in China. The results show that the TBPN model is suitable for fault diagnosis in the case of small data. Compared with using time domain signals or spectrum alone, their combination use can improve the effectiveness of fault diagnosis.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chen, S., Meng, Y., Tang, H., Tian, Y., He, N., & Shao, C. (2020). Robust deep learning-based diagnosis of mixed faults in rotating machinery. IEEE/ASME Transactions on Mechatronics, 25, 2167–2176.
Chen, X., Zhang, B., & Gao, D. (2021). Bearing fault diagnosis base on multi-scale CNN and LSTM model. Journal of Intelligent Manufacturing, 32, 971–987.
Douze, M., Szlam, A., Hariharan, B., & Jégou, H. (2018). Low-shot learning with large-scale diffusion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3349–3358).
Feng, L., & Zhao, C. (2021). Fault description based attribute transfer for zero-sample industrial fault diagnosis. IEEE Transactions on Industrial Informatics, 17, 1852–1862.
Feng, Y., Chen, J., Zhang, T., He, S., Xu, E., & Zhou, Z. (2021). Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis. ISA Transactions, In Press.
Finn, C., Abbeel, P., & Levine, S. (2017). Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning (pp. 1126–1135).
Gao, Y., Liu, X., Huang, H., & Xiang, J. (2021). A hybrid of FEM simulations and generative adversarial networks to classify faults in rotor-bearing systems. ISA Transactions, 108, 356–366.
Goyal, D., Choudhary, A., Pabla, B. S., & Dhami, S. S. (2020). Support vector machines based non-contact fault diagnosis system for bearings. Journal of Intelligent Manufacturing, 31, 1275–1289.
Han, Y., Tang, B., & Deng, L. (2019). An enhanced convolutional neural network with enlarged receptive fields for fault diagnosis of planetary gearboxes. Computers in Industry, 107, 50–58.
He, D., Li, R., & Zhu, J. (2012). Plastic bearing fault diagnosis based on a two-step data mining approach. IEEE Transactions on Industrial Electronics, 60, 3429–3440.
Jia, F., Lei, Y., Lin, J., Zhou, X., & Lu, N. (2016). Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mechanical Systems and Signal Processing, 72, 303–315.
Jiang, G., He, H., Yan, J., & Xie, P. (2018). Multiscale convolutional neural networks for fault diagnosis of wind turbine gearbox. IEEE Transactions on Industrial Electronics, 66, 3196–3207.
Lei, Y., Jia, F., Lin, J., Xing, S., & Ding, S. X. (2016). An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data. IEEE Transactions on Industrial Electronics, 63, 3137–3147.
Li, C., Sanchez, R.-V., Zurita, G., Cerrada, M., Cabrera, D., & Vásquez, R. E. (2015). Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis. Neurocomputing, 168, 119–127.
Li, C., Sanchez, R.-V., Zurita, G., Cerrada, M., Cabrera, D., & Vásquez, R. E. (2016). Gearbox fault diagnosis based on deep random forest fusion of acoustic and vibratory signals. Mechanical Systems and Signal Processing, 76, 283–293.
Li, C., Yang, K., Tang, H., Wang, P., Li, J., & He, Q. (2021). Fault diagnosis for rolling bearings of a freight train under limited fault data: Few-shot learning method. Journal of Transportation Engineering, Part A: Systems, 147, 04021041.
Li, X., Zhang, W., & Ding, Q. (2018). Cross-domain fault diagnosis of rolling element bearings using deep generative neural networks. IEEE Transactions on Industrial Electronics, 66, 5525–5534.
Li, N., Zhou, R., Hu, Q., & Liu, X. (2012). Mechanical fault diagnosis based on redundant second generation wavelet packet transform, neighborhood rough set and support vector machine. Mechanical Systems and Signal Processing, 28, 608–621.
Liu, H., Zhou, J., Zheng, Y., Jiang, W., & Zhang, Y. (2018). Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. ISA Transactions, 77, 167–178.
Lu, C., Wang, Z.-Y., Qin, W.-L., & Ma, J. (2017). Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification. Signal Processing, 130, 377–388.
Pandya, D. H., Upadhyay, S. H., & Harsha, S. P. (2013). Fault diagnosis of rolling element bearing with intrinsic mode function of acoustic emission data using APF-KNN. Expert Systems with Applications, 40, 4137–4145.
Rafiee, J., Arvani, F., Harifi, A., & Sadeghi, M. H. (2007). Intelligent condition monitoring of a gearbox using artificial neural network. Mechanical Systems and Signal Processing, 21, 1746–1754.
Ren, Z., Zhu, Y., Yan, K., Chen, K., Kang, W., Yue, Y., & Gao, D. (2020). A novel model with the ability of few-shot learning and quick updating for intelligent fault diagnosis. Mechanical Systems and Signal Processing, 138, 106608.
Schwartz, E., Karlinsky, L., Shtok, J., Harary, S., Marder, M., Feris, R., Kumar, A., Giryes, R., & Bronstein, A.M. (2018). Delta-encoder: An effective sample synthesis method for few-shot object recognition. In Neural information processing systems (pp. 2850–2860).
Shevchik, S. A., Saeidi, F., Meylan, B., & Wasmer, K. (2016). Prediction of failure in lubricated surfaces using acoustic time frequency features and random forest algorithm. IEEE Transactions on Industrial Informatics, 13, 1541–1553.
Snell, J., Swersky, K., & Zemel, R. (2017). Prototypical networks for few-shot learning. In Proceedings of the 31st international conference on neural information processing systems (pp. 4077–4087).
Wang, D., Zhang, M., Xu, Y., Lu, W., Yang, J., & Zhang, T. (2021). Metric-based meta-learning model for few-shot fault diagnosis under multiple limited data conditions. Mechanical Systems and Signal Processing, 155, 107510.
Wang, S., Wang, D., Kong, D., Wang, J., Li, W., & Zhou, S. (2020). Few-shot rolling bearing fault diagnosis with metric-based meta learning. Sensors, 20, 6437.
Wang, S., Xiang, J., Zhong, Y., & Tang, H. (2018). A data indicator-based deep belief networks to detect multiple faults in axial piston pumps. Mechanical Systems and Signal Processing, 112, 154–170.
Wang, Y., Lee, D., Heo, J., & Park, J. (2021). One-shot summary prototypical network toward accurate unpaved road semantic segmentation. IEEE Signal Processing Letters, 28, 1200–1204.
Wu, J., Zhao, Z., Sun, C., Yan, R., & Chen, X. (2020). Few-shot transfer learning for intelligent fault diagnosis of machine. Measurement, 166, 108202.
Xu, Q., Lu, S., Jia, W., & Jiang, C. (2020). Imbalanced fault diagnosis of rotating machinery via multi-domain feature extraction and cost-sensitive learning. Journal of Intelligent Manufacturing, 31, 1467–1481.
Zhang, A., Li, S., Cui, Y., Yang, W., Dong, R., & Hu, J. (2019). Limited data rolling bearing fault diagnosis with few-shot learning. IEEE Access, 7, 110895–110904.
Zhang, W., Li, C., Peng, G., Chen, Y., & Zhang, Z. (2018). A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load. Mechanical Systems and Signal Processing, 100, 439–453.
Zhang, W., Peng, G., Li, C., Chen, Y., & Zhang, Z. (2017). A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors, 17, 425.
Zhang, X., & Zhou, J. (2013). Multi-fault diagnosis for rolling element bearings based on ensemble empirical mode decomposition and optimized support vector machines. Mechanical Systems and Signal Processing, 41, 127–140.
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019). Deep learning and its applications to machine health monitoring. Mechanical Systems and Signal Processing, 115, 213–237.
Acknowledgements
The authors gratefully acknowledge financial support from the Key Research and Development Program of Anhui Province (202004a05020020), the National Statistical Science Research Projects of China (2019LD05), and the National Natural Science Foundation of PR China (72171070, 71671056). Special thanks to data support from industrial partner RONDS.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jiang, C., Chen, H., Xu, Q. et al. Few-shot fault diagnosis of rotating machinery with two-branch prototypical networks. J Intell Manuf 34, 1667–1681 (2023). https://doi.org/10.1007/s10845-021-01904-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-021-01904-x