Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A self-supervised framework for computer-aided arrhythmia diagnosis

Published: 21 November 2024 Publication History

Abstract

Cardiovascular diseases, including all types of arrhythmias, are the leading cause of death. Deep learning (DL)-based electrocardiography (ECG) diagnosis systems have attracted considerable attention in recent years. However, training DL-based models requires much high-quality labeled data, and labeling ECG records is time-consuming and expensive. In this paper, a high-precision deep network obtained via low-cost annotation, that is, a self-supervised residual convolutional neural network (SSRCNN), was designed. First, a convolutional neural network and residual blocks were designed to construct a deep feature extractor to automatically obtain the feature expression of ECG signals. Next, we developed time- and lead-dimension-based data augmentation methods and designed a pretraining framework based on unlabeled datasets such that the feature extractor could update the weights in the unlabeled samples. Furthermore, through interactions with clinicians, we used a few labeled data to fine-tune the pretrained model and feature classifier to automatically extract deep features and perform effective classification. Finally, we used different open-source datasets to validate the superiority of the SSRCNN. With the support of unlabeled datasets, SSRCNN can effectively reduce clinicians’ workload. Compared with existing methods, the SSRCNN achieves a better diagnostic performance in terms of average accuracy (99.0 %) and average F1-macro (86.83 %) using approximately 25 % of labeled data. Therefore, the SSRCNN has a potential for practical applications in clinical settings.

Highlights

This paper presents a novel self-supervised residual convolution neural network for actual arrhythmia classification.
Convolution layers, and Residual blocks are integrated to improve model diagnostic performance.
The novel pre-training framework and data augmentation methods are introduced to obtain ECG representations.
SSRCNN improves 5.74% and 8.73% in average accuracy and average F1 macro by using approximately 25% labeled data.

References

[1]
WHOFactSheet. http://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds), 2017.
[2]
R. Levin, D. Cohen, W. Frisbie, et al., Potential for real-time processing of the continuously monitored electrocardiogram in the detection, quantitation, and intervention of silent myocardial ischemia, Cardiol. Clin. 4 (1986) 735.
[3]
M. AlGhatrif, J. Lindsay, A brief review: history to understand fundamentals of electrocardiography, J. Community Hosp. Intern. Med. Perspect. 2 (2012) 14383,.
[4]
D.E. Becker, Fundamentals of electrocardiography interpretation, Anesth. Prog. 53 (2006) 53–64,.
[5]
X. Zhai, C. Tin, Automated ECG classification using dual heartbeat coupling based on convolutional neural network, IEEE Access 6 (2018) 27465–27472.
[6]
J. Li, Y. Si, T. Xu, S. Jiang, Deep convolutional neural network based ECG classification system using information fusion and one-hot encoding techniques, Math. Probl. Eng. (2018).
[7]
A. Sellami, H. Hwang, A robust deep convolutional neural network with batch-weighted loss for heartbeat classification, Expert Syst. Appl. 122 (2019) 75–84.
[8]
S.L. Oh, E.Y.K. Ng, R.S. Tan, U.R. Acharya, Automated diagnosis of arrhythmia using combination of CNN and LSTM techniques with variable length heart beats, Comput. Biol. Med. 102 (2018) 278–287.
[9]
Y. Jin, C. Qin, Y. Huang, W. Zhao, C. Liu, Multi-domain modeling of atrial fibrillation detection with twin attentional convolutional long short-term memory neural networks, Knowl. Based Syst. 193 (2020).
[10]
R. He, K. Wang, N. Zhao, Y. Liu, Y. Yuan, Q. Li, H. Zhang, Automatic detection of atrial fibrillation based on continuous wavelet transform and 2D convolutional neural networks, Front. Physiol. 9 (2018).
[11]
H. Fujita, D. Cimr, Computer Aided detection for fibrillations and flutters using deep convolutional neural network, Inf. Sci. 486 (2019) 231–239.
[12]
H. Fujita, D. Cimr, Decision support system for arrhythmia prediction using convolutional neural network structure without preprocessing, Appl. Intell. 49 (2019) 3383–3391.
[13]
U.R. Acharya, H. Fujita, O.S. Lih, Y. Hagiwara, J.H. Tan, M. Adam, Automated detection of arrhythmias using different intervals of tachycardia ECG segments with convolutional neural network, Inf. Sci. 405 (2017) 81–90.
[14]
L. Jing, Y. Tian, Self-supervised visual feature learning with deep neural networks: a survey, IEEE Trans. Pattern Anal. Mach. Intell. 43 (2021) 4037–4058,.
[15]
T. Chen, S. Kornblith, M. Norouzi, G. Hinton, A simple framework for contrastive learning of visual representations, Int. Conf. Mach. Learn. (2020) 1597–1607.
[16]
J.-B. Grill, F. Strub, F. Altch´e, C. Tallec, P. Richemond, E. Buchatskaya, C. Doersch, B. Avila Pires, Z. Guo, M. Gheshlaghi Azar, B. Piot, koray kavukcuoglu, R. Munos, M. Valko. Bootstrap your own latent - a new approach to self-supervised learning, in: H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, H. Lin (Eds.), Adv. Neural Inf. Process. Syst., Curran Associates, Inc., 2020, pp. 21271–21284, in: https://proceedings.neurips.cc/paper/2020/file/f3ada80d5c4ee70142b17b8192b2958e-Pa per.pdf.
[17]
M. Caron, I. Misra, J. Mairal, P. Goyal, P. Bojanowski, A. Joulin. Unsupervised learning of visual features by contrasting cluster assignments, in: H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, H. Lin (Eds.), Adv. Neural Inf. Process. Syst., Curran Associates, Inc., 2020, pp. 9912–9924. in: https://proceedings.neurips.cc/paper/2020/file/70feb62b69f16e0238f741fab228fec2-Paper.pdf.
[18]
K. Weimann, T.O.F. Conrad, Transfer learning for ECG classification, Sci. Rep., 11, 2021, p. 5251,.
[19]
N. Diamant, E. Reinertsen, S. Song, A. Aguirre, C. Stultz, P. Batra. Patient Contrastive Learning: a Performant, Expressive, and Practical Approach to ECG Modeling. 2021. ArXiv Prepr. ArXiv2104.04569.
[20]
T. Mehari, N. Strodthoff, Self-supervised representation learning from 12-lead ECG data, Comput. Biol. Med. 141 (2022).
[21]
B. Gopal, R. Han, G. Raghupathi, A. Ng, G. Tison, P. Rajpurkar, 3KG: contrastive learning of 12-lead electrocardiograms using physiologically-inspired augmentations, Mach. Learn. Heal (2021) 156–167.
[22]
H. Liu, Z. Zhao, Q. She, Self-supervised ECG pre-training, Biomed. Signal Process Control 70 (2021),.
[23]
A.L. Goldberger, L.A.N. Amaral, L. Glass, et al., Physiobank, physiotoolkit, and physionet: components of a new research resource for complex physiologic signals, Circulation 101 (2000) 215–220.
[24]
F.F. Liu, C.Y. Liu, L.N. Zhao, X.Y. Zhang, X.L. Wu, X.Y. Xu, Y.L. Liu, C.Y. Ma, S.S. Wei, Z.Q. He, J.Q. Li, N.Y. Kwee, An open access database for evaluating the algorithms of ECG rhythm and morphology abnormal detection, J. Med. Imaging Health Inform. 8 (7) (2018) 1368–1373.
[25]
K. Luo, J. Li, Z. Wang, et al., Patient-specific deep architectural model for ECG classification, J. Healthc. Eng. 2017 (2017).
[26]
J. Li, Y. Si, T. Xu, S. Jiang, Deep convolutional neural network based ECG classification system using information fusion and one-hot encoding techniques, Math. Probl. Eng. (2018).
[27]
T. Golany, G. Lavee, S. Tejman Yarden, K. Radinsky, Improving ECG classification using generative adversarial networks, Proc. AAAI Conf. Artif. Intell. (2020).
[28]
S. Kiranyaz, T. Ince, M. Gabbouj, Real-time patient-specific ecg classification by 1-d convolutional neural networks, IEEE Trans. Biomed. Eng. 63 (2015) 664–675.
[29]
Y. Jin, C. Qin, J. Liu, Y. Liu, Z. Li, C. Liu, A novel deep wavelet convolutional neural network for actual ECG signal denoising, Biomed. Signal Process. Control 87 (2024).
[30]
Y. Jin, Z. Li, C. Qin, J. Liu, Y. Liu, L. Zhao, C. Liu, A novel attentional deep neural network-based assessment method for ECG quality, Biomed. Signal Process. Control 79 (2023).
[31]
He K., Zhang X., Ren S., Sun J. Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770-778.
[32]
Y. Xia, N. Wulan, K. Wang, H. Zhang, Detecting atrial fibrillation by deep convolutional neural networks, Comput. Biol. Med. 93 (2018) 84–92.
[33]
Y. Jin, C. Qin, J. Liu, K. Lin, H. Shi, Y. Huang, C. Liu, A novel domain adaptive residual network for automatic atrial fibrillation detection, Knowl. Based Syst. 203 (2020).
[34]
D.P. Kingma, J. Ba, Adam: a method for stochastic optimization, arXiv preprint arXiv: 1412.6980, 2014.
[35]
U.R. Acharya, S.L. Oh, Y. Hagiwara, et al., A deep convolutional neural network model to classify heartbeats, Comput. Biol. Med. 89 (2017) 389–396.
[36]
P. Gopika, V. Sowmya, E.A. Gopalakrishnan, et al. Transferable approach for cardiac disease classification using deep learning. Deep Learning Techniques for Biomedical and Health Informatics, New York, NY, USA: Academic, 2020, pp. 285–303.
[37]
H. Zhang, H. Zhang, S. Pirbhulal, et al., Active balancing mechanism for imbalanced medical data in deep learning–based classification models, ACM Trans. Multimed. Comput. Commun. Appl. 16 (2020) 1–15.
[38]
X. Xu, S. Jeong, J. Li, Interpretation of electrocardiogram (ECG) rhythm by combined CNN and BiLSTM, IEEE Access 8 (2020) 125380–125388.
[39]
J. Wang, X. Qiao, C. Liu, et al., Automated ECG classification using a non-local convolutional block attention module, Comput. Methods Prog. Biomed. 203 (2021).
[40]
M. Hammad, A.M. Iliyasu, A. Subasi, et al., A multitier deep learning model for arrhythmia detection, IEEE Trans. Instrum. Meas. 70 (2021) 1–9.
[41]
T. Pokaprakarn, R.R. Kitzmiller, J.R. Moorman, et al., Sequence to sequence ECG cardiac rhythm classification using convolutional recurrent neural networks, IEEE J. Biomed. Health Inf. 26 (2) (2022) 572–580.
[42]
D. Meltzer, D. Luengo, Efficient clustering-based electrocardiographic biometric identification, Expert Syst. Appl. 219 (2023).
[43]
Yang Y., Jin L., Pan Z. 2020. ECG Arrhythmia Heartbeat Classification Using Deep Learning Networks. Cloud Computing. 10th EAI International Conference, CloudComp 2020. Proceedings. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST 363).
[44]
A.M. Shaker, M. Tantawi, H.A. Shedeed, M.F. Tolba, Heartbeat classification using 1D convolutional neural networks, Proc. Proc. Int. Conf. Adv. Intell. Syst. Inform. 1058 (2020) 502–511.
[45]
X. Guo, Q. Wang, J. Zheng, An intelligent computer-aided diagnosis approach for atrial fibrillation detection based on multi-scale convolution kernel and Squeeze-and-Excitation network, Biomed. Signal Process. Control 68 (2021).
[46]
B. Hanh, H. Manh, P. Thang, Automatic varied-length ECG classification using a lightweight DenseNet model, Biomed. Signal Process. Control 82 (2023).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Applied Soft Computing
Applied Soft Computing  Volume 164, Issue C
Oct 2024
1497 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 21 November 2024

Author Tags

  1. Actual arrhythmia classification
  2. ECG
  3. Self-supervised learning
  4. Novel data augmentation methods
  5. Residual block

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media