Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Multicentric intelligent cardiotocography signal interpretation using deep semi-supervised domain adaptation via minimax entropy and domain invariance

Published: 09 July 2024 Publication History

Abstract

Background and Objective

Obstetricians use Cardiotocography (CTG), which is the continuous recording of fetal heart rate and uterine contraction, to assess fetal health status. Deep learning models for intelligent fetal monitoring trained on extensively labeled and identically distributed CTG records have achieved excellent performance. However, creation of these training sets requires excessive time and specialist labor for the collection and annotation of CTG signals. Previous research has demonstrated that multicenter studies can improve model performance. However, models trained on cross-domain data may not generalize well to target domains due to variance in distribution among datasets. Hence, this paper conducted a multicenter study with Deep Semi-Supervised Domain Adaptation (DSSDA) for intelligent interpretation of antenatal CTG signals. This approach helps to align cross-domain distribution and transfer knowledge from a label-rich source domain to a label-scarce target domain.

Methods

We proposed a DSSDA framework that integrated Minimax Entropy and Domain Invariance (DSSDA-MMEDI) to reduce inter-domain gaps and thus achieve domain invariance. The networks were developed using GoogLeNet to extract features from CTG signals, with fully connected, softmax layers for classification. We designed a Dynamic Gradient-driven strategy based on Mutual Information (DGMI) to unify the losses from Minimax Entropy (MME), Domain Invariance (DI), and supervised cross-entropy during iterative learning.

Results

We validated our DSSDA model on two datasets collected from collaborating healthcare institutions and mobile terminals as the source and target domains, which contained 16,355 and 3,351 CTG signals, respectively. Compared to the results achieved with deep learning networks without DSSDA, DSSDA-MMEDI significantly improved sensitivity and F1-score by over 6%. DSSDA-MMEDI also outperformed other state-of-the-art DSSDA approaches for CTG signal interpretation. Ablation studies were performed to determine the unique contribution of each component in our DSSDA mechanism.

Conclusions

The proposed DSSDA-MMEDI is feasible and effective for alignment of cross-domain data and automated interpretation of multicentric antenatal CTG signals with minimal annotation cost.

Highlights

We conducted a multicenter study for intelligent antepartum fetal monitoring to address scarce labeling and domain shift.
We proposed a Deep Semi-Supervised Domain Adaptation (DSSDA) model via Minimax Entropy and Domain Invariance (DSSDA-MMEDI).
The source and target domains were respectively collected from collaborating healthcare institutions and mobile terminals.
Compared to the deep learning networks without DSSDA, DSSDA-MMEDI significantly improved sensitivity and F1-score by over 6%.
DSSDA-MMEDI outperformed other state-of-the-art DSSDA approaches for CTG signal interpretation.

References

[1]
R. Dlugatch, A. Georgieva, A. Kerasidou, Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care, BMC Med. Ethics 24 (1) (2023) 1–16.
[2]
D. Asfaw, I. Jordanov, L. Impey, et al., Multimodal deep learning for predicting adverse birth outcomes based on early labour data, Bioengineering 10 (6) (2023) 730.
[3]
Society of Obstetricians and Gynaecologists of Canada, SOGC clinical practice guidelines. Guidelines for vaginal birth after previous Caesarean birth, Int. J. Gynaecol. Obstet. 89 (3) (2005) 319–331.
[4]
X. Xie, B. Kong, T. Duan, Obstetrics and Gynecology, People's Health Publishing House, 2018.
[5]
S. Santo, D. Ayres-de-Campos, C. Costa-Santos, et al., Agreement and accuracy using the FIGO, ACOG and NICE cardiotocography interpretation guidelines, Acta Obstet. Gynecol. Scand. 96 (2) (2017) 166–175.
[6]
H. Yang, X. Li, Z. Wang, et al., Expert consensus on the application of electronic fetal heart rate monitoring, Chin. J. Perinat. Med. 18 (7) (2015) 486–490.
[7]
Y. Fei, F. Chen, L. He, et al., Intelligent classification of antenatal cardiotocography signals via multimodal bidirectional gated recurrent units, Biomed. Signal Process. Control 78 (2022).
[8]
Y. Zhang, Y. Deng, Z. Zhou, et al., Multimodal learning for fetal distress diagnosis using a multimodal medical information fusion framework, Front. Physiol. 13 (2022).
[9]
Z. Cömert, A. Şengür, Ü. Budak, et al., Prediction of intrapartum fetal hypoxia considering feature selection algorithms and machine learning models, Health Inf. Sci. Syst. 7 (2019) 1–9.
[10]
Y. Chen, A. Guo, Q. Chen, et al., Intelligent classification of antepartum cardiotocography model based on deep forest, Biomed. Signal Process. Control 67 (2021).
[11]
E. Spairani, B. Daniele, M.G. Signorini, et al., A deep learning mixed-data type approach for the classification of FHR signals, Front. Bioeng. Biotechnol. 10 (2022).
[12]
H. Liang, Y. Lu, A CNN-RNN unified framework for intrapartum cardiotocograph classification, Comput. Methods Programs Biomed. 229 (2023).
[13]
J. Zhu, M. Wang, Y. Li, et al., Convolutional neural network based anatomical site identification for laryngoscopy quality control: a multicenter study, Am. J. Otolaryngol. 44 (2) (2023).
[14]
L. Feng, Z. Liu, C. Li, et al., Development and validation of a radiopathomics model to predict pathological complete response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer: a multicentre observational study, Lancet Digit. Health 4 (1) (2022) e8–e17.
[15]
L. Dong, W. He, R. Zhang, et al., Artificial intelligence for screening of multiple retinal and optic nerve diseases, JAMA Netw. Open 5 (5) (2022).
[16]
M. Wei, Y. Zhang, C. Ding, et al., Associating peritoneal metastasis with T2-weighted MRI images in epithelial ovarian cancer using deep learning and radiomics: a multicenter study, J. Magn. Reson. Imaging (2023).
[17]
P. Wang, P. Li, Y. Li, et al., Classification of histopathological whole slide images based on multiple weighted semi-supervised domain adaptation, Biomed. Signal Process. Control 73 (2022).
[18]
R. Ding, Y. Zhou, J. Xu, et al., Cross-hospital sepsis early detection via semi-supervised optimal transport with self-paced ensemble, IEEE J. Biomed. Health Inform. 27 (2023) 3049–3060.
[19]
J. Zhou, B. Jing, Z. Wang, et al., Soda: detecting covid-19 in chest x-rays with semi-supervised open set domain adaptation, IEEE/ACM Trans. Comput. Biol. Bioinform. 19 (5) (2021) 2605–2612.
[20]
W. Gao, Y. Lu, Fetal heart baseline extraction and classification based on deep learning, in: 2019 International Conference on Information Technology and Computer Application (ITCA), IEEE, 2019, pp. 211–216.
[21]
C. Szegedy, W. Liu, Y. Jia, et al., Going deeper with convolutions, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1–9.
[22]
K. Saito, D. Kim, S. Sclaroff, et al., Semi-supervised domain adaptation via minimax entropy, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 8050–8058.
[23]
Y. Zhu, F. Zhuang, D. Wang, Aligning domain-specific distribution and classifier for cross-domain classification from multiple sources, in: AAAI Conference on Artificial Intelligence, 2019, pp. 5989–5996.
[24]
X. Xing, Z. Chen, M. Zhu, et al., Discrepancy and gradient-guided multi-modal knowledge distillation for pathological glioma grading, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer Nature Switzerland, Cham, 2022, pp. 636–646.
[25]
R. Liao, D. Moyer, M. Cha, et al., Multimodal representation learning via maximization of local mutual information, in: Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Proceedings, Part II 24, Strasbourg, France, September 27–October 1, 2021, Springer International Publishing, September 2021, pp. 273–283.
[26]
Y. Hu, W. Shi, C.H. Yeh, Spatiotemporal convolution sleep network based on graph attention mechanism with automatic feature extraction, Comput. Methods Programs Biomed. 244 (2024).
[27]
Simonyan, K.; Zisserman, A. (2014): Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.
[28]
A. Krizhevsky, I. Sutskever, G.E. Hinton, Imagenet classification with deep convolutional neural networks, Commun. ACM 60 (6) (2017) 84–90.
[29]
K. He, X. Zhang, S. Ren, et al., Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770–778.
[30]
Z. Deng, D. Li, Y. Song, T. Xiang, Robust target training for multi-source domain adaptation, in: 33rd British Machine Vision Conference (BMVC), BMVA, 2022, p. 778.
[31]
Y. Grandvalet, Y. Bengio, Semi-supervised learning by entropy minimization, Adv. Neural Inf. Process. Syst. (2004) 17.
[32]
L. Yang, Y. Wang, M. Gao, et al., Deep co-training with task decomposition for semi-supervised domain adaptation, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021, pp. 8906–8916.
[33]
C. Qin, L. Wang, Q. Ma, et al., Contradictory structure learning for semi-supervised domain adaptation, in: Proceedings of the 2021 SIAM International Conference on Data Mining (SDM), Society for Industrial and Applied Mathematics, 2021, pp. 576–584.
[34]
J. Yoon, D. Kang, M. Cho, Semi-supervised domain adaptation via sample-to-sample self-distillation, in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2022, pp. 1978–1987.
[35]
Y. Zhang, C. Jing, H. Lin, et al., Hard class rectification for domain adaptation, Knowl.-Based Syst. 222 (2021).
[36]
J. Liang, D. Hu, Y. Wang, et al., Source data-absent unsupervised domain adaptation through hypothesis transfer and labeling transfer, IEEE Trans. Pattern Anal. Mach. Intell. 44 (11) (2021) 8602–8617.
[37]
J. Liang, D. Hu, J. Feng, Domain adaptation with auxiliary target domain-oriented classifier, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 16632–16642.
[38]
C.X. Ren, Y.H. Liu, X.W. Zhang, et al., Multi-source unsupervised domain adaptation via pseudo target domain, IEEE Trans. Image Process. 31 (2022) 2122–2135.
[39]
Y.Z. Yang, Z. Xu, Rethinking the value of labels for improving class-imbalanced learning, in: Proceedings of the 34th International Conference on Neural Information Processing Systems, 2020, pp. 19290–19301.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Computer Methods and Programs in Biomedicine
Computer Methods and Programs in Biomedicine  Volume 249, Issue C
Jun 2024
175 pages

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 09 July 2024

Author Tags

  1. Multicenter study
  2. Cardiotocography signal
  3. Deep semi-supervised domain adaptation
  4. Minimax entropy
  5. Domain invariance
  6. Dynamic gradient-driven strategy

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media