Abstract
The magnetic resonance (MR) images of fetuses make it possible for doctors to detect out pathological fetal brains in early stages. Brain tissue segmentation is prerequisite for making brain morphology and volume analyses. nnU-Net is an automatic segmentation method based on deep learning. It can adaptively configure itself, so as to adapt to a specific task via preprocessing, network architecture, training, and post-processing. Therefore, we adapt nnU-Net to segment seven types of fetal brain tissues, including external cerebrospinal fluid, gray matter, white matter, ventricle, cerebellum, deep gray matter, and brainstem. With regard to the characteristics of the FeTA 2021 data, some adjustments are made to the original nnU-Net, so that it can segment seven types of fetal brain tissues precisely as far as possible. The average segmentation results on FeTA 2021 training data demonstrate that our advanced nnU-Net is superior to the peers including SegNet, CoTr, AC U-Net and ResUnet. Its average segmentation results are 0.842, 11.759 and 0.957 in terms of Dice, HD95 and VS criteria. Moreover, the experimental results on FeTA 2021 test data further demonstrate that our advanced nnU-Net has obtained good segmentation performance of 0.774, 14.699 and 0.875 in terms of Dice, HD95 and VS, ranked the third in FeTA 2021 challenge. Our advanced nnU-Net realized the task for segmenting the fetal brain tissues using MR images of different gestational ages, which can help doctors to make correct and seasonable diagnoses.
Similar content being viewed by others
References
Modell B, Darlison MW, Malherbe H, Moorthie S, Blencowe H, Mahaini R, El-Adawy M. Congenital disorders: epidemiological methods for answering calls for action. J Commun Genetics. 2018;9(4):335–40.
Makropoulos A, Counsell SJ, Rueckert D. A review on automatic fetal and neonatal brain MRI segmentation. NeuroImage. 2018;170:231–48.
Habas PA, Kim K, Rousseau F, Glenn OA, Barkovich AJ, Studholme C. Atlas-based segmentation of the germinal matrix from in utero clinical MRI of the fetal brain. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 351–358. Springer, 2008.
Habas PA, Kim K, Corbett-Detig JM, Rousseau F, Glenn OA, Barkovich AJ, Studholme C. A spatiotemporal atlas of MR intensity, tissue probability and shape of the fetal brain with application to segmentation. NeuroImage. 2010;53(2):460–70.
Serag A, Kyriakopoulou V, Rutherford MA, Edwards AD, Hajnal JV, Aljabar P, Counsell SJ, Boardman J, Rueckert D. A multi-channel 4D probabilistic atlas of the developing brain: application to fetuses and neonates. Ann BMVA. 2012;2012(3):1–14.
Sarki R, Ahmed K, Wang H, Zhang Y, Wang K. Convolutional neural network for multi-class classification of diabetic eye disease. EAI Endorsed Trans Scalable Inf Syst. 2022;9(4): e15.
Sarki R, Ahmed K, Wang H, Zhang Y. Automated detection of mild and multi-class diabetic eye diseases using deep learning. Health Inf Sci Syst. 2020;8(32):1–9.
Pandey D, Wang H, Yin X, Wang K, Zhang Y, Shen J. Automatic breast lesion segmentation in phase preserved DCE-MRIs. Health Inf Sci Syst. 2022;10(9):1–19.
Jiahua D, Michalska S, Subramani S, Wang H, Zhang Y. Neural attention with character embeddings for hay fever detection from Twitter. Health Inf Sci Syst. 2019;7(21):1–7.
Alvi AM, Siuly S, Wang H. A long short-term memory based framework for early detection of mild cognitive impairment from EEG signals. IEEE Trans Emerg Top Comput Intell. 2022. https://doi.org/10.1109/TETCI.2022.3186180.
Supriya S, Siuly S, Wang H, Zhang Y. Automated epilepsy detection techniques from electroencephalogram signals: a review study. Health Inf Sci Syst. 2020;8(33):1–15.
He J, Rong J, Sun L, Wang H, Zhang Y, Ma J. A framework for cardiac arrhythmia detection from IoT-based ECGs. World Wide Web. 2020;23(5):2835–50.
Khalili N, Lessmann N, Turk E, Claessens N, de Heus R, Kolk T, Viergever MA, Benders MJ, Išgum I. Automatic brain tissue segmentation in fetal MRI using convolutional neural networks. Magn Reson Imaging. 2019;64:77–89.
Payette K, Kottke R, Jakab A. Efficient multi-class fetal brain segmentation in high resolution MRI reconstructions with noisy labels. In Medical Ultrasound, and Preterm, Perinatal and Paediatric Image Analysis, pp. 295–304. Springer, 2020.
Hong J, Yun HJ, Park G, Kim S, Laurentys CT, Siqueira LC, Tarui T, Rollins CK, Ortinau CM, Grant PE, Lee JM. Fetal cortical plate segmentation using fully convolutional networks with multiple plane aggregation. Front Neurosci. 2020;14:591683.
Dou H, Karimi D, Rollins CK, Ortinau CM, Vasung L, Velasco-Annis C, Ouaalam A, Yang X, Ni D, Gholipour A. A deep attentive convolutional neural network for automatic cortical plate segmentation in fetal MRI. IEEE Trans Med Imaging. 2021;40(4):1123–33.
de Dumast P, Kebiri H, Atat C, Dunet V, Koob M, Cuadra MB. Segmentation of the cortical plate in fetal brain MRI with a topological loss. In: Uncertainty for safe utilization of machine learning in medical imaging, and perinatal imaging, placental and preterm image analysis, pp. 200–209. Springer, 2021.
Badrinarayanan V, Kendall A, Cipolla R. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell. 2017;39(12):2481–95.
Xie Y, Zhang J, Shen C, Xia Y. Cotr: Efficiently bridging CNN and transformer for 3D medical image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 171–180. Springer, 2021.
Chen X, Williams BM, Vallabhaneni SR, Czanner G, Williams R, Zheng Y. Learning active contour models for medical image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11632–11640, 2019.
Zhang Z, Liu Q, Wang Y. Road extraction by deep residual U-Net. IEEE Geosci Remote Sens Lett. 2018;15(5):749–53.
Isensee F, Jaeger PF, Kohl SA, Petersen J, Maier-Hein KH. nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat Methods. 2021;18(2):203–11.
Payette K, de Dumast P, Kebiri H, Ezhov I, Paetzold JC, Shit S, Iqbal A, Khan R, Kottke R, Grehten P, Ji H. An automatic multi-tissue human fetal brain segmentation benchmark using the fetal tissue annotation dataset. Sci Data. 2021;8(1):1–14.
Tourbier S, Bresson X, Hagmann P, Thiran JP, Meuli R, Cuadra MB. An efficient total variation algorithm for super-resolution in fetal brain MRI with adaptive regularization. NeuroImage. 2015;118:584–97.
Kuklisova-Murgasova M, Quaghebeur G, Rutherford MA, Hajnal JV, Schnabel JA. Reconstruction of fetal brain MRI with intensity matching and complete outlier removal. Med Image Anal. 2012;16(8):1550–64.
Payette K, Li H, de Dumast P, Licandro R, Ji H, Siddiquee MM, Xu D, Myronenko A, Liu H, Pei Y, Wang L. Fetal brain tissue annotation and segmentation challenge results. 2022. arXiv:2204.09573
Falk T, Mai D, Bensch R, Çiçek Ö, Abdulkadir A, Marrakchi Y, Böhm A, Deubner J, Jäckel Z, Seiwald K, et al. U-net: deep learning for cell counting, detection, and morphometry. Nat Methods. 2019;16(1):67–70.
Dice LR. Measures of the amount of ecologic association between species. Ecology. 1945;26(3):297–302.
Huttenlocher DP, Klanderman GA, Rucklidge WJ. Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell. 1993;15(9):850–63.
Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL. Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell. 2017;40(4):834–48.
Acknowledgements
This work is supported in part by the National Natural Science Foundation of China under Grant Nos. of 62076159, 12031010, and 61673251; and is also supported by the Fundamental Research Funds for the Central Universities under Grant Nos. of GK202105003 and 202207017. We acknowledge those who organized the FeTA 2021 challenge and published the training data and the related informations for us to use in this research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There is not any conflict of interest in the manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Peng, Y., Xu, Y., Wang, M. et al. The nnU-Net based method for automatic segmenting fetal brain tissues. Health Inf Sci Syst 11, 17 (2023). https://doi.org/10.1007/s13755-023-00220-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s13755-023-00220-3