Abstract
Automatic segmentation of the liver in abdominal CT images is critical for guiding liver cancer biopsies and treatment planning. Yet, automatic segmentation of CT liver images remains challenging due to the poor contrast between the liver and surrounding organs in abdominal CT images. In this paper, we propose a novel network for liver segmentation, and the network is essentially a U-shaped network with an encoder–decoder structure. Firstly, the complementary feature enhancement unit is designed in the network to mitigate the semantic gap between encoder and decoder. The complementary feature enhancement unit is based on subtraction, which enhances the complementary features between encoder and decoder. Secondly, this paper proposes a new cross attention model that no longer generates value by convolution, which reduces redundant information and enhances the contextual information of single sparse attention by encoding contextual information by \(3\times 3\) convolution. The dice score, accuracy, and precision of our network on the LiTS dataset were 95.85\(\%\), 97.19\(\%\), and 97.11\(\%\), and the dice score, accuracy, and precision on the dataset consisted of 3Dircadb and CHAOS were 93.65\(\%\), 94.38\(\%\), and 97.53\(\%\).
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Sung, H., Ferlay, J., Jacques, S., Rebecca, L., Laversanne, M., Soerjomataram, I., Jemal, A., Bray, F.: Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: Cancer J. Clin. 71(3), 209–249 (2021)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. Lect. Notes Comput. Sci. 9351(2015), 234–241 (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 640–651 (2014)
Han, X.: Automatic liver lesion segmentation using a deep convolutional neural network method. Preprint at arXiv:1704.07239
Li, X.M., Chen, H., Qi, X.J., Dou, Q., Fu, C.W., Heng, P.A.: H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans. Med. Imaging 37(12), 2663–2674 (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Huang, G., Liu, Z., van der Maten, L., Weinberger, KQ.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2261–2269 (2017)
Oktay, O., Schlemper, J., Folgoc, LL., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, NY., Kainz, B. et al.: Attention U-Net: learning where to look for the pancreas. Preprint at arXiv:1804.03999
Pan, G., Zheng, Y.X., Guo, S., Lv, Y.Z.: Automatic sewer pipe defect semantic segmentation based on improved U-Net. Autom. Constr. 119, 103383 (2020)
Zhao, X., Zhang, P., Song, F., Fan, G., Sun, Y., Wang, Y., Tian, Z., Zhang, L., Zhang, G.: D2A U-Net: automatic segmentation of COVID-19 CT slices based on dual attention and hybrid dilated convolution. Comput. Biol. Med. 135, 104526 (2021)
Chen, S., Zou, Y., Liu, P.X.: IBA-U-Net: attentive BConvLSTM U-Net with redesigned inception for medical image segmentation. Comput. Biol. Med. 135, 104551 (2021)
Yang, J., Qiu, K.: An improved segmentation algorithm of CT image based on U-Net network and attention mechanism. Multimed Tools Appl. (2021). https://doi.org/10.1007/s11042-021-10841-z
Hyunseok, S., Charles, H., Maxime, B., Ruoxiu, X., Lei, X.: Modified U-Net (mU-Net) with incorporation of object-dependent high level features for improved liver and liver-tumor segmentation in CT images. Preprint at arXiv:1911.00140
Zhou, Z., Siddiquee, M.R., Tajbakhsh, N., Liang, J.: Unet++: a nested U-Net architecture for medical image segmentation. CoRR (2018) arXiv:1807.10165
He, K.M., Zhang, X.Y., Ren, S.Q., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015)
Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Semantic image segmentation with deep convolutional nets and fully connected CRFs. Preprint at arXiv:1412.7062
Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. (2016) arXiv:1606.00915
Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking atrous convolution for semantic image segmentation. (2017) arXiv:1706.05587
Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision-ECCV 2018. ECCV 2018. Lecture Notes in Computer Science, vol. 11211. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_4920
Li, H.C., Xiong, P.F., Jie, A., Wang, L.X.: Pyramid attention network for semantic segmentation. Preprint at arXiv:1805.10180
Gu, F., Burlutskiy, N., Andersson, M., Wilen, L.K.: Multi-resolution networks for semantic segmentation in whole slide images. Preprint at arXiv:1807.09607v1
Hiroki, T., Yuki, T., Akihiko, Y., Ryoma, B.: Adaptive weighting multi-field-of-view CNN for semantic segmentation in pathology. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12597–12606 (2019)
Wang, X., Girshick, R., Gupta, A., He, K.: Non-local neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7794–7803 (2018)
Huang, Z.L., Wang, X.G., Huang, L.C., Huang, C., Wei, Y.C., Liu W.Y.: CCNet: criss-cross attention for semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 603–612 (2019)
Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., Lu, H.: Dual attention network for scene segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3146–3154 (2019)
Zhu, Z., Xu, M.D., Bai, S., Huang, T.T., Bai X.: Asymmetric non-local neural networks for semantic segmentation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 593–602 (2019)
Bilic, P., Christ, P.F., Vorontsov, E., Chlebus, G., Chen, H., et al.: The liver tumor segmentation benchmark (LiTS). arXiv:1901.04056
Christ, P.F., et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. In: Ourselin, S., Joskowicz, L., Sabuncu, M., Unal, G., Wells, W. (eds.) Medical Image Computing and Computer-Assisted Intervention-MICCAI 2016. MICCAI 2016. Lecture Notes in Computer Science, vol. 9901. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46723-8_48
Kavur, A.E., Gezer, N.S., Aslan, S., Conze, P.H., Groza, V., Pham, D.D., Chatterjee, S., Ernst, P., Han, S., Rajan, R., et al.: CHAOS challenge-combined (CT-MR) healthy abdominal organ segmentation. Med. Image Anal. 69, 101950 (2021)
Ibtehaz, N., Rahman, M.S.: MultiResUNet: rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw. 121, 74–87 (2020)
Zhao, H.S., Shi, J.P., Qi, X.J., Wang, X.G., Jia, J.Y.: Pyramid scene parsing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2881–2890 (2017)
Jha, D., Smedsrud, P.H., Riegler, M.A., Johansen, D., Lange, T., Halvorsen, P.: ResUNet++: an advanced architecture for medical image segmentation. In:2019 IEEE International Symposium on Multimedia (ISM), pp. 225–2255 (2019) https://doi.org/10.1109/ISM46123.2019.00049
Cai, K., Yang, R.Q., Li, L.H., Zhou, J., Ou, S.X., Feng, L.: A framework combining window width-level adjustment and Gaussian filter-based multi-resolution for automatic whole heart segmentation. Neurocomputing 220(12), 138–150 (2017)
Woo, S., Park, J.C., Lee, J.Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018)
Li, X., Wang, W.H., Hu, X.L., Jian, Y.: Selective Kernel networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 510–519 (2019)
Gu, Z.W., Cheng, J., Fu, H.Z., Zhou, K., Hao, H.Y., Zhao, Y.T., Zhang, T.Y., Gao, S.H., Liu, J.: Ce-net: context encoder network for 2d medical image segmentation. IEEE Trans. Med. Imaging 38(10), 2281–2292 (2019)
Liu, Z., Han, K., Wang, Z., et al.: Automatic liver segmentation from abdominal CT volumes using improved convolution neural networks. Multimed. Syst. 27, 111–124 (2021)
Fan, T., Wang, G., Wang, X., et al.: MSN-Net: a multi-scale context nested U-Net for liver segmentation. SIViP 15, 1089–1097 (2021)
Acknowledgements
This work was supported by the Key Science and Technology Program of Henan Province(212102310084)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Sun, J., Hui, Z., Tang, C. et al. Liver segmentation based on complementary features U-Net. Vis Comput 39, 4685–4696 (2023). https://doi.org/10.1007/s00371-022-02617-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-022-02617-9