Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

CCN-CL: : A content-noise complementary network with contrastive learning for low-dose computed tomography denoising

Published: 01 August 2022 Publication History
  • Get Citation Alerts
  • Abstract

    In recent years, low-dose computed tomography (LDCT) has played an increasingly important role in the diagnosis CT to reduce the potential adverse effects of x-ray radiation on patients while maintaining the same diagnostic image quality. Current deep learning-based denoising methods applied to LDCT imaging only use normal dose CT (NDCT) images as positive examples to guide the denoising process. Recent studies on contrastive learning have proved that the original images as negative examples can also be helpful for network learning. Therefore, this paper proposes a novel content-noise complementary network with contrastive learning for an LDCT denoising task. First, to better train our proposed network, a contrastive learning loss, taking the NDCT image as a positive example and the original LDCT image as a negative example to guide the network learning is added. Furthermore, we also design a network structure that combines content-noise complementary learning strategy, attention mechanism, and deformable convolution for better network performance. In an evaluation study, we compare the performance of our designed network with some of the state-of-the-art methods in the 2016 NIH-AAPM-Mayo Clinic Low Dose CT Grand Challenge dataset. The quantitative and qualitative evaluation results demonstrate the feasibility and effectiveness of applying our proposed CCN-CL network model as a new deep learning-based LDCT denoising method.

    Highlights

    A novel network for low-dose CT (LDCT) denoising.
    The network is combined with contrastive learning and a contrastive regularization loss term is proposed to constrain it.
    The content-noise complementary learning strategy is introduced into our network architecture.
    The attention mechanism and deformable convolution are also introduced into our framework for LDCT denoising.
    The framework is tested in the AAPM dataset and achieved superior performance than the most widely used denoised networks.

    References

    [1]
    A. Manduca, L. Yu, J.D. Trzasko, et al., Projection space denoising with bilateral filtering and CT noise modeling for dose reduction in CT[J], Med. Physi. 36 (11) (2009) 4911–4919.
    [2]
    J.A. Fessler, Penalized weighted least-squares image reconstruction for positron emission tomography[J], IEEE Trans. Med. Imag. 13 (2) (1994) 290–300.
    [3]
    J. Wang, T. Li, H. Lu, et al., Penalized weighted least-squares approach to sinogram noise reduction and image reconstruction for low-dose X-ray computed tomography[J], IEEE Trans. Med. Imag. 25 (10) (2006) 1272–1283.
    [4]
    J. Hsieh, Adaptive streak artifact reduction in computed tomography resulting from excessive x‐ray photon noise[J], Med. Phys. 25 (11) (1998) 2139–2147.
    [5]
    Y. Zhang, J. Zhang, H. Lu, Statistical sinogram smoothing for low-dose CT with segmentation-based adaptive filtering[J], IEEE Trans. Nucl. Sci. 57 (5) (2010) 2587–2598.
    [6]
    Z. Li, L. Yu, J.D. Trzasko, et al., Adaptive nonlocal means filtering based on local noise level for CT denoising[J], Med. Physi. 41 (1) (2014).
    [7]
    P.F. Feruglio, C. Vinegoni, J. Gros, et al., Block matching 3D random noise filtering for absorption optical projection tomography[J], Phys. Med. Biol. 55 (18) (2010) 5401.
    [8]
    Y. Liu, J. Ma, Y. Fan, et al., Adaptive-weighted total variation minimization for sparse data toward low-dose x-ray computed tomography image reconstruction[J], Phys. Med. Biol. 57 (23) (2012) 7923.
    [9]
    Y. Chen, X. Yin, L. Shi, et al., Improving abdomen tumor low-dose CT images using a fast dictionary learning based processing[J], Phys. Med. Biol. 58 (16) (2013) 5803.
    [10]
    Y. Chen, J. Liu, Y. Hu, et al., Discriminative feature representation: an effective postprocessing solution to low dose CT imaging[J], Phys. Med. Biol. 62 (6) (2017) 2103.
    [11]
    G.F. Rust, V. Aurich, M. Reiser, Noise/dose reduction and image improvements in screening virtual colonoscopy with tube currents of 20 mAs with nonlinear Gaussian filter chains[C]//Medical Imaging 2002: physiology and Function from Multidimensional Images, Int. Soc. Optic. Photonic. 4683 (2002) 186–197.
    [12]
    Y. Chen, J. Ma, Q. Feng, et al., Nonlocal prior Bayesian tomographic reconstruction[J], J. Math. Imag. Vis. 30 (2) (2008) 133–146.
    [13]
    H. Zhang, J. Ma, J. Wang, et al., Statistical image reconstruction for low-dose CT using nonlocal means-based regularization[J], Comput. Med. Imag. Graph. 38 (6) (2014) 423–435.
    [14]
    M. Beister, D. Kolditz, W.A. Kalender, Iterative reconstruction methods in X-ray CT[J], Phys. Med. 28 (2) (2012) 94–108.
    [15]
    C. Zhang, T. Zhang, M. Li, et al., Low-dose CT reconstruction via L1 dictionary learning regularization using iteratively reweighted least-squares[J], Biomed. Eng. Online 15 (1) (2016) 1–21.
    [16]
    E.Y. Sidky, X. Pan, Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization[J], Phys. Med. Biol. 53 (17) (2008) 4777.
    [17]
    Y. Chen, D. Gao, C. Nie, et al., Bayesian statistical reconstruction for low-dose X-ray computed tomography using an adaptive-weighting nonlocal prior[J], Comput. Med. Imag. Graph. 33 (7) (2009) 495–500.
    [18]
    S. Bera, P.K. Biswas, Noise conscious training of non local neural network powered by self attentive spectral normalized markovian patch GAN for low dose CT denoising[J], IEEE Trans. Med. Imag. 40 (12) (2021) 3663–3673.
    [19]
    Y. Ma, B. Wei, P. Feng, et al., Low-dose CT image denoising using a generative adversarial network with a hybrid loss function for noise learning[J], IEEE Access 8 (2020) 67519–67529.
    [20]
    M. Li, Q. Du, L. Duan, et al., Incorporation of Residual Attention Modules into Two Neural Networks for Low‐dose CT denoising[J], Medical Physics, 2021.
    [21]
    Z. Li, S. Zhou, J. Huang, et al., Investigation of low-dose ct image denoising using unpaired deep learning methods[J], IEEE Trans. Radio. Plasma. Med. Sci. 5 (2) (2020) 224–234.
    [22]
    Q. Yang, P. Yan, M.K. Kalra, et al., CT Image Denoising with Perceptive Deep Neural networks[J], 2017, arXiv preprint arXiv:1702.07019.
    [23]
    D. Wu, K. Kim, G.E. Fakhri, et al., A Cascaded Convolutional Neural Network for X-Ray Low-Dose CT Image denoising[J], 2017, arXiv preprint arXiv:1705.04267.
    [24]
    W. Chen, Y. Shao, Y. Wang, et al., A novel total variation model for low-dose CT image denoising[J], IEEE Access 6 (2018) 78892–78903.
    [25]
    H. Chen, Y. Zhang, W. Zhang, et al., Low-dose CT via convolutional neural network[J], Biomed. Opt Express 8 (2) (2017) 679–694.
    [26]
    H. Chen, Y. Zhang, M.K. Kalra, et al., Low-dose CT with a residual encoder-decoder convolutional neural network[J], IEEE Trans. Med. Imag. 36 (12) (2017) 2524–2535.
    [27]
    Q. Yang, P. Yan, Y. Zhang, et al., Low-dose CT image denoising using a generative adversarial network with Wasserstein distance and perceptual loss[J], IEEE Trans. Med. Imag. 37 (6) (2018) 1348–1357.
    [28]
    X. Yin, Q. Zhao, J. Liu, et al., Domain progressive 3D residual convolution network to improve low-dose CT imaging[J], IEEE Trans. Med. Imag. 38 (12) (2019) 2903–2913.
    [29]
    H. Shan, Y. Zhang, Q. Yang, et al., 3-D convolutional encoder-decoder network for low-dose CT via transfer learning from a 2-D trained network[J], IEEE Trans. Med. Imag. 37 (6) (2018) 1522–1534.
    [30]
    K. Chen, K. Long, Y. Ren, et al., Lesion-inspired denoising network: connecting medical image denoising and lesion detection[C], Proc. ACM Int. Conf. Multimedia. (2021) 3283–3292.
    [31]
    K. Chen, J. Huang, J. Sun, et al., Task-Driven Deep Learning for LDCT Image Denoising[C]//The Fourth International Symposium on Image Computing and Digital Medicine, 2020, pp. 35–39.
    [32]
    K. Chen, X. Pu, Y. Ren, et al., Low-dose Ct Image Blind Denoising with Graph Convolutional networks[C]//International Conference on Neural Information Processing, Springer, Cham, 2020, pp. 423–435.
    [33]
    Y. Zhang, D. Hu, Q. Zhao, et al., CLEAR: comprehensive learning enabled adversarial reconstruction for subtle structure enhanced low-dose CT imaging[J], IEEE Trans. Med. Imag. 40 (11) (2021) 3089–3101.
    [34]
    J. Liu, J. Ma, Y. Zhang, et al., Discriminative feature representation to improve projection data inconsistency for low dose CT imaging[J], IEEE Trans. Med. Imag. 36 (12) (2017) 2499–2509.
    [35]
    D. Hu, Y. Zhang, J. Liu, et al., DIOR: Deep Iterative Optimization-Based Residual-Learning for Limited-Angle CT Reconstruction[J], IEEE Transactions on Medical Imaging, 2022.
    [36]
    W. Xia, Z. Lu, Y. Huang, et al., CT reconstruction with PDF: parameter-dependent framework for data from multiple geometries and dose levels[J], IEEE Trans. Med. Imag. 40 (11) (2021) 3065–3076.
    [37]
    H. Chen, Y. Zhang, Y. Chen, et al., LEARN: learned experts' assessment-based reconstruction network for sparse-data CT[J], IEEE Trans. Med. Imag. 37 (6) (2018) 1333–1347.
    [38]
    W. Xia, Z. Lu, Y. Huang, et al., MAGIC: manifold and graph integrative convolutional network for low-dose CT reconstruction[J], IEEE Trans. Med. Imag. 40 (12) (2021) 3459–3472.
    [39]
    Y. Zhang, T. Lv, R. Ge, et al., CD-Net: comprehensive domain network with spectral complementary for DECT sparse-view reconstruction[J], IEEE Trans. Comput. Image. 7 (2021) 436–447.
    [40]
    W. Xia, Z. Lu, Y. Huang, et al., CT reconstruction with PDF: parameter-dependent framework for data from multiple geometries and dose levels[J], IEEE Trans. Med. Imag. 40 (11) (2021) 3065–3076.
    [41]
    K. He, H. Fan, Y. Wu, et al., Momentum Contrast for Unsupervised Visual Representation learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 9729–9738.
    [42]
    W. Cui, C. Yan, Z. Yan, et al., BMNet: a new region-based metric learning method for early alzheimer's disease identification with FDG-PET images[J], Front. Neurosci. (2022) 16.
    [43]
    Y. Peng, Z. Cheng, C. Gong, et al., Pretreatment DCE-MRI-based deep learning outperforms radiomics analysis in predicting pathologic complete response to neoadjuvant chemotherapy in breast cancer[J], Front. Oncol. 12 (2022) 846775-846775.
    [44]
    W. Cao, G. Yuan, Q. Liu, et al., ICL-net: global and local inter-pixel correlations learning network for skin lesion segmentation[J], IEEE J. Niomed. Health Informatic. (2022),.
    [45]
    T. Chen, S. Kornblith, M. Norouzi, et al., A simple framework for contrastive learning of visual representations[C]//International conference on machine learning, PMLR (2020) 1597–1607.
    [46]
    A. Oord, Y. Li, O. Vinyals, Representation Learning with Contrastive Predictive coding[J], 2018, arXiv preprint arXiv:1807.03748.
    [47]
    O. Henaff, Data-efficient image recognition with contrastive predictive coding[C]//International Conference on Machine Learning, PMLR (2020) 4182–4192.
    [48]
    P. Sermanet, C. Lynch, Y. Chebotar, et al., Time-contrastive Networks: Self-Supervised Learning from video[C]//2018 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2018, pp. 1134–1141.
    [49]
    J.B. Grill, F. Strub, F. Altché, et al., Bootstrap Your Own Latent: A New Approach to Self-Supervised learning[J], 2020, arXiv preprint arXiv:2006.07733.
    [50]
    T. Park, A.A. Efros, R. Zhang, et al., Contrastive Learning for Unpaired Image-To-Image translation[C]//European Conference on Computer Vision, Springer, Cham, 2020, pp. 319–345.
    [51]
    H. Wu, Y. Qu, S. Lin, et al., Contrastive Learning for Compact Single Image Dehazing[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 10551–10560.
    [52]
    M. Geng, X. Meng, J. Yu, et al., Content-Noise Complementary Learning for Medical Image Denoising[J], IEEE Transactions on Medical Imaging, 2021.
    [53]
    X. Xu, M. Li, W. Sun, Learning Deformable Kernels for Image and Video denoising[J], 2019, arXiv preprint arXiv:1904.06903.
    [54]
    Yu F, Koltun V. Multi-scale context aggregation by dilated convolutions[J]. arXiv preprint arXiv:1511.07122, 2015.
    [55]
    J. Dai, H. Qi, Y. Xiong, et al., Deformable Convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 764–773.
    [56]
    AAPM (2017): Low dose CT Grand Challenge. [Online]. Available: http://www.aapm.org/GrandChallenge/LowDoseCT/#.
    [57]
    W. Lu, J.A. Onofrey, Y. Lu, et al., An investigation of quantitative accuracy for deep learning based denoising in oncological PET[J], Phys. Med. Biol. 64 (16) (2019).
    [58]
    J. Hu, L. Shen, G. Sun, Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7132–7141.
    [59]
    X. Zhu, H. Hu, S. Lin, et al., Deformable Convnets V2: More Deformable, Better results[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 9308–9316.
    [60]
    K. He, X. Zhang, S. Ren, et al., Deep Residual Learning for Image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770–778.
    [61]
    Q. Wang, B. Wu, P. Zhu, et al., ECA-Net: efficient channel attention for deep convolutional neural networks, in: 2020 IEEE[C]//CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2020.
    [62]
    H. Zhang, K. Zu, J. Lu, et al., Epsanet: an Efficient Pyramid Split Attention Block on Convolutional Neural network[J], 2021, arXiv preprint arXiv:2105.14447.
    [63]
    M.H. Guo, Z.N. Liu, T.J. Mu, et al., Beyond Self-Attention: External Attention Using Two Linear Layers for Visual tasks[J], 2021, arXiv preprint arXiv:2105.02358.
    [64]
    Kingma D P, Ba J. Adam: A Method for Stochastic optimization[J]. arXiv preprint arXiv:1412.6980, 2014.

    Cited By

    View all
    • (2024)SwinCT: feature enhancement based low-dose CT images denoising with swin transformerMultimedia Systems10.1007/s00530-023-01202-x30:1Online publication date: 7-Jan-2024

    Index Terms

    1. CCN-CL: A content-noise complementary network with contrastive learning for low-dose computed tomography denoising
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image Computers in Biology and Medicine
          Computers in Biology and Medicine  Volume 147, Issue C
          Aug 2022
          1105 pages

          Publisher

          Pergamon Press, Inc.

          United States

          Publication History

          Published: 01 August 2022

          Author Tags

          1. LDCT
          2. Image denoising
          3. Contrastive learning
          4. Content-noise complementary learning

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)SwinCT: feature enhancement based low-dose CT images denoising with swin transformerMultimedia Systems10.1007/s00530-023-01202-x30:1Online publication date: 7-Jan-2024

          View Options

          View options

          Get Access

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media