Abstract
Computed tomography (CT) is widely used to locate pulmonary nodules for preliminary diagnosis of the lung cancer. However, due to high visual similarities between malignant (cancer) and benign (non-cancer) nodules, distinguishing malignant from malign nodules is not an easy task for a thoracic radiologist. In this paper, a novel convolutional neural network (ConvNet) architecture is proposed to classify the pulmonary nodules as either benign or malignant. Due to the high variance of nodule characteristics in CT scans, such as size and shape, a multi-path, multi-scale architecture is proposed and applied in the proposed ConvNet to improve the classification performance. The multi-scale method utilizes filters with different sizes to more effectively extracted nodule features from local regions, and the multi-path architecture combines features extracted from different ConvNet layers thereby enhancing the nodule features with respect to global regions. The proposed ConvNet is trained and evaluated on the LUNGx Challenge database, and achieves a sensitivity of 0.887 and a specificity of 0.924 with an area under the curve (AUC) of 0.948. The proposed ConvNet achieves a 14% AUC improvement compared to the state-of-the-art unsupervised learning approach. The proposed ConvNet also outperforms the other state-of-the-art ConvNets explicitly designed for pulmonary nodule classification. For clinical usage, the proposed ConvNet could potentially assist the radiologists to make diagnostic decisions in CT screening.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
American Cancer Society. 2017. Retrieved January, 2019 from Cancer facts & figures 2017. https://www.cancer.org/research/cancer-facts-statistics/all-cancer-facts-figures/cancer-facts-figures-2017.html
Anthimopoulos, M., Christodoulidis, S., Ebner, L., Christe, A., & Mougiakakou, S. (2016). Lung pattern classification for interstitial lung diseases using a deep convolutional neural network. IEEE Transactions on Medical Imaging, 35(5), 1207–1216. https://doi.org/10.1109/TMI.2016.2535865.
Armato, S. G., Drukker, K., Li, F., Hadjiiski, L., Tourassi, G. D., Kirby, J. S., et al. (2016). LUNGx challenge for computerized lung nodule classification. Journal of Medical Imaging, 3, 3–9. https://doi.org/10.1117/1.JMI.3.4.044506.
Armato, S. G., Giger, M. L., Moran, C. J., Blackburn, J. T., Doi, K., & MacMahon, H. (1999). Computerized detection of pulmonary nodules on CT scans. RadioGraphics, 19(5), 1303–1311.
Bishop, C. M. (2006). Pattern recognition and machine learning (information science and statistics). Secaucus, NJ: Springer.
Chen, J., & Shen, Y. (2017). The effect of kernel size of CNNs for lung nodule classification. In 2017 9th international conference on advanced infocomm technology (ICAIT) (pp. 340–344). https://doi.org/10.1109/ICAIT.2017.8388942.
Ciompi, F., Jacobs, C., Scholten, E. T., Wille, M. M. W., de Jong, P. A., Prokop, M., et al. (2015). Bag-of-frequencies: A descriptor of pulmonary nodules in computed tomography images. IEEE Transactions on Medical Imaging, 34(4), 962–973. https://doi.org/10.1109/TMI.2014.2371821.
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition (pp. 248–255).
Duchi, J., Hazan, E., & Singer, Y. (2011). Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12, 2121–2159.
Efron, B. (1993). An introduction to the bootstrap. Monographs on statistics and applied probability (Series) (Vol. 57). New York: Chapman & Hall.
Giger, M. L., Bae, K. T., & Macmahon, H. (1994). Computerized detection of pulmonary nodules in computed tomography images. Investigative Radiology, 29(4), 459–465.
He, K., Zhang, X., Ren, S., & Sun, J. (2015a). Deep residual learning for image recognition. CoRR arXiv:1512.03385.
He, K., Zhang, X., Ren, S., & Sun, J. (2015b). Deep residual learning for image recognition. CoRR arXiv:1512.03385.
Janowczyk, A., & Madabhushi, A. (2016). Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases. Journal of Pathology Informatics, 7, 29. https://doi.org/10.4103/2153-3539.186902.
Jarrett, K., Kavukcuoglu, K., Ranzato, M., & LeCun, Y. (2009). What is the best multi-stage architecture for object recognition? In 2009 IEEE 12th international conference on computer vision (pp. 2146–2153).
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) Caffe: Convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093.
Kamiya, A., Murayama, S., Kamiya, H., Yamashiro, T., Oshiro, Y., & Tanaka, N. (2014). Kurtosis and skewness assessments of solid lung nodule density histograms: Differentiating malignant from benign nodules on CT. Japanese Journal of Radiology, 32(1), 14–21.
Kang, G., Liu, K., Hou, B., & Zhang, N. (2017). 3D multi-view convolutional neural networks for lung nodule classification. PLOS ONE, 12, 1–21. https://doi.org/10.1371/journal.pone.0188290.
Krizhevsky, A., Sutskever, I., & Hinton, G.E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th international conference on neural information processing systems—volume 1, Curran Associates Inc., USA, NIPS’12 (pp. 1097–1105).
Levi, G., & Hassncer, T. (2015). Age and gender classification using convolutional neural networks. In 2015 IEEE conference on computer vision and pattern recognition workshops (CVPRW) (pp. 34–42). https://doi.org/10.1109/CVPRW.2015.7301352.
Li, C., Diao, Y., Ma, H., & Li, Y. (2008). A statistical PCA method for face recognition. In 2008 Second international symposium on intelligent information technology application (vol. 3, pp. 376–380). https://doi.org/10.1109/IITA.2008.71.
Li, Q., Cai, W., Wang, X., Zhou, Y., Feng, D.D., & Chen, M. (2014). Medical image classification with convolutional neural network. In 2014 13th international conference on control automation robotics vision (ICARCV) (pp. 844–848).
Li, W., Cao, P., Zhao, D., & Wang, J. (2016). Pulmonary nodule classification with deep convolutional neural networks on computed tomography images. Computational and Mathematical Methods in Medicine, 2016, 6215085. https://doi.org/10.1155/2016/6215085.
Mazurowski, M. A., Habas, P. A., Zurada, J. M., Lo, J. Y., Baker, J. A., & Tourassi, G. D. (2008). Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural Networks, 21(2), 427–436. (Advances in Neural Networks Research: IJCNN ’07) .
Monkam, P., Qi, S., Xu, M., Han, F., Zhao, X., & Qian, W. (2018). CNN models discriminating between pulmonary micro-nodules and non-nodules from CT images. BioMedical Engineering OnLine, 17(1), 96. https://doi.org/10.1186/s12938-018-0529-x.
Nishio, M., & Nagashima, C. (2017). Computer-aided diagnosis for lung cancer: Usefulness of nodule heterogeneity. Academic Radiology, 24(3), 328–336.
Shen, W., Zhou, M., Yang, F., Yu, D., Dong, D., Yang, C., et al. (2017). Multi-crop convolutional neural networks for lung nodule malignancy suspiciousness classification. Pattern Recognition, 61, 663–673. https://doi.org/10.1016/j.patcog.2016.05.029.
Shin, H., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., et al. (2016). Deep convolutional neural networks for computer-aided detection: cnn architectures, dataset characteristics and transfer learning. IEEE Transactions on Medical Imaging, 35(5), 1285–1298. https://doi.org/10.1109/TMI.2016.2528162.
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., et al. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529, 484–489.
Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. CoRR arXiv:1409.1556.
Song, Q., Zhao, L., Luo, X., & Dou, X. (2017). Using deep learning for classification of lung nodules on computed tomography images. Journal of Healthcare Engineering, 2017, 7. https://doi.org/10.1155/2017/8314740.
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1), 1929–1958.
Szegedy, C., Ioffe, S., & Vanhoucke, V. (2016). Inception-v4, inception-resnet and the impact of residual connections on learning. CoRR. arXiv:1602.07261.
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015a). Going deeper with convolutions. In Computer vision and pattern recognition (CVPR).
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2015b). Rethinking the inception architecture for computer vision. CoRR arXiv:1512.00567.
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., et al. (2016). Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging, 35(5), 1299–1312.
The National Lung Screening Trial Research Team. (2011). Reduced lung-cancer mortality with low-dose computed tomographic screening. New England Journal of Medicine, 365(5), 395–409.
van Beek, E. J., Mirsadraee, S., & Murchison, J. T. (2015). Lung cancer screening: Computed tomography or chest radiographs? World Journal of Radiology, 7(8), 189–193. https://doi.org/10.4329/wjr.v7.i8.189.
van Ginneken, B., Setio, A. A. A., Jacobs, C., & Ciompi, F. (2015). Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. In: 2015 IEEE 12th international symposium on biomedical imaging (ISBI) (pp. 286–289).
Zhang, F., Song, Y., Cai, W., Lee, M. Z., Zhou, Y., Huang, H., et al. (2014). Lung nodule classification with multilevel patch-based context analysis. IEEE Transactions on Biomedical Engineering, 61(4), 1155–1166.
Zhao, X., Liu, L., Qi, S., Teng, Y., Li, J., & Qian, W. (2018). Agile convolutional neural network for pulmonary nodule classification using CT images. International Journal of Computer Assisted Radiology and Surgery, 13(4), 585–595. https://doi.org/10.1007/s11548-017-1696-0.
Zhu, H., Cheng, H., & Fan, Y. (2015). Random local binary pattern based label learning for multi-atlas segmentation. ProcSPIE, 9413, 8.
Acknowledgements
Data used in this study is obtained from The Cancer Imaging Archive (TCIA) sponsored by SPIE, NCI/NIH, AAPM and The University of Chicago, a public available medical database. This research was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI) and the Ministry of Health & Welfare, Republic of Korea (grant number: HI18C2383).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, Y., Zhang, H., Chae, K.J. et al. Novel convolutional neural network architecture for improved pulmonary nodule classification on computed tomography. Multidim Syst Sign Process 31, 1163–1183 (2020). https://doi.org/10.1007/s11045-020-00703-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11045-020-00703-6