Abstract
Computed Tomography (CT) is commonly used in clinical procedures and limited angle tomography reconstruction has important applications in diagnostic CT, breast tomography, dental tomography, etc. However, CT images reconstructed from limited angle acquisitions suffer from severe artifacts due to incomplete sinogram data. Although existing iterative reconstruction methods improve image quality relative to filtered back projection, these methods require extensive computation and still often provide unsatisfactory images. Supervised deep learning methods have been proposed to further improve the image quality of limited angle reconstructions. However, a key limitation in supervised deep learning for this application is the lack of large-scale real sinogram-reconstruction pairs for training. Given the large number of CT images available in the wild, we can create a large number of simulated sinogram-reconstruction pairs. Thus the requirement for real paired sinogram-reconstruction data can be alleviated if simulated sinograms (e.g. monochromatic) are able to train a reconstruction network for real sinograms (e.g. polychromatic source, scattering, beam hardening). In this paper, we propose an end-to-end limited angle tomography reconstruction adversarial network (Tomo-GAN) via unsupervised sinogram adaptation without having real sinogram-reconstruction pairs. Tomo-GAN is trained by using (1) unpaired sinograms from the simulation and real domains, and (2) large-scale reconstruction images from only the simulation domain. Tomo-GAN is built based upon a cycle consistent network with similarity constrained for sinogram adaptation and a multi-scale conditional reconstruction network. Experimental results on a public dataset with a limited angle setting demonstrated a consistent improvement over previous methods while significantly reducing the reconstruction computation time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kak, A.C., Slaney, M.: Principles of Computerized Tomographic Imaging. IEEE Press, New York (1988)
Cho, J.H., Fessler, J.A.: Motion-compensated image reconstruction for cardiac CT with sinogram-based motion estimation. In: 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC), pp. 1–5. IEEE (2013)
Mohan, K.A., et al.: TIMBIR: a method for time-space reconstruction from interlaced views. IEEE Trans. Comput. Imaging 1(2), 96–111 (2015)
Niklason, L.T., et al.: Digital tomosynthesis in breast imaging. Radiology 205(2), 399–406 (1997)
Hyvönen, N., Kalke, M., Lassas, M., Setälä, H., Siltanen, S.: Three-dimensional dental X-ray imaging by combination of panoramic and projection data. Inverse Probl. Imaging 4(2), 257–271 (2010)
Zhou, B., Guo, Q., Zeng, X., Xu, M.: Feature decomposition based saliency detection in electron cryo-tomograms. arXiv preprint arXiv:1801.10562 (2018)
Guo, J., Zhou, B., Zeng, X., Freyberg, Z., Xu, M.: Model compression for faster structural separation of macromolecules captured by cellular electron cryo-tomography. In: Campilho, A., Karray, F., ter Haar Romeny, B. (eds.) ICIAR 2018. LNCS, vol. 10882, pp. 144–152. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93000-8_17
Huang, Y., et al.: Restoration of missing data in limited angle tomography based on Helgason-Ludwig consistency conditions. Biomed. Phys. Eng. Express 3(3), 035015 (2017)
Frikel, J., Quinto, E.T.: Characterization and reduction of artifacts in limited angle tomography. Inverse Probl. 29(12), 125007 (2013)
Zhang, H., et al.: Image prediction for limited-angle tomography via deep learning with convolutional neural network. arXiv preprint arXiv:1607.08707 (2016)
Rick Chang, J.-H., Li, C.-L., Poczos, B., Vijaya Kumar, B.V.K., Sankaranarayanan, A.C.: One network to solve them all-solving linear inverse problems using deep projection models. In: ICCV, pp. 5889–5898 (2017)
Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., Efros, A.A.: Context encoders: feature learning by inpainting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2536–2544 (2016)
Ledig, C., et al.: Photo-realistic single image super-resolution using a generative adversarial network. In: CVPR, vol. 2, p. 4 (2017)
Gordon, R., Bender, R., Herman, G.T.: Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and X-ray photography. J. Theoret. Biol. 29(3), 471–481 (1970)
Trampert, J., Leveque, J.-J.: Simultaneous iterative reconstruction technique: physical interpretation based on the generalized least squares solution. J. Geophys. Res.: Solid Earth 95(B8), 12553–12559 (1990)
Zhu, J.-Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)
Zhou, B., Lin, X., Eck, B., Hou, J., Wilson, D.: Generation of virtual dual energy images from standard single-shot radiographs using multi-scale and conditional adversarial network. arXiv preprint arXiv:1810.09354 (2018)
Hubbell, J.H., Seltzer, S.M.: Tables of X-ray mass attenuation coefficients and mass energy-absorption coefficients 1 kev to 20 mev for elements z= 1 to 92 and 48 additional substances of dosimetric interest. Technical report, National Institute of Standards and Technology-PL, Gaithersburg, MD (1995)
Yan, K., Wang, X., Lu, L., Summers, R.M.: Deeplesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning. J. Med. Imaging 5(3), 036501 (2018)
Mersereau, R.M., Oppenheim, A.V.: Digital reconstruction of multidimensional signals from their projections. Proc. IEEE 62(10), 1319–1338 (1974)
Rivers, M.L.: tomoRecon: high-speed tomography reconstruction on workstations using multi-threading. In: Developments in X-Ray Tomography VIII, vol. 8506, p. 85060U. International Society for Optics and Photonics (2012)
Eck, B.L., et al.: Computational and human observer image quality evaluation of low dose, knowledge-based CT iterative reconstruction. Med. Phys. 42(10), 6098–6111 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, B., Lin, X., Eck, B. (2019). Limited Angle Tomography Reconstruction: Synthetic Reconstruction via Unsupervised Sinogram Adaptation. In: Chung, A., Gee, J., Yushkevich, P., Bao, S. (eds) Information Processing in Medical Imaging. IPMI 2019. Lecture Notes in Computer Science(), vol 11492. Springer, Cham. https://doi.org/10.1007/978-3-030-20351-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-20351-1_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-20350-4
Online ISBN: 978-3-030-20351-1
eBook Packages: Computer ScienceComputer Science (R0)