Abstract
Image reconstruction is a mathematical process, where the image is compressed into a small representation and derived from this form. The general use of the reconstruction technique finds a place in noise removal from images obtained in medicine or other areas of life. In this paper, we propose a heuristic validation mechanism for training different types of neural networks in the problem of image reconstruction. The main idea is based on finding some important areas on image by heuristic algorithm and train network until a certain level of entropy of these areas is achieved. The mathematical model of this technique is described and supported by experimental results on different datasets with complex analysis of different heuristics. Proposed approach shows that it can reduce the average time of training process using convolutional neural networks.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Atlason HE, Love A, Sigurdsson S, Gudnason V, Ellingsen LM (2019) Unsupervised brain lesion segmentation from mri using a convolutional autoencoder. In: Medical Imaging 2019: Image Processing, vol 10949, p 109491H. International Society for Optics and Photonics
Belthangady C, Royer LA (2019) Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction. Nat Methods 16:1215–1225
Chen M, Shi X, Zhang Y, Wu D, Guizani M (2017) Deep features learning for medical image analysis with convolutional autoencoder neural network. IEEE Trans Big Data. https://doi.org/10.1109/TBDATA.2017.2717439
Dietze M, Branderhorst W, Viergever M, De Jong H (2019) Accelerated spect image reconstruction with a convolutional neural network. J Nucl Med 60(supplement 1):1351–1351
Elsayed SM, Sarker RA, Essam DL (2013) A genetic algorithm for solving the cec’2013 competition problems on real-parameter optimization. In: 2013 IEEE Congress on evolutionary computation, pp 356–360. IEEE
Gao Y, Liang Z, Moore W, Zhang H, Pomeroy MJ, Ferretti JA, Bilfinger TV, Ma J, Lu H (2019) A feasibility study of extracting tissue textures from a previous full-dose ct database as prior knowledge for bayesian reconstruction of current low-dose ct images. IEEE Trans Med Imaging 38(8):1981–1992
Gondara L (2016) Medical image denoising using convolutional denoising autoencoders. In: 2016 IEEE 16th international conference on data mining workshops (ICDMW), pp 241–246. IEEE
Inam O, Qureshi M, Akram H, Omer H, Laraib Z (2019) Accelerating parallel magnetic resonance image reconstruction on graphics processing units using cuda. In: 2019 IEEE 2nd international conference on information and computer technologies (ICICT), pp 109–113. IEEE
Kang C, Yu X, Wang S-H, Guttery D, Pandey H, Tian Y, Zhang Y (2020) A heuristic neural network structure relying on fuzzy logic for images scoring. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2020.2966163
Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980
Krizhevsky A, Nair V, Hinton G (2009) Cifar-10 and cifar-100 datasets. URl: https://www.cs.toronto.edu/kriz/cifar.html6
Li LL, Zhao X, Tseng ML, Tan RR (2020) Short-term wind power forecasting based on support vector machine with improved dragonfly algorithm. J Clean Prod 242:118,447
Liu S, Bai W, Liu G, Li W, Srivastava HM (2018) Parallel fractal compression method for big video data. Complexity 2018:2016976. https://doi.org/10.1155/2018/2016976
Liu S, Fu W, He L, Zhou J, Ma M (2017) Distribution of primary additional errors in fractal encoding method. Multimed Tools Appl 76(4):5787–5802
Liu S, Guo C, Al-Turjman F, Muhammad K, de Albuquerque VHC (2020) Reliability of response region: a novel mechanism in visual tracking by edge computing for iiot environments. Mech Syst Signal Process 138:106,537
Liu S, Liu G, Zhou H (2019) A robust parallel object tracking method for illumination variations. Mobile Netw Appl 24(1):5–17
Liu S, Pan Z, Cheng X (2017) A novel fast fractal image compression method based on distance clustering in high dimensional sphere surface. Fractals 25(04):1740,004
Lobos RA, Haldar JP (2019) Improving the performance of accelerated image reconstruction in k-space: the importance of kernel shape. In: Proceedings of the international society for magnetic resonance in medicine
Mirjalili S (2016) Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput Appl 27(4):1053–1073
Połap D, Marcin W (2017) Polar bear optimization algorithm: meta-heuristic with fast population movement and dynamic birth and death mechanism. Symmetry 9(10):203
Qiao Y (2007) The mnist database of handwritten digits. Dapat diakses di: http://www.gavo.tu-tokyo.ac.jp/~qiao/database.html
Qin C, Schlemper J, Caballero J, Price AN, Hajnal JV, Rueckert D (2018) Convolutional recurrent neural networks for dynamic MR image reconstruction. IEEE Trans Med Imaging 38(1):280–290
Sabar NR, Turky A, Song A, Sattar A (2019) An evolutionary hyper-heuristic to optimise deep belief networks for image reconstruction. Appl Soft Comput p 105510
Sadiq M, Shi D, Guo M, Cheng X (2019) Facial landmark detection via attention-adaptive deep network. IEEE Access 7:181,041–181,050
Sainath TN, Kingsbury B, Ramabhadran B (2012) Auto-encoder bottleneck features using deep belief networks. In: 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 4153–4156. IEEE
Schlemper J, Caballero J, Hajnal JV, Price AN, Rueckert D (2017) A deep cascade of convolutional neural networks for dynamic MR image reconstruction. IEEE Trans Med Imaging 37(2):491–503
Sha F, Zandavi SM, Chung YY (2019) Fast deep parallel residual network for accurate super resolution image processing. Expert Syst Appl 128:157–168
Szu H, Hartley R (1987) Fast simulated annealing. Phys Lett A 122(3–4):157–162
Trotter M, Wood T, Hwang J (2019) Forecasting a storm: Divining optimal configurations using genetic algorithms and supervised learning. In: 2019 IEEE international conference on autonomic computing (ICAC), pp 136–146. IEEE
Wang S, Sun J, Mehmood I, Pan C, Chen Y, Zhang YD (2020) Cerebral micro-bleeding identification based on a nine-layer convolutional neural network with stochastic pooling. Concurr Comput Pract Exp 32(1): e5130
Wang S, Tang C, Sun J, Zhang Y (2019) Cerebral micro-bleeding detection based on densely connected neural network. Front Neurosci 13:422
Wang SH, Zhang YD, Yang M, Liu B, Ramirez J, Gorriz JM (2019) Unilateral sensorineural hearing loss identification based on double-density dual-tree complex wavelet transform and multinomial logistic regression. Integr Comput-Aided Eng 26(4):411–426
Xiao H, Rasul K, Vollgraf R (2017) Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. corr arxiv: abs/1708.07747
Yang XS, Deb S (2009) Cuckoo search via lévy flights. In: 2009 World congress on nature & biologically inspired computing (NaBIC), pp 210–214. IEEE
Yang XS et al (2008) Nature-inspired metaheuristic algorithms. Firefly algorithm 20:79–90
Zeng X, Leung MR, Zeev-Ben-Mordehai T, Xu M (2018) A convolutional autoencoder approach for mining features in cellular electron cryo-tomograms and weakly supervised coarse segmentation. J Struct Biol 202(2):150–160
Acknowledgements
This work was funded by the National Centre for Research and Development of Poland (0080/DIA/2016/45) held by Dawid Polap. This research was partially funded by the Natural Sciences and Engineering Council of Canada (NSERC) Discovery Grant held by Gautam Srivastava.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Authors acknowledge the contribution to this project of the “Diamond Grant 2016” No. 0080/DIA/2016/45 from the Polish Ministry of Science and Higher Education.
Rights and permissions
About this article
Cite this article
Połap, D., Srivastava, G. Neural image reconstruction using a heuristic validation mechanism. Neural Comput & Applic 33, 10787–10797 (2021). https://doi.org/10.1007/s00521-020-05046-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-05046-8