Deep Learning and Medical Diagnosis: A Review of Literature

Abstract

In this review the application of deep learning for medical diagnosis is addressed. A thorough analysis of various scientific articles in the domain of deep neural networks application in the medical field has been conducted. More than 300 research articles were obtained, and after several selection steps, 46 articles were presented in more detail. The results indicate that convolutional neural networks (CNN) are the most widely represented when it comes to deep learning and medical image analysis. Furthermore, based on the findings of this article, it can be noted that the application of deep learning technology is widespread, but the majority of applications are focused on bioinformatics, medical diagnosis and other similar fields.

1. Introduction

Neural networks have advanced at a remarkable rate, and they have found practical applications in various industries [1]. Deep neural networks define inputs to outputs through a complex composition of layers which present building blocks including transformations and nonlinear functions [2]. Now, deep learning can solve problems which are hardly solvable with traditional artificial intelligence [3]. Deep learning can utilize unlabeled information during training; it is thus well-suited to addressing heterogeneous information and data, in order to learn and acquire knowledge [4]. The applications of deep learning may lead to malicious actions, however the positive use of this technology is much broader. Back in 2015, it was noted that deep learning has a clear path towards operating with large data sets, and thus, the applications of deep learning are likely to be broader in the future [3]. A large number of newer studies have highlighted the capabilities of advanced deep learning technologies, including learning from complex data [5,6], image recognition [7], text categorization [8] and others. One of the main applications of deep learning is for medical diagnosis [9,10]. This includes but is not limited to health informatics [11], biomedicine [12], and magnetic resonance image MRI analysis [13]. More specific uses of deep learning in the medical field are segmentation, diagnosis, classification, prediction, and detection of various anatomical regions of interest (ROI). Compared to traditional machine learning, deep learning is far superior as it can learn from raw data, and has multiple hidden layers which allow it to learn abstractions based on inputs [5]. The key to deep learning capabilities lies in the capability of the neural networks to learn from data through general purpose learning procedure [5].

The main goal of this review is to address the applications of deep learning in medical diagnosis in a concise and simple manner. Why is this important? It was noticed that a large number of scientific papers define various applications of deep learning in great detail. However, the number of papers that actually provide a concise review of deep learning application in medical diagnosis are scarce. Scientific terminology in the domain of deep learning can be confusing for researchers outside of this topic. This review paper provides a concise and simple approach to deep learning applications in medical diagnosis, and it can moderately contribute to the existing body of literature. The following research questions are used as guidelines for this article:

• How diverse is the application of deep learning in the field of medical diagnosis?
• Can deep learning substitute the role of doctors in the future?
• Does deep learning have a future or will it become obsolete?

This paper includes three main sections. In the first section the research methodology is described. Afterwards, the review of deep learning application in medical diagnosis is addressed. Finally, the results are discussed, conclusions are drawn, and future research is suggested.

2. Method

2.1. Flow Diagram of the Research

The research process is in accordance with the PRISMA flow diagram and protocol [14], and depicts the conducted steps from identifying articles to eligible articles for further analysis. The mentioned flow diagram is shown in Figure 1.

There are four main sections in the flow diagram. Firstly, article identification is conducted. This includes acquiring articles from various sources. The next section of the diagram includes the screening process. Article duplicates were excluded. Furthermore, the articles are screened once more and inadequate articles are removed. In the third section, full-articles were analyzed in order to determine the eligibility of the articles for further review. Ineligible articles were excluded from further review. The fourth and final section includes studies/articles that were thoroughly analyzed.

2.2. Literature Sources

In order to investigate the applications of deep learning in medical diagnosis, 263 articles published in the domain were analyzed. The main sources of these articles are presented in

Table 1. Literature sources.

Literature Source	ISSN
Briefings in Bioinformatics	1477-4054
Expert Systems with Application	0957-4174
IEEE Transactions Medical Imaging	1558-254X
Medical Image Analysis	1361-8423
Molecular Pharmaceutics	1543-8392
Nature	1476-4687
Neural Computing and Applications	0941-0643
Neurocomputing	0925-2312

.

These journals were chosen so that the credibility of this review paper is not compromised. However, there is a wide variety of other literature sources that are also adequate for this review.

2.3. Data Collection Process

The data collection process included extensive research of articles that addressed the applications of deep learning in the medical field. These articles were downloaded and analyzed in order to acquire sufficient theoretical information on the subject. The results in this paper are qualitative in nature, and the main focus is to review the applications of deep learning, and to answer the research questions which were outlined in the introduction section of this paper. In sum, the data collection process was conducted in four main phases:

• Phase 1: Searching articles in credible journals. This included the use of keywords presented under the Section 2.4 of this paper. At this point the articles were thoroughly analyzed.
• Phase 2: Analyzing the literature and excluding articles that do not fit the eligibility criteria. As there was no special screening during the search process, at this point the articles were analyzed and selected for further analysis.
• Phase 3: Thorough analysis of eligible articles conducted and the qualitative data classified in accordance with the aim of the review. At this stage there was a possibility of bias towards clearly written and conducted research articles.
• Phase 4: Qualitative data obtained and notes taken in order to concisely present the data in the results section of this paper. Data was collected in the form remarks and notes of what type of data and methods were used, and on what applications.

2.4. Obtained Literature and Eligibility Criteria

When the necessary literature for this systematic review was gathered, it was important to include various fields where deep learning is practically used. Therefore, the following keywords were used in the search engine:

• deep learning practical applications
• deep learning and medical diagnosis
• deep learning and MRI
• deep learning CT
• deep learning segmentation in medicine
• deep learning classification in medicine
• deep learning diagnosis medicine
• deep learning application medicine

This way it was ensured that a wide variety of articles will be included in the review. The year of article publication was also considered; the earliest article dates from 2014, while the majority of other reviewed articles are from 2016, 2017 and 2018. However, for the introduction section of this review, earlier articles were also addressed.

2.5. Risk of Bias in Individual Studies

There was no major bias during the data analysis. However, if an article was not about the application of deep learning in the field of medical diagnosis or medicine in general, it was then excluded from further analysis. This type of review paper allows the inclusion of articles, regardless of sample size, location, and data. There may seem to be a minor bias towards articles that address deep learning applications in medicine, particularly in cancer detection. However, this is due to the sheer number of articles that is much higher in this specific domain, as compared to other diseases. Therefore, this minor bias does not have a major impact, or indeed, any impact, on the obtained results.

3. Results

When it comes to deep learning and its application for medical diagnosis, there are two main approaches. The first approach is classification that includes reducing potential outcomes (diagnosis) by mapping data to specific outcomes. The second approach is physiological data which includes medical images and data from other sources are used to identify and diagnose tumors, or other diseases [15]. In addition, deep learning can be used for dietary assessment support [16]. For a certainty, deep learning is applied in various ways when it comes to medical diagnosis.

Brief reviews of individual articles in the domain of deep learning and medical diagnosis are given in

Table 2. Results of individual articles in the domain of deep learning and medical diagnosis.

Reference	Method	Data Source	Application/Remarks
[17]	CNN	Computed tomography (CT)	Anatomical localization; the results indicate that 3D localization of anatomical regions is possible with 2D images.
[18]	CNN	MRI	Automated segmentation; liver, heart and great vessels segmentation; it was concluded that this approach has great potential for clinical applications.
[19]	CNN	MRI	Brain tumor grading; a 3-layered CNN has a 18% performance improvement over to the baseline neural network.
[20]	CNN	Fundus images	Glaucoma detection; the experiments were performed on SCES and ORIGA datasets; further, it was noted that this approach may be great for glaucoma detection.
[21]	CNN	MRI	Alzheimer’s disease prediction; the accuracy of this approach is far superior compared to 2D methods
[22]	CNN	Mammography	Automatic breast tissue classification; the pectoral muscles were detected with high accuracy (0.83) while nipple detection had lower accuracy (0.56).
[23]	CNN	ECG	Automatic detection of myocardial infarction; average accuracy was 93.53% with noise and 95.22% without noise.
[24]	CNN	CT	Automated segmentation of human brain structures.
[25]	DBN-NN	Mammography	Automatic diagnosis for detecting breast cancer; the accuracy of the overall neural network was 99.68%, the sensitivity was 100%, and the specificity was 99.47%.
[26]	SDAE	Ultrasound of breasts, and lung CT	Breast lesion and pulmonary nodule detection/diagnosis; the results indicated that there is a significant increase in performance. In addition, it was noted that deep learning techniques have the potential to change CAD systems, with ease, and without the need for structural redesign.
[27]	CNN	Clinical images	Classification of skin cancer; the results of the study were satisfactory, as the deep convolutional neural networks achieve performance similar to the expertise of 21 board-certified dermatologist. This can lead to mobile dermatology diagnosis, providing millions of people with universal diagnostic care.
[28]	UGRNN	Various medical data sets	Drug-induced liver injury (DILI) prediction. The model had an accuracy of 86.9%, sensitivity of 82.5%, and specificity of 92.9%. Overall, deep learning gave significantly better results in opposite to other DILI prediction models. In sum, deep learning can lower the health risk for humans when it comes to DILI.
[29]	CRNN	Fundus images	Automatic grading system for nuclear cataracts; this method improved the clinical management of this cataract disease, and it has a potential for other eye disease diagnosis.
[30]	CNN	X-ray	Chest pathology identification; the area under the curve for heart detection was 0.89, for right pleural effusion detection 0.93, and for the classification between a healthy and an abnormal chest X-ray was 0.79. It was concluded that it is possible for non-medical images, and datasets to be sufficient for recognition of medical images.
[31]	SA-SVM	Dermoscopic images	Skin cancer diagnosis; the results were promising, and there is a possibility to use this type of self -advised SVM method in cases where is limited labeled data.
[32]	CSDCNN	Mammography	Multi-classification of breast cancer; a great performance of 93.2% accuracy was achieved on large-scale datasets
[33]	DNN	MRI	Brain tumor segmentation; with this method the whole brain can be segmented in 25 s to 3 min, thus making it a great segmentation tool.
[34]	CNN	MRI	Brain lesion segmentation; this approach produced great results.
[35]	CNN	Mammography	Breast density classification; Radiologist have a problem to differentiate between the two types of density. A learning model was developed that helped radiologist in the diagnosis process. Deep learning was found to be useful when it comes to realistic diagnosis, and overall clinical needs.
[36]	RBM	Shear-wave elastography SWE	Breast tumor classification; the results indicated that the deep learning model achieved a remarkable accuracy rate of 93.4%, with 88.6% sensitivity, and 97.1% specificity.
[37]	DL-CNN	CT urography	Urinary bladder segmentation; this method can overcome strong boundaries between two regions that have large differences of gray levels.
[38]	U-Net	MRI	Glioblastoma segmentation; this approach allowed a large U-Net training with small datasets, without significant overfitting. Taken into consideration that patients move during the segmentation process, there may be performance increase switching to 3D convolutions.
[39]	CNN	CT	Disease staging and prognosis of smokers; this type of chronic lung illness prognosis is powerful for risk assessment.
[40]	SDAE	Various medical images	Cancer detection from gene data; the study was successful as this method managed to extract genes that are helpful when it comes to cancer prediction.
[41]	CNN	The 3D volumetric ultrasound data	Ultrasound segmentation of first trimester placenta; it was noted that this approach had similar performance compared to results that were acquired through MRI data.
[42]	CNN	MRI	Segmentation of the striatum; two serial CNN architectures were used; the speed and accuracy of this approach makes it adequate for application in neuroscience and other clinical fields.
[43]	CNN	Images produced with a digital slider	Lymph node metastases detection in breast cancer; the best performing algorithm achieved performance comparable to a pathologist.
[44]	CNN	MRI	Brain segmentation; the results are comparable of other state-of-the-art performance.
[45]	CAD classifier with deep features from autoencoder	CT	Lung nodule classification; this approach resulted an accuracy of 75.01% and sensitivity of 83.35%; false positive was 0.39 per patient over 10 cross validations.
[46]	CNN, DBN, SDAE	CT	Lung cancer diagnosis; highest accuracy was achieved with DBN (0.8119).
[47]	CNN	MRI	Breast cancer diagnosis; with this approach the achieved accuracy was 96.39%, the sensitivity was 97.73%, and the specificity was 94.87%.
[48]	CNN	CT	Lung nodule detection; the network was trained with weak label information; 3D segmentation could exclude air tracts in the lungs, thus reducing false positives.
[49]	DLCNN	Planar projection (PPJ) image	Microcalcifications detection in digital breast tomosynthesis; the best obtained AUC was 0.933.
[50]	CNN	CT	Pancreas segmentation; average dice scores were from 46.6% to 68.8%.
[51]	CNN	Fundus images	Diagnosis of diabetic retinopathy; on a dataset of 80,000 images the accuracy was 75% and the sensitivity is 95%.
[52]	U-Net	MRI	Breast and fibroglandular tissue segmentation; average Dice Similarity Coefficients (DSC) were 0.850 for 3C U-net, 0.811 for 2C U-net, and 0.671 for atlas-based method.
[53]	CNN	Histopathology images	Breast cancer histopathology classification; average recognition rate was 82.13% for classification tasks, and 80.10% accuracy when it comes to magnification estimation.
[54]	CNN	Fundus images	Retina vessel segmentation; this method reduces the number of false-positives.
[55]	CNN	MRI	Brain segmentation; the performance is dependent of several factors such as initialization, preprocessing, and post-processing.
[56]	CNN	MRI	Automatic brain segmentation; this approach can be used for accurate brain segmentation results.
[57]	CNN	Digital images	Identifying and classifying tumor-associated stroma from breast biopsies; the study revealed that this deep learning approach was able to define stromal features of ductal carcinoma in situ grade.
[58]	CNN	Gastric images	Gastric cancer identification; the accuracy of classification was 97.93%.
[59]	CNN	CT	Lytic and sclerotic metastatic spinal lesion detection, segmentation and classification; the obtained results were quantitatively compared to other methods and it was concluded that this approach can provide better accuracy even for small lesions (greater than 1.4 mm3 and diameter greater than 0.7 mm).
[60]	DCNN	MRI	In this study the predictive test was conducted both with deep learning and non-deep-learning. The deep learning approach had an accuracy of 84%, sensitivity of 69.6% and specificity of 83.9%. The non-deep-learning approach had 70% accuracy, 49.4% sensitivity, and 81.7% specificity.
[61]	CNN	CT	Lung cancer nodule malignancy classification; with this approach a high level of accuracy was achieved 99%. This is proportionate to the accuracy of an experienced radiologist.
[62]	SSAE	Digital pathology images	Nuclei detection of breast cancer; the stacked sparse autoencoder (SSAE) approach can outperform state of the art nuclear detection strategies.

.

Furthermore, the synthesis of the results is presented in

Table 3. Synthesis of articles by type of deep learning method, data source and application.

Type of Deep Learning Method	Number of Articles
CNN	32
RBM	1
SA-SVM	1
CRNN	1
Other	3
DBN	1
SDAE	2
UGRNN	1
Multiple	1
U-Net	2
CSDCNN	1
Type of Data Source	Number of Articles
X-ray	1
Ultrasound	2
CT	10
MRI	13
Fundus photography	4
Mammography	4
Other data	12
Application Type	Number of Articles
Localization	1
Segmentation	14
Grading	2
Detection	8
Prediction	4
Classification	8
Diagnosis	6
Identification	2

.

In the next section the results are discussed.

4. Discussion

Discussing the Results

The main goal of this paper was to review various articles in the domain of deep learning application in medical diagnosis. After analyzing more than 300 articles, 46 were further examined, and the individual results of each article were presented. There was no need for quantitative data analysis, as the nature of this review was to present the variety of deep learning uses in the medical field. The synthesis of data was conducted in a simple way. Some of the methods used for synthesis were in accordance with other similar studies [63,64,65]. According to the gathered data, the most widely used deep learning method is convolutional neural networks (CNNs). In addition, MRI was most frequently used as training data. When it comes to the specific use, segmentation is the most represented. It is important to note, that the article review and analysis was biased towards newer (published 2015 and later) articles, and articles that included “deep learning” in the title. It can be seen that there is a large variety in the type of data that is used to train and apply deep neural networks. CT scan images, MRIs, fundus photography and other types of data can be used for expert-level diagnosis. However, as noted in other studies, neural networks use energy to activate neurons. With the human brain, during the thought process only a small number of neurons are active, while the neighboring neurons are shut down until needed. Communication “costs” are reduced through single-task allocation for neighboring neurons [65]. It is expected that artificial neural networks will further develop in the future, thus managing to complete more complex tasks.

The concise nature of this review can moderately contribute to the existing body of literature. The aim was to provide an objective, simple and a concise article. The individual research results provide sufficient information and insight into the applications of deep learning for detecting, classifying, segmenting and diagnosing various diseases and abnormalities in specific anatomical regions of interest (ROI). Without a doubt deep learning application in the medical field will further develop as it has already achieved remarkable results in medical image analysis [66], and more precisely, in image-based cancer detection and diagnosis [67]. This may increase the efficiency and quality of healthcare in the long-run, thus reducing the risk of late-diagnosis of serious diseases. However, as mentioned before, there is still a long way to go before general purpose neural networks will be commercially relevant. Finally, it is expected that artificial intelligence will “rise” through the combination of representation learning and complex reasoning [3].

5. Conclusions

5.1. Research Questions

In the introduction section of this review, three main research questions were investigated:

● How diverse is the application of deep learning in the field of medical diagnosis?

Deep learning methods have a wide application in the medical field. In this case, medical diagnosis is conducted through use-cases of deep learning networks. As mentioned before, these include detection, segmentation, classification, prediction and other. The results of the reviewed studies indicate that deep learning methods can be far superior in comparison to other high-performing algorithms. Therefore, it is safe to assume that deep learning is and will continue to diversify its uses.

● Can deep learning substitute the role of doctors in the future?

The future development of deep learning promises more applications in various fields of medicine, particularly in the domain of medical diagnosis. However, in the current state, it is not evident that deep learning can substitute the role of doctors/clinicians in medical diagnosis. So far, deep learning can provide good support for experts in the medical field.

● Does deep learning have a future or will it become obsolete?

All indicators point towards an even wider use of deep learning in various fields. Deep learning has already found its application in transportation and greenhouse-gas emission control [68], traffic control [69], text classification [8,70], object detection [71], speech detection [72,73], translation [74] and in other fields. These applications were not so represented in the past. Traditional approaches to various similarity measures are ineffective when compared to deep learning [63]. Based on these findings, it can be suggested that deep learning and deep neural networks will prevail, and that they will find many other uses in the near future.

5.2. Limitations and Future Research

The main limitation of this paper is the absence of meta-analysis of quantitative data. However, considering the main goal of this paper, this limitation does not devalue the contribution of the review. For future research, a more categorized review should be conducted. In addition, the development and application of deep learning through defined periods of time could be added. A theoretical introduction to future reviews is also recommended. In this case, the theoretical background did not contain a detailed explanation of how deep neural networks function. However, given the nature of the review, and the target audience (researchers whose domain of expertise is not deep learning focused), such a theoretical approach was not deemed necessary.