Deep learning: systematic review, models, challenges, and research directions
Pages 23103 - 23124
Abstract
The current development in deep learning is witnessing an exponential transition into automation applications. This automation transition can provide a promising framework for higher performance and lower complexity. This ongoing transition undergoes several rapid changes, resulting in the processing of the data by several studies, while it may lead to time-consuming and costly models. Thus, to address these challenges, several studies have been conducted to investigate deep learning techniques; however, they mostly focused on specific learning approaches, such as supervised deep learning. In addition, these studies did not comprehensively investigate other deep learning techniques, such as deep unsupervised and deep reinforcement learning techniques. Moreover, the majority of these studies neglect to discuss some main methodologies in deep learning, such as transfer learning, federated learning, and online learning. Therefore, motivated by the limitations of the existing studies, this study summarizes the deep learning techniques into supervised, unsupervised, reinforcement, and hybrid learning-based models. In addition to address each category, a brief description of these categories and their models is provided. Some of the critical topics in deep learning, namely, transfer, federated, and online learning models, are explored and discussed in detail. Finally, challenges and future directions are outlined to provide wider outlooks for future researchers.
References
[1]
Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C (2018) A survey on deep transfer learning. In: International conference on artificial neural networks, Springer, Berlin; p 270–279
[2]
Tang B, Chen Z, Hefferman G, Pei S, Wei T, He H, and Yang Q Incorporating intelligence in fog computing for big data analysis in smart cities IEEE Trans Ind Informatics 2017 13 2140-2150
[3]
Talaei Khoei T, Aissou G, Al Shanaileh K, Devabhaktuni V K, and Kaabouch N Supervised deep learning models for detecting GPS spoofing attacks on unmanned aerial vehicles 2023 IEEE international conference on electro information technology (eIT) 2023
[4]
Nguyen TT, Nguyen QVH, Nguyen DT, Nguyen DT, Huynh-The T, Nahavandi S, Nguyen TT, Pham QV, and Nguyen CM Deep learning for deepfakes creation and detection: a survey Comput Vis Image Underst 2022 223 103525
[5]
Dong S, Wang P, and Abbas K A survey on deep learning and its applications Comput Scie Rev 2021 40 100379
[6]
Ni J, Young T, Pandelea V, Xue F, and Cambria E Recent advances in deep learning based dialogue systems: a systematic survey Artif Intell Rev 2022 56 1-101
[7]
Piccialli F, Di Somma V, Giampaolo F, Cuomo S, and Fortino G A survey on deep learning in medicine: why, how and when? Inf Fus 2021 66 111-137
[8]
Schmidhuber J Deep learning in neural networks: an overview Neural Netw 2015 61 85-117
[9]
Hatcher WG and Yu W A survey of deep learning: platforms, applications and emerging research trends IEEE Access 2018 6 24411-24432
[10]
Pouyanfar S, Sadiq S, Yan Y, Tian H, Tao Y, Reyes MP, Shyu ML, Chen SC, and Iyengar SS A survey on deep learning: algorithms, techniques, and applications ACM Comput Surv (CSUR) 2018 51 5 1-36
[11]
Alom MZ et al. A state-of-the-art survey on deep learning theory and architectures Electronics 2019 8 3 292
[12]
Dargan S, Kumar M, Ayyagari MR, and Kumar G A survey of deep learning and its applications: a new paradigm to machine learning Arch of Computat Methods Eng 2020 27 4 1071-1092
[13]
Johnson JM and Khoshgoftaar TM Survey on deep learning with class imbalance J Big Data 2019 6 1 1-54
[14]
Zhang Q, Yang LT, Chen Z, and Li P A survey on deep learning for big data Inf Fus 2018 42 146-157
[15]
Hu X, Chu L, Pei J, Liu W, and Bian J Model complexity of deep learning: a survey Knowl Inf Syst 2021 63 10 2585-2619
[16]
Dubey SR, Singh SK, and Chaudhuri BB Activation functions in deep learning: a comprehensive survey and benchmark Neurocomputing 2022 503 92-108
[17]
Berman D, Buczak A, Chavis J, and Corbett C A survey of deep learning methods for cyber security Information 2019 10 4 122
[18]
Tong K and Wu Y Deep learning-based detection from the perspective of small or tiny objects: a survey Image Vis Comput 2022 123 104471
[19]
Baduge SK, Thilakarathna S, Perera JS, Arashpour M, Sharafi P, Teodosio B, Shringi A, and Mendis P Artificial intelligence and smart vision for building and construction 4.0: machine and deep learning methods and applications Autom Constr 2022 141 104440
[20]
Omitaomu OA and Niu H Artificial intelligence techniques in smart grid: a survey Smart Cities 2021 4 2 548-568
[21]
Akay A and Hess H Deep learning: current and emerging applications in medicine and technology IEEE J Biomed Health Inform 2019 23 3 906-920
[22]
Liu W, Wang Z, Liu X, Zeng N, Liu Y, and Alsaadi FE A survey of deep neural network architectures and their applications Neurocomputing 2017 234 11-26
[23]
Srinidhi CL, Ciga O, and Martel AL Deep neural network models for computational histopathology: a survey Med Image Anal 2021 67 101813
[24]
Kattenborn T, Leitloff J, Schiefer F, and Hinz S Review on convolutional neural networks (CNN) in vegetation remote sensing ISPRS J Photogramm Remote Sens 2021 173 24-49
[25]
Tugrul B, Elfatimi E, and Eryigit R Convolutional neural networks in detection of plant leaf diseases: a review Agriculture 2022 12 8 1192
[26]
Yadav SP, Zaidi S, Mishra A, and Yadav V Survey on machine learning in speech emotion recognition and vision systems using a recurrent neural network (RNN) Arch Computat Methods Eng 2022 29 3 1753-1770
[27]
Mai HT, Lieu QX, Kang J, and Lee J A novel deep unsupervised learning-based framework for optimization of truss structures Eng Comput 2022 39 1-24
[28]
Jiang H, Peng M, Zhong Y, Xie H, Hao Z, Lin J, Ma X, and Hu X A survey on deep learning-based change detection from high-resolution remote sensing images Remote Sens 2022 14 7 1552
[29]
Mousavi SM and Beroza GC Deep-learning seismology Science 2022 377 6607 eabm4470
[30]
Song X, Li J, Cai T, Yang S, Yang T, and Liu C A survey on deep learning based knowledge tracing Knowl-Based Syst 2022 258 110036
[31]
Wang J and Biljecki F Unsupervised machine learning in urban studies: a systematic review of applications Cities 2022 129 103925
[32]
Li Y (2022) Research and application of deep learning in image recognition. In: 2022 IEEE 2nd international conference on power, electronics and computer applications (ICPECA), p 994–999
[33]
Borowiec ML, Dikow RB, Frandsen PB, McKeeken A, Valentini G, and White AE Deep learning as a tool for ecology and evolution Methods Ecol Evol 2022 13 8 1640-1660
[34]
Wang X et al. Deep reinforcement learning: a survey IEEE Trans on Neural Netw Learn Syst 2022
[35]
Pateria S, Subagdja B, Tan AH, and Quek C Hierarchical reinforcement learning: A comprehensive survey ACM Comput Surv (CSUR) 2021 54 5 1-35
[36]
Amroune M Machine learning techniques applied to on-line voltage stability assessment: a review Arch Comput Methods Eng 2019 28 273-287
[37]
Liu S, Shi R, Huang Y, Li X, Li Z, Wang L, Mao D, Liu L, Liao S, Zhang M, et al. A data-driven and data-based framework for online voltage stability assessment using partial mutual information and iterated random forest Energies 2021 14 715
[38]
Ahmad A, Saraswat D, and El Gamal A A survey on using deep learning techniques for plant disease diagnosis and recommendations for development of appropriate tools Smart Agric Technol 2023 3 100083
[39]
Khan A, Khan SH, Saif M, Batool A, Sohail A, and Waleed Khan M A survey of deep learning techniques for the analysis of COVID-19 and their usability for detecting omicron J Exp Theor Artif Intell 2023
[40]
Wang C, Gong L, Wang A, Li X, Hung PCK, and Xuehai Z SOLAR: services-oriented deep learning architectures IEEE Trans Services Comput 2017 14 1 262-273
[41]
Moshayedi AJ, Roy AS, Kolahdooz A, and Shuxin Y Deep learning application pros and cons over algorithm deep learning application pros and cons over algorithm EAI Endorsed Trans AI Robotics 2022 1 1 1-13
[42]
Huang L, Luo R, Liu X, and Hao X Spectral imaging with deep learning Light: Sci Appl 2022 11 1 61
[43]
Bhangale KB and Kothandaraman M Survey of deep learning paradigms for speech processing Wireless Pers Commun 2022 125 2 1913-1949
[44]
Khojaste-Sarakhsi M, Haghighi SS, Ghomi SF, and Marchiori E Deep learning for Alzheimer's disease diagnosis: a survey Artif Intell Med 2022 130 102332
[45]
Fu G, Jin Y, Sun S, Yuan Z, and Butler D The role of deep learning in urban water management: a critical review Water Res 2022 223 118973
[46]
Kim L-W DeepX: deep learning accelerator for restricted Boltzmann machine artificial neural networks IEEE Trans Neural Netw Learn Syst 2018 29 5 1441-1453
[47]
Wang C, Gong L, Yu Q, Li X, Xie Y, and Zhou X DLAU: a scalable deep learning accelerator unit on FPGA IEEE Trans Comput-Aided Design Integr Circuits Syst 2017 36 3 513-517
[48]
Dundar A, Jin J, Martini B, and Culurciello E Embedded streaming deep neural networks accelerator with applications IEEE Trans Neural Netw Learn Syst 2017 28 7 1572-1583
[49]
De Mauro A, Greco M, Grimaldi M, Nobili G (2016) Beyond data scientists: a review of big data skills and job families. In: Proceedings of IFKAD, p 1844–1857
[50]
Lin S-B Generalization and expressivity for deep nets IEEE Trans Neural Netw Learn Syst 2019 30 5 1392-1406
[51]
Gopinath M and Sethuraman SC A comprehensive survey on deep learning based malware detection techniques Comp Sci Rev 2023 47 100529
[52]
Khalifa NE, Loey M, and Mirjalili S A comprehensive survey of recent trends in deep learning for digital images augmentation Artif Intell Rev 2022 55 1-27
[53]
Peng S, Cao L, Zhou Y, Ouyang Z, Yang A, Li X, Jia W, and Yu S A survey on deep learning for textual emotion analysis in social networks Digital Commun Netw 2022 8 5 745-762
[54]
Tao X, Gong X, Zhang X, Yan S, and Adak C Deep learning for unsupervised anomaly localization in industrial images: a survey IEEE Trans Instrum Meas 2022 71 1-21
[55]
Sharifani K and Amini M Machine learning and deep learning: a review of methods and applications World Inf Technol Eng J 2023 10 07 3897-3904
[56]
Li Q, Peng H, Li J, Xia C, Yang R, Sun L, Yu PS, and He L A survey on text classification: from traditional to deep learning ACM Trans Intell Syst Technol (TIST) 2022 13 2 1-41
[57]
Zhou Z, Xiang Y, Hao Xu, Yi Z, Shi Di, and Wang Z A novel transfer learning-based intelligent nonintrusive load-monitoring with limited measurements IEEE Trans Instrum Meas 2021 70 1-8
[58]
Akram MW, Li G, Jin Y, Chen X, Zhu C, and Ahmad A Automatic detection of photovoltaic module defects in infrared images with isolated and develop-model transfer deep learning Sol Energy 2020 198 175-186
[59]
Karimipour H, Dehghantanha A, Parizi RM, Choo K-KR, and Leung H A deep and scalable unsupervised machine learning system for cyber-attack detection in large-scale smart grids IEEE Access 2019 7 80778-80788
[60]
Moonesar IA and Dass R Artificial intelligence in health policy—a global perspective Global J Comput Sci Technol 2021 1 1-7
[61]
Mo Y, Wu Y, Yang X, Liu F, and Liao Y Review the state-of-the-art technologies of semantic segmentation based on deep learning Neurocomputing 2022 493 626-646
[62]
Subramanian N, Elharrouss O, Al-Maadeed S, and Chowdhury M A review of deep learning-based detection methods for COVID-19 Comput Biol Med 2022 143 105233
[63]
Tsuneki M Deep learning models in medical image analysis J Oral Biosci 2022 64 3 312-320
[64]
Pan X, Lin X, Cao D, Zeng X, Yu PS, He L, Nussinov R, and Cheng F Deep learning for drug repurposing: Methods, databases, and applications Wiley Interdiscip Rev: Computat Mol Sci 2022 12 4 e1597
[65]
Novakovsky G, Dexter N, Libbrecht MW, Wasserman WW, and Mostafavi S Obtaining genetics insights from deep learning via explainable artificial intelligence Nat Rev Genet 2023 24 2 125-137
[66]
Fan Y, Tao B, Zheng Y, and Jang S-S A data-driven soft sensor based on multilayer perceptron neural network with a double LASSO approach IEEE Trans Instrum Meas 2020 69 7 3972-3979
[67]
Menghani G Efficient deep learning: a survey on making deep learning models smaller, faster, and better ACM Comput Surv 2023 55 12 1-37
[68]
Mehrish A, Majumder N, Bharadwaj R, Mihalcea R, and Poria S A review of deep learning techniques for speech processing Inf Fus 2023 99 101869
[69]
Mohammed A and Kora R A comprehensive review on ensemble deep learning: opportunities and challenges J King Saud Univ-Comput Inf Sci 2023 35 757-774
[70]
Alzubaidi L, Bai J, Al-Sabaawi A, Santamaría J, Albahri AS, Al-dabbagh BSN, Fadhel MA, Manoufali M, Zhang J, Al-Timemy AH, and Duan Y A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications J Big Data 2023 10 1 46
[71]
Katsogiannis-Meimarakis G and Koutrika G A survey on deep learning approaches for text-to-SQL The VLDB J 2023
[72]
Soori M, Arezoo B, and Dastres R Artificial intelligence, machine learning and deep learning in advanced robotics a review Cognitive Robotics 2023 3 57-70
[73]
Mijwil M, Salem IE, and Ismaeel MM The significance of machine learning and deep learning techniques in cybersecurity: a comprehensive review Iraqi J Comput Sci Math 2023 4 1 87-101
[74]
de Oliveira RA and Bollen MH Deep learning for power quality Electr Power Syst Res 2023 214 108887
[75]
Yin L, Gao Qi, Zhao L, Zhang B, Wang T, Li S, and Liu H A review of machine learning for new generation smart dispatch in power systems Eng Appl Artif Intell 2020 88 103372
[76]
Luong NC et al. (2019) Applications of deep reinforcement learning in communications and networking: a survey. In: IEEE communications surveys & tutorials, vol 21, no 4, p 3133–3174,
[77]
Kiran BR et al. Deep reinforcement learning for autonomous driving: a survey IEEE Trans Intell Transp Syst 2022 23 6 4909-4926
[78]
Arulkumaran K, Deisenroth MP, Brundage M, and Bharath AA Deep Reinforcement Learning: A Brief Survey IEEE Signal Process Mag 2017 34 6 26-38
[79]
Levine S, Kumar A, Tucker G, Fu J (2020) Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv preprint arXiv:2005.01643
[80]
Vinuesa R, Azizpour H, Leite I, Balaam M, Dignum V, Domisch S, Felländer A, Langhans SD, Tegmark M, and Nerini FF The role of artificial intelligence in achieving the sustainable development goals Nature Commun 2020
[81]
Khoei TT, Kaabouch N (2023) ACapsule Q-learning based reinforcement model for intrusion detection system on smart grid. In: 2023 IEEE international conference on electro information technology (eIT), Romeoville, IL, USA, pp 333–339.
[82]
Hoi SC, Sahoo D, Lu J, and Zhao P Online learning: a comprehensive survey Neurocomputing 2021 459 249-289
[83]
Celard P, Iglesias EL, Sorribes-Fdez JM, Romero R, Vieira AS, and Borrajo L A survey on deep learning applied to medical images: from simple artificial neural networks to generative models Neural Comput Appl 2023 35 3 2291-2323
[84]
Mohammad-Rahimi H, Rokhshad R, Bencharit S, Krois J, and Schwendicke F Deep learning: a primer for dentists and dental researchers J Dent 2023 130 104430
[85]
Liu Z, Tong L, Chen L, Jiang Z, Zhou F, Zhang Q, Zhang X, Jin Y, and Zhou H Deep learning based brain tumor segmentation: a survey Complex Intell Syst 2023 9 1 1001-1026
[86]
Zheng Y, Xu Z, and Xiao A Deep learning in economics: a systematic and critical review Artif Intell Rev 2023 4 1-43
[87]
Jia T, Kapelan Z, de Vries R, Vriend P, Peereboom EC, Okkerman I, and Taormina R Deep learning for detecting macroplastic litter in water bodies: a review Water Res 2023 231 119632
[88]
Newbury R, Gu M, Chumbley L, Mousavian A, Eppner C, Leitner J, Bohg J, Morales A, Asfour T, Kragic D, and Fox D Deep learning approaches to grasp synthesis: a review IEEE Trans Robotics 2023
[89]
Shafay M, Ahmad RW, Salah K, Yaqoob I, Jayaraman R, and Omar M Blockchain for deep learning: review and open challenges Clust Comput 2023 26 1 197-221
[90]
Benczúr AA., Kocsis L, Pálovics R (2018) Online machine learning in big data streams. arXiv preprint arXiv:1802.05872
[91]
Shalev-Shwartz S Online learning and online convex optimization Found Trends® Mach Learn 2011 4 2 107-194
[92]
Millán Giraldo M and Sánchez Garreta JS A comparative study of simple online learning strategies for streaming data WSEAS Trans Circuits Syst 2008 7 10 900-910
[93]
Pinto G, Wang Z, Roy A, Hong T, and Capozzoli A Transfer learning for smart buildings: a critical review of algorithms, applications, and future perspectives Adv Appl Energy 2022 5 100084
[94]
Sayed AN, Himeur Y, and Bensaali F Deep and transfer learning for building occupancy detection: a review and comparative analysis Eng Appl Artif Intell 2022 115 105254
[95]
Li C, Zhang S, Qin Y, and Estupinan E A systematic review of deep transfer learning for machinery fault diagnosis Neurocomputing 2020 407 121-135
[96]
Li W, Huang R, Li J, Liao Y, Chen Z, He G, Yan R, and Gryllias K A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: theories, applications and challenges Mech Syst Signal Process 2022 167 108487
[97]
Wan Z, Yang R, Huang M, Zeng N, and Liu X A review on transfer learning in EEG signal analysis Neurocomputing 2021 421 1-14
[98]
Tan C, Sun F, Kong T (2018) A survey on deep transfer learning.In: Proceedings of international conference on artificial neural networks. p 270–279
[99]
Qian F, Gao W, Yang Y, Yu D, et al. Potential analysis of the transfer learning model in short and medium-term forecasting of building HVAC energy consumption Energy 2020 193 116724
[100]
Weber M, Doblander C, Mandl P, (2020b). Towards the detection of building occupancy with synthetic environmental data. arXiv preprint arXiv:2010.04209
[101]
Zhu H, Xu J, Liu S, and Jin Y Federated learning on non-IID data: a survey Neurocomputing 2021 465 371-390
[102]
Ouadrhiri AE and Abdelhadi A Differential privacy for deep and federated learning: a survey IEEE Access 2022 10 22359-22380
[103]
Zhang C, Xie Y, Bai H, Yu B, Li W, and Gao Y A survey on federated learning Knowl-Based Syst 2021 216 106775
[104]
Banabilah S, Aloqaily M, Alsayed E, Malik N, and Jararweh Y Federated learning review: fundamentals, enabling technologies, and future applications Inf Process Manag 2022 59 6 103061
[105]
Mothukuri V, Parizi RM, Pouriyeh S, Huang Y, Dehghantanha A, and Srivastava G A survey on security and privacy of federated learning Futur Gener Comput Syst 2021 115 619-640
[106]
McMahan HB, Moore E, Ramage D, Hampson S, Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Proceedings of the 20th international conference on artificial intelligence and statistics, AISTATS
[107]
Hardy S, Henecka W, Ivey-Law H, Nock R, Patrini G, Smith G, Thorne B (2017) Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv preprint arXiv:1711.10677
[108]
Chen T, He T, Benesty M, Khotilovich V, Tang Y, Cho H, et al. Xgboost: extreme gradient boosting R Package Vers 2015 1 4-2
[109]
Heng K, Fan T, Jin Y, Liu Y, Chen T, Yang Q (2019) Secureboost: a lossless federated learning framework. arXiv preprint arXiv:1901.08755
[110]
Konečný J, McMahan HB, Yu FX, Richtárik P, Suresh AT, Bacon D (2016) Federated learning: strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492
[111]
Hamedani L, Liu R, Atat J, and Wu Y Reservoir computing meets smart grids: attack detection using delayed feedback networks IEEE Trans Industr Inf 2017 14 2 734-743
[112]
Yuan X, Xie L, and Abouelenien M A regularized ensemble framework of deep learning for cancer detection from multi-class, imbalanced training data Pattern Recogn 2018 77 160-172
[113]
Xiao B, Xiong J, Shi Y (2016) Novel applications of deep learning hidden features for adaptive testing. In: Proceedings of the 21st Asia and South Pacifc design automation conference, p 743–748
[114]
Zhong SH, Li Y, and Le B Query oriented unsupervised multi document summarization via deep learning Expert Syst Appl 2015 42 1-10
[115]
Vincent P et al. Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion J Mach Learn Res 2010 11 3371-3408
[116]
Alom MZ et al. (2017) Object recognition using cellular simultaneous recurrent networks and convolutional neural network. In: Neural networks (IJCNN), international joint conference on IEEE
[117]
Quang W, Stokes JW (2016) MtNet: a multi-task neural network for dynamic malware classification. in: proceedings of the international conference detection of intrusions and malware, and vulnerability assessment, Donostia-San Sebastián, Spain, 7–8 July, p 399–418
[118]
Kamilaris A and Prenafeta-Boldú FX Deep learning in agriculture: a survey Comput Electron Agric 2018 147 70-90
[119]
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Van Der Laak JA, Van Ginneken B, and Sánchez CI A survey on deep learning in medical image analysis Med Image Anal 2017 42 60-88
[120]
Gheisari M, Ebrahimzadeh F, Rahimi M, Moazzamigodarzi M, Liu Y, Dutta Pramanik PK, Heravi MA, Mehbodniya A, Ghaderzadeh M, Feylizadeh MR, and Kosari S Deep learning: applications, architectures, models, tools, and frameworks: a comprehensive survey CAAI Trans Intell Technol 2023
[121]
Pichler M and Hartig F Machine learning and deep learning—a review for ecologists Methods Ecol Evolut 2023 14 4 994-1016
[122]
Wang N, Chen T, Liu S, Wang R, Karimi HR, and Lin Y Deep learning-based visual detection of marine organisms: a survey Neurocomputing 2023 532 1-32
[123]
Lee M The geometry of feature space in deep learning models: a holistic perspective and comprehensive review Mathematics 2023 11 10 2375
[124]
Xu M, Yoon S, Fuentes A, and Park DS A comprehensive survey of image augmentation techniques for deep learning Pattern Recogn 2023 137 109347
[125]
Minaee S, Abdolrashidi A, Su H, Bennamoun M, and Zhang D Biometrics recognition using deep learning: a survey Artif Intell Rev 2023 56 1-49
[126]
Xiang H, Zou Q, Nawaz MA, Huang X, Zhang F, and Yu H Deep learning for image inpainting: a survey Pattern Recogn 2023 134 109046
[127]
Chakraborty S and Mali K An overview of biomedical image analysis from the deep learning perspective Research anthology on improving medical imaging techniques for analysis and intervention 2022 Hershey IGI Global 43-59
[128]
Lestari, N.I., Hussain, W., Merigo, J.M. and Bekhit, M., 2023, January. A Survey of Trendy Financial Sector Applications of Machine and Deep Learning. In: Application of big data, blockchain, and internet of things for education informatization: second EAI international conference, BigIoT-EDU 2022, Virtual Event, July 29–31, 2022, Proceedings, Part III, Springer Nature, Cham, p. 619–633
[129]
Chaddad A, Peng J, Xu J, and Bouridane A Survey of explainable AI techniques in healthcare Sensors 2023 23 2 634
[130]
Grumiaux PA, Kitić S, Girin L, and Guérin A A survey of sound source localization with deep learning methods J Acoust Soc Am 2022 152 1 107-151
[131]
Zaidi SSA, Ansari MS, Aslam A, Kanwal N, Asghar M, and Lee B A survey of modern deep learning based object detection models Digital Signal Process 2022 126 103514
[132]
Dong J, Zhao M, Liu Y, Su Y, and Zeng X Deep learning in retrosynthesis planning: datasets, models and tools Brief Bioinf 2022 23 1 391
[133]
Zhan ZH, Li JY, and Zhang J Evolutionary deep learning: a survey Neurocomputing 2022 483 42-58
[134]
Matsubara Y, Levorato M, and Restuccia F Split computing and early exiting for deep learning applications: survey and research challenges ACM Comput Surv 2022 55 5 1-30
[135]
Zhang B, Rong Y, Yong R, Qin D, Li M, Zou G, and Pan J Deep learning for air pollutant concentration prediction: a review Atmos Environ 2022 290 119347
[136]
Yu X, Zhou Q, Wang S, and Zhang YD A systematic survey of deep learning in breast cancer Int J Intell Syst 2022 37 1 152-216
[137]
Behrad F and Abadeh MS An overview of deep learning methods for multimodal medical data mining Expert Syst Appl 2022 200
[138]
Mittal S, Srivastava S, and Jayanth JP A survey of deep learning techniques for underwater image classification IEEE Trans Neural Netw Learn Syst 2022
[139]
Tercan H and Meisen T Machine learning and deep learning based predictive quality in manufacturing: a systematic review J Intell Manuf 2022 33 7 1879-1905
[140]
Stefanini M, Cornia M, Baraldi L, Cascianelli S, Fiameni G, and Cucchiara R From show to tell: a survey on deep learning-based image captioning IEEE Trans Pattern Anal Mach Intell 2022 45 1 539-559
[141]
Caldas S, Konečný J, McMahan HB, Talwalkar A (2018) Expanding the reach of federated learning by reducing client resource requirements. arXiv preprint arXiv:1812.07210
[142]
Chen Y, Sun X, and Jin Y Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation IEEE Trans Neural Netw Learn Syst 2019 31 4229-4238
[143]
Zhu H and Jin Y Multi-objective evolutionary federated learning IEEE Trans Neural Netw Learn Syst 2019 31 1310-1322
Recommendations
Deep learning in neural networks
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. ...
Deep learning, reinforcement learning, and world models
AbstractDeep learning (DL) and reinforcement learning (RL) methods seem to be a part of indispensable factors to achieve human-level or super-human AI systems. On the other hand, both DL and RL have strong connections with our brain functions ...
Deep Learning: Methods and Applications
This monograph provides an overview of general deep learning methodology and its applications to a variety of signal and information processing tasks. The application areas are chosen with the following three criteria in mind: (1) expertise or knowledge ...
Comments
Information & Contributors
Information
Published In
© The Author(s) 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 07 September 2023
Accepted: 15 August 2023
Received: 31 May 2023
Author Tags
Qualifiers
- Review-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in