Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Federated learning review: : Fundamentals, enabling technologies, and future applications

Published: 01 November 2022 Publication History
  • Get Citation Alerts
  • Abstract

    Federated Learning (FL) has been foundational in improving the performance of a wide range of applications since it was first introduced by Google. Some of the most prominent and commonly used FL-powered applications are Android’s Gboard for predictive text and Google Assistant. FL can be defined as a setting that makes on-device, collaborative Machine Learning possible. A wide range of literature has studied FL technical considerations, frameworks, and limitations with several works presenting a survey of the prominent literature on FL. However, prior surveys have focused on technical considerations and challenges of FL, and there has been a limitation in more recent work that presents a comprehensive overview of the status and future trends of FL in applications and markets. In this survey, we introduce the basic fundamentals of FL, describing its underlying technologies, architectures, system challenges, and privacy-preserving methods. More importantly, the contribution of this work is in scoping a wide variety of FL current applications and future trends in technology and markets today. We present a classification and clustering of literature progress in FL in application to technologies including Artificial Intelligence, Internet of Things, blockchain, Natural Language Processing, autonomous vehicles, and resource allocation, as well as in application to market use cases in domains of Data Science, healthcare, education, and industry. We discuss future open directions and challenges in FL within recommendation engines, autonomous vehicles, IoT, battery management, privacy, fairness, personalization, and the role of FL for governments and public sectors. By presenting a comprehensive review of the status and prospects of FL, this work serves as a reference point for researchers and practitioners to explore FL applications under a wide range of domains.

    Highlights

    Draw the big picture of the fundamental of federated machine learning.
    Presenting the most prominent federated learning applications and shows other potential use cases.
    Provide a range of future applications and directions for the research in the federated machine learning.

    References

    [1]
    Aïvodji U.M., Gambs S., Martin A., IOTFLA : A secured and privacy-preserving smart home architecture implementing federated learning, in: 2019 IEEE security and privacy workshops (SPW), 2019, pp. 175–180.
    [2]
    Al-Laith A., Shahbaz M., Alaskar H.F., Rehmat A., Arasencorpus: A semi-supervised approach for sentiment annotation of a large arabic text corpus, Applied Sciences 11 (5) (2021) 2434.
    [3]
    Alawadi S., Kebande V.R., Dong Y., Bugeja J., Persson J.A., Olsson C.M., A federated interactive learning iot-based health monitoring platform, in: European conference on advances in databases and information systems, Springer, 2021, pp. 235–246.
    [4]
    Aledhari M., Razzak R., Parizi R.M., Saeed F., Federated learning: A survey on enabling technologies, protocols, and applications, IEEE Access 8 (2020) 140699–140725.
    [5]
    Aledhari M., Razzak R., Parizi R.M., Saeed F., Federated learning: A survey on enabling technologies, protocols, and applications, IEEE Access 8 (2020) 140699–140725,.
    [6]
    Ang F., Chen L., Zhao N., Chen Y., Wang W., Yu F.R., Robust federated learning with noisy communication, IEEE Transactions on Communications (2020).
    [7]
    Arrieta A.B., Díaz-Rodríguez N., Del Ser J., Bennetot A., Tabik S., Barbado A., et al., Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI, Information Fusion 58 (2020) 82–115.
    [8]
    Awan S., Li F., Luo B., Liu M., Poster: A reliable and accountable privacy-preserving federated learning framework using the blockchain, in: Proceedings of the 2019 ACM SIGSAC conference on computer and communications security, in: CCS ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 2561–2563,.
    [9]
    Bagheri B., Rezapoor M., Lee J., A unified data security framework for federated prognostics and health management in smart manufacturing, Manufacturing Letters (2020).
    [10]
    Balta D., Sellami M., Kuhn P., Schöpp U., Buchinger M., Baracaldo N., et al., Accountable federated machine learning in government: Engineering and management insights, in: International conference on electronic participation, Springer, 2021, pp. 125–138.
    [11]
    Google AI defeats human Go champion, 2017, URL https://www.bbc.com/news/technology-40042581.
    [12]
    Bengio Y., Courville A., Vincent P., Representation learning: A review and new perspectives, IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (8) (2013) 1798–1828.
    [13]
    Bhagoji A.N., Chakraborty S., Mittal P., Calo S., Chaudhuri K., Salakhutdinov R. (Eds.), Analyzing federated learning through an adversarial lens, in: Proceedings of machine learning research, vol. 97, PMLR, Long Beach, California, USA, 2019, pp. 634–643. URL http://proceedings.mlr.press/v97/bhagoji19a.html.
    [14]
    Bishop C.M., Nasrabadi N.M., Pattern recognition and machine learning, Vol. 4, Springer, 2006.
    [15]
    Blanquer I., Brasileiro F., Brito A., Calatrava A., Carvalho A., Fetzer C., et al., Federated and secure cloud services for building medical image classifiers on an intercontinental infrastructure, Future Generation Computer Systems 110 (2020) 119–134.
    [16]
    Bojarski M., Del Testa D., Dworakowski D., Firner B., Flepp B., Goyal P., et al., End to end learning for self-driving cars, 2016, arXiv preprint arXiv:1604.07316.
    [17]
    Brik B., Ksentini A., Bouaziz M., Federated learning for UAVs-enabled wireless networks: Use cases, challenges, and open problems, IEEE Access 8 (2020) 53841–53849.
    [18]
    Brisimi T.S., Chen R., Mela T., Olshevsky A., Paschalidis I.C., Shi W., Federated learning of predictive models from federated electronic health records, International Journal of Medical Informatics 112 (2018) 59–67.
    [19]
    Cai, L., Lin, D., Zhang, J., & Yu, S. Dynamic sample selection for federated learning with heterogeneous data in fog computing.
    [20]
    Chai Z., Fayyaz H., Fayyaz Z., Anwar A., Zhou Y., Baracaldo N., et al., Towards taming the resource and data heterogeneity in federated learning, in: 2019 USENIX conference on operational machine learning (OpML 19), USENIX Association, Santa Clara, CA, 2019, pp. 19–21. URL https://www.usenix.org/conference/opml19/presentation/chai.
    [21]
    Chan W., Jaitly N., Le Q.V., Vinyals O., Listen, attend and spell, 2015, arXiv preprint arXiv:1508.01211.
    [22]
    Chen Y.-T., Chuang Y.-C., Wu A.-Y.A., Online extreme learning machine design for the application of federated learning, in: 2020 2nd IEEE international conference on artificial intelligence circuits and systems (AICAS), IEEE, 2020, pp. 188–192.
    [23]
    Chen H., Li H., Xu G., Zhang Y., Luo X., Achieving privacy-preserving federated learning with irrelevant updates over E-health applications, in: ICC 2020 - 2020 IEEE international conference on communications (ICC), 2020, pp. 1–6,.
    [24]
    Chen Y., Luo F., Li T., Xiang T., Liu Z., Li J., A training-integrity privacy-preserving federated learning scheme with trusted execution environment, Information Sciences 522 (2020) 69–79,. URL http://www.sciencedirect.com/science/article/pii/S0020025520301201.
    [25]
    Chen Y., Luo F., Li T., Xiang T., Liu Z., Li J., A training-integrity privacy-preserving federated learning scheme with trusted execution environment, Information Sciences 522 (2020) 69–79.
    [26]
    Chen Y., Qin X., Wang J., Yu C., Gao W., Fedhealth: A federated transfer learning framework for wearable healthcare, IEEE Intelligent Systems (2020) 1.
    [27]
    Chen Y., Sun X., Jin Y., Communication-efficient federated deep learning with asynchronous model update and temporally weighted aggregation, 2019, arXiv preprint arXiv:1903.07424.
    [28]
    Chen M., Yang Z., Saad W., Yin C., Poor H.V., Cui S., Performance optimization of federated learning over wireless networks, in: 2019 IEEE global communications conference (GLOBECOM), IEEE, 2019, pp. 1–6.
    [29]
    Conway-Jones D., Tuor T., Wang S., Leung K.K., Demonstration of federated learning in a resource-constrained networked environment, in: 2019 IEEE international conference on smart computing (SMARTCOMP), IEEE, 2019, pp. 484–486.
    [30]
    Deist T.M., Dankers F.J., Ojha P., Marshall] M.S., Janssen T., Faivre-Finn C., et al., Distributed learning on 20 000+ lung cancer patients – The personal health train, Radiotherapy and Oncology 144 (2020) 189–200.
    [31]
    Denny D., Kazim E., Koshiyama A., Treleaven P., Dolga R., Anticorruption techs to face a global economy-federated learning, open data catalogues, and “blockchain”, 2021, Available at SSRN.
    [32]
    Dodge S., Karam L., A study and comparison of human and deep learning recognition performance under visual distortions, in: 2017 26th international conference on computer communication and networks (ICCCN), IEEE, 2017, pp. 1–7.
    [33]
    Doku R., Rawat D.B., Liu C., Towards federated learning approach to determine data relevance in big data, in: 2019 IEEE 20th international conference on information reuse and integration for data science (IRI), IEEE, 2019, pp. 184–192.
    [34]
    Dolui, K., Cuba Gyllensten, I., Lowet, D., Michiels, S., Hallez, H., & Hughes, D. (2019). Towards privacy-preserving mobile applications with federated learning: The case of matrix factorization (poster). In Proceedings of the 17th annual international conference on mobile systems, applications, and services (pp. 624–625).
    [35]
    Dong Y., Chen X., Shen L., Wang D., EaSTFLy: Efficient and secure ternary federated learning, Computers & Security (2020).
    [36]
    Du Z., Wu C., Yoshinaga T., Yau K.A., Ji Y., Li J., Federated learning for vehicular internet of things: Recent advances and open issues, IEEE Open Journal of the Computer Society 1 (2020) 45–61.
    [37]
    Duan M., Liu D., Chen X., Tan Y., Ren J., Qiao L., et al., Astraea: Self-balancing federated learning for improving classification accuracy of mobile deep learning applications, in: 2019 IEEE 37th international conference on computer design (ICCD), IEEE, 2019, pp. 246–254.
    [38]
    Dwork C., Differential privacy: A survey of results, in: International conference on theory and applications of models of computation, Springer, 2008, pp. 1–19.
    [39]
    Elayan H., Aloqaily M., Guizani M., Deep federated learning for IoT-based decentralized healthcare systems, in: 2021 international wireless communications and mobile computing (IWCMC), IEEE, 2021, pp. 105–109.
    [40]
    Elayan H., Aloqaily M., Guizani M., Digital twin for intelligent context-aware IoT healthcare systems, IEEE Internet of Things Journal (2021).
    [41]
    Elayan H., Aloqaily M., Guizani M., Sustainability of healthcare data analysis IoT-based systems using deep federated learning, IEEE Internet of Things Journal (2021).
    [42]
    Encheva S., Tumin S., On improving quality of the decision making process in a federated learning system, in: International conference on cooperative design, visualization and engineering, Springer, 2008, pp. 192–195.
    [43]
    Fang C., Guo Y., Wang N., Ju A., Highly efficient federated learning with strong privacy preservation in cloud computing, Computers & Security (2020).
    [44]
    Feng J., Rong C., Sun F., Guo D., Li Y., Pmf: A privacy-preserving human mobility prediction framework via federated learning, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4 (1) (2020) 1–21.
    [45]
    Feraudo A., Yadav P., Safronov V., Popescu D.A., Mortier R., Wang S., et al., CoLearn: Enabling federated learning in MUD-compliant IoT edge networks, in: Proceedings of the third ACM international workshop on edge systems, analytics and networking, in: EdgeSys ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 25–30,.
    [46]
    Franco N., Van H.M., Dreiser M., Weiss G., Towards a self-adaptive architecture for federated learning of industrial automation systems, in: 2021 international symposium on software engineering for adaptive and self-managing systems (SEAMS), 2021.
    [47]
    Gengler N., Symposium review: Challenges and opportunities for evaluating and using the genetic potential of dairy cattle in the new era of sensor data from automation, Journal of Dairy Science 102 (6) (2019) 5756–5763.
    [48]
    Gentry, C. (2009). Fully homomorphic encryption using ideal lattices. In Proceedings of the forty-first annual ACM symposium on theory of computing (pp. 169–178).
    [49]
    Ghosh A.M., Grolinger K., Edge-cloud computing for internet of things data analytics: Embedding intelligence in the edge with deep learning, IEEE Transactions on Industrial Informatics (2021).
    [50]
    Goecks J., Jalili V., Heiser L.M., Gray J.W., How machine learning will transform biomedicine, Cell 181 (1) (2020) 92–101.
    [51]
    Guo Y., Wang D., Vishwanath A., Xu C., Li Q., Towards federated learning for HVAC analytics: A measurement study, in: Proceedings of the eleventh ACM international conference on future energy systems, in: e-Energy ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 68–73,.
    [52]
    Guo S., Zeng D., Dong S., Pedagogical data analysis via federated learning toward Education 4.0, American Journal of Education and Information Technology 4 (2) (2020) 56.
    [53]
    Gururani S., Lerch A., Semi-supervised audio classification with partially labeled data, in: 2021 IEEE international symposium on multimedia (ISM), IEEE, 2021, pp. 111–114.
    [54]
    Han X., Yu H., Gu H., Visual inspection with federated learning, in: International conference on image analysis and recognition, Springer, 2019, pp. 52–64.
    [55]
    Hänsch R., Hellwich O., Semi-supervised learning for classification of polarimetric SAR-data, in: 2009 IEEE international geoscience and remote sensing symposium, Vol. 3, 2009, pp. III–987–III–990.
    [56]
    Hao M., Li H., Luo X., Xu G., Yang H., Liu S., Efficient and privacy-enhanced federated learning for industrial artificial intelligence, IEEE Transactions on Industrial Informatics (2019).
    [57]
    Hao M., Li H., Xu G., Liu S., Yang H., Towards efficient and privacy-preserving federated deep learning, in: ICC 2019 - 2019 IEEE international conference on communications (ICC), 2019, pp. 1–6.
    [58]
    Hard A., Kiddon C.M., Ramage D., Beaufays F., Eichner H., Rao K., et al., Federated learning for mobile keyboard prediction, 2018, URL https://arxiv.org/abs/1811.03604.
    [59]
    Hilmkil A., Callh S., Barbieri M., Sütfeld L.R., Zec E.L., Mogren O., Scaling federated learning for fine-tuning of large language models, in: International conference on applications of natural language to information systems, 2021, pp. 15–23.
    [60]
    Hsu H.-Y., Srivastava G., Wu H.-T., Chen M.-Y., Remaining useful life prediction based on state assessment using edge computing on deep learning, Computer Communications 160 (2020).
    [61]
    Hu R., Guo Y., Li H., Pei Q., Gong Y., Personalized federated learning with differential privacy, IEEE Internet of Things Journal (2020).
    [62]
    Huang X., Ding Y., Jiang Z.L., Qi S., Wang X., Liao Q., DP-FL: a novel differentially private federated learning framework for the unbalanced data, World Wide Web (2020) 1–17.
    [63]
    Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700–4708).
    [64]
    Huang L., Shea A.L., Qian H., Masurkar A., Deng H., Liu D., Patient clustering improves efficiency of federated machine learning to predict mortality and hospital stay time using distributed electronic medical records, Journal of Biomedical Informatics 99 (2019).
    [65]
    Imteaj A., Amini M.H., Distributed sensing using smart end-user devices: Pathway to federated learning for autonomous IoT, in: 2019 international conference on computational science and computational intelligence (CSCI), 2019, pp. 1156–1161.
    [66]
    Jalalirad A., Scavuzzo M., Capota C., Sprague M., A simple and efficient federated recommender system, in: Proceedings of the 6th IEEE/ACM international conference on big data computing, applications and technologies, in: BDCAT ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 53–58,.
    [67]
    James B.T., Luczak B.B., Girgis H.Z., MeShClust: an intelligent tool for clustering DNA sequences, Nucleic Acids Research 46 (14) (2018) e83.
    [68]
    Jararweh Y., Otoum S., Al Ridhawi I., Trustworthy and sustainable smart city services at the edge, Sustainable Cities and Society 62 (2020).
    [69]
    Kairouz P., McMahan H.B., Avent B., Bellet A., Bennis M., Bhagoji A.N., et al., Advances and open problems in federated learning, Foundations and Trends® in Machine Learning 14 (1–2) (2021) 1–210.
    [70]
    Kharitonov E., Federated online learning to rank with evolution strategies, in: WSDM ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 249–257,.
    [71]
    Kim Y.J., Hong C.S., Blockchain-based node-aware dynamic weighting methods for improving federated learning performance, in: 2019 20th Asia-Pacific network operations and management symposium (APNOMS), IEEE, 2019, pp. 1–4.
    [72]
    Kim H., Park J., Bennis M., Kim S.-L., Blockchained on-device federated learning, IEEE Communications Letters 24 (6) (2019) 1279–1283.
    [73]
    Knight W., Defeated chess champ garry kasparov has made peace with AI, 2020, URL https://www.wired.com/story/defeated-chess-champ-garry-kasparov-made-peace-ai/.
    [74]
    Konečnỳ J., McMahan H.B., Ramage D., Richtárik P., Federated optimization: Distributed machine learning for on-device intelligence, 2016, arXiv preprint arXiv:1610.02527.
    [75]
    Konečný J., McMahan H.B., Yu F.X., Richtárik P., Suresh A.T., Bacon D., Federated learning: Strategies for improving communication efficiency, 2016, CoRR abs/1610.05492. arXiv:1610.05492. URL http://arxiv.org/abs/1610.05492.
    [76]
    Kuai H., Zhong N., The extensible data-brain model: Architecture, applications and directions, Journal of Computer Science (2020).
    [77]
    Kwon D., Jeon J., Park S., Kim J., Cho S., Multi-agent DDPG-based deep learning for smart ocean federated learning IoT networks, IEEE Internet of Things Journal (2020) 1.
    [78]
    Lan Y., Deng H., Chen T., A new method of distance measure for graph-based semi-supervised learning, in: 2011 international conference on machine learning and cybernetics, Vol. 4, 2011, pp. 1444–1448.
    [79]
    Li L., Fan Y., Tse M., Lin K.-Y., A review of applications in federated learning, Computers & Industrial Engineering 149 (2020),. URL http://www.sciencedirect.com/science/article/pii/S0360835220305532.
    [80]
    Li H., Han T., An end-to-end encrypted neural network for gradient updates transmission in federated learning, 2019, arXiv preprint arXiv:1908.08340.
    [81]
    Li T., Sahu A.K., Talwalkar A., Smith V., Federated learning: Challenges, methods, and future directions, IEEE Signal Processing Magazine 37 (3) (2020) 50–60.
    [82]
    Li Z., Sharma V., Mohanty S.P., Preserving data privacy via federated learning: Challenges and solutions, IEEE Consumer Electronics Magazine 9 (3) (2020) 8–16.
    [83]
    Li L., Xiong H., Guo Z., Wang J., Xu C.-Z., SmartPC: Hierarchical pace control in real-time federated learning system, in: 2019 IEEE real-time systems symposium (RTSS), IEEE, 2019, pp. 406–418.
    [84]
    Lim W.Y.B., Luong N.C., Hoang D.T., Jiao Y., Liang Y.-C., Yang Q., et al., Federated learning in mobile edge networks: A comprehensive survey, IEEE Communications Surveys & Tutorials 22 (3) (2020) 2031–2063.
    [85]
    Lin M., Accelerating the translation of artificial intelligence from ideas to routine clinical workflow, Academic Radiology 27 (1) (2020) 121–122. Special Issue: Artificial Intelligence.
    [86]
    Lin B.Y., He C., Zeng Z., Wang H., Huang Y., Soltanolkotabi M., et al., FedNLP: A research platform for federated learning in natural language processing, 2021, arXiv preprint arXiv:2104.08815.
    [87]
    Lin T., Kong L., Stich S.U., Jaggi M., Ensemble distillation for robust model fusion in federated learning, 2020, arXiv preprint arXiv:2006.07242.
    [88]
    Liu W., Chen L., Chen Y., Zhang W., Accelerating federated learning via momentum gradient descent, IEEE Transactions on Parallel and Distributed Systems 31 (8) (2020) 1754–1766.
    [89]
    Liu, L., Hu, Y., Yu, J., Zhang, F., Huang, G., & Xiao, J., et al. (2019). Training encrypted models with privacy-preserved data on blockchain. In Proceedings of the 3rd international conference on vision, image and signal processing (pp. 1–6).
    [90]
    Liu Y., Li H., Xiao J., Jin H., FLoc: Fingerprint-based indoor localization system under a federated learning updating framework, in: 2019 15th international conference on mobile ad-hoc and sensor networks (MSN), IEEE, 2019, pp. 113–118.
    [91]
    Liu X., Li H., Xu G., Lu R., He M., Adaptive privacy-preserving federated learning, Peer-to-Peer Networking and Applications (2020).
    [92]
    Liu Y., Ma Z., Yan Z., Wang Z., Liu X., Ma J., Privacy-preserving federated k-means for proactive caching in next generation cellular networks, Information Sciences 521 (2020) 14–31.
    [93]
    Liu B., Wang L., Liu M., Lifelong federated reinforcement learning: a learning architecture for navigation in cloud robotic systems, IEEE Robotics and Automation Letters 4 (4) (2019) 4555–4562.
    [94]
    Liu F., Wu X., Ge S., Fan W., Zou Y., Federated learning for vision-and-language grounding problems, in: Proceedings of the AAAI conference on artificial intelligence, Vol. 34, 2020, pp. 11572–11579,. (07). URL https://ojs.aaai.org/index.php/AAAI/article/view/6824.
    [95]
    Liu L., Zhang J., Song S., Letaief K.B., Client-edge-cloud hierarchical federated learning, 2019, arXiv preprint arXiv:1905.06641.
    [96]
    Lu Y., Huang X., Dai Y., Maharjan S., Zhang Y., Blockchain and federated learning for privacy-preserved data sharing in industrial IoT, IEEE Transactions on Industrial Informatics 16 (6) (2019) 4177–4186.
    [97]
    Lu Y., Huang X., Dai Y., Maharjan S., Zhang Y., Federated learning for data privacy preservation in vehicular cyber-physical systems, IEEE Network 34 (3) (2020) 50–56.
    [98]
    Lu Y., Huang X., Zhang K., Maharjan S., Zhang Y., Blockchain empowered asynchronous federated learning for secure data sharing in internet of vehicles, IEEE Transactions on Vehicular Technology 69 (4) (2020) 4298–4311.
    [99]
    Lu X., Liao Y., Lió P., Hui P., Privacy-preserving asynchronous federated learning mechanism for edge network computing, IEEE Access 8 (2020) 48970–48981.
    [100]
    Lundervold A.S., Lundervold A., An overview of deep learning in medical imaging focusing on MRI, Zeitschrift für Medizinische Physik 29 (2) (2019) 102–127. Special Issue: Deep Learning in Medical Physics.
    [101]
    Luping W., Wei W., Bo L., Cmfl: Mitigating communication overhead for federated learning, in: 2019 IEEE 39th international conference on distributed computing systems (ICDCS), IEEE, 2019, pp. 954–964.
    [102]
    Ma C., Li J., Ding M., Yang H.H., Shu F., Quek T.Q., et al., On safeguarding privacy and security in the framework of federated learning, IEEE Network (2020).
    [103]
    Ma X., Zhang F., Chen X., Shen J., Privacy preserving multi-party computation delegation for deep learning in cloud computing, Information Sciences 459 (2018) 103–116.
    [104]
    Majeed U., Hong C.S., Flchain: Federated learning via MEC-enabled blockchain network, in: 2019 20th Asia-Pacific network operations and management symposium (APNOMS), IEEE, 2019, pp. 1–4.
    [105]
    Malle B., Giuliani N., Kieseberg P., Holzinger A., The more the merrier-federated learning from local sphere recommendations, in: International cross-domain conference for machine learning and knowledge extraction, Springer, 2017, pp. 367–373.
    [106]
    Martinez I., Francis S., Hafid A.S., Record and reward federated learning contributions with blockchain, in: 2019 international conference on cyber-enabled distributed computing and knowledge discovery (CyberC), IEEE, 2019, pp. 50–57.
    [107]
    Marulli F., Bellini E., Marrone S., A security-oriented architecture for federated learning in cloud environments, in: AINA workshops, 2020.
    [108]
    McMahan B., Ramage D., Federated learning: Collaborative machine learning without centralized training data, Google AI Blog (2017).
    [109]
    McMahan B., Thakurta A., Federated learning with formal differential privacy guarantees, Google AI Blog (2021).
    [110]
    McNally S., Roche J., Caton S., Predicting the price of bitcoin using machine learning, in: 2018 26th Euromicro international conference on parallel, distributed and network-based processing (PDP), IEEE, 2018, pp. 339–343.
    [111]
    Mowla N.I., Tran N.H., Doh I., Chae K., Federated learning-based cognitive detection of jamming attack in flying ad-hoc network, IEEE Access 8 (2020) 4338–4350.
    [112]
    Muniswamaiah M., Agerwala T., Tappert C.C., Federated query processing for big data in data science, in: 2019 IEEE international conference on big data (Big data), 2019, pp. 6145–6147.
    [113]
    Nadiger C., Kumar A., Abdelhak S., Federated reinforcement learning for fast personalization, in: 2019 IEEE second international conference on artificial intelligence and knowledge engineering (AIKE), IEEE, 2019, pp. 123–127.
    [114]
    Nguyen D.C., Pathirana P.N., Ding M., Seneviratne A., Blockchain for 5g and beyond networks: A state of the art survey, 2019, arXiv preprint arXiv:1912.05062.
    [115]
    Nilsson A., Smith S., Ulm G., Gustavsson E., Jirstrand M., A performance evaluation of federated learning algorithms, in: Proceedings of the second workshop on distributed infrastructures for deep learning, in: DIDL ’18, Association for Computing Machinery, New York, NY, USA, 2018, pp. 1–8,.
    [116]
    Nishio T., Yonetani R., Client selection for federated learning with heterogeneous resources in mobile edge, in: ICC 2019-2019 IEEE international conference on communications (ICC), IEEE, 2019, pp. 1–7.
    [117]
    Noble B.D., Satyanarayanan M., Narayanan D., Tilton J.E., Flinn J., Walker K.R., Agile application-aware adaptation for mobility, Operating Systems Review 31 (5) (1997) 276–287.
    [118]
    Nuding, F., & Mayer, R. (2020). Poisoning attacks in federated learning: An evaluation on traffic sign classification. In Proceedings of the tenth ACM conference on data and application security and privacy (pp. 168–170).
    [119]
    What is federated learning, 2020, https://blogs.nvidia.com/blog/2019/10/13/what-is-federated-learning/, Accessed: 2020-12-30.
    [120]
    Oneto L., Chiappa S., Fairness in machine learning, in: Recent trends in learning from data, Springer, 2020, pp. 155–196.
    [121]
    Pahwa K., Agarwal N., Stock market analysis using supervised machine learning, in: 2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon), 2019, pp. 197–200.
    [122]
    Pandey S.R., Tran N.H., Bennis M., Tun Y.K., Manzoor A., Hong C.S., A crowdsourcing framework for on-device federated learning, IEEE Transactions on Wireless Communication 19 (5) (2020) 3241–3256.
    [123]
    Pokhrel S.R., Choi J., Federated learning with blockchain for autonomous vehicles: Analysis and design challenges, IEEE Transactions on Communications (2020).
    [124]
    Pokhrel S.R., Choi J., Improving TCP performance over WiFi for internet of vehicles: A federated learning approach, IEEE Transactions on Vehicular Technology 69 (6) (2020) 6798–6802.
    [125]
    Posner J., Tseng L., Aloqaily M., Jararweh Y., Federated learning in vehicular networks: opportunities and solutions, IEEE Network 35 (2) (2021) 152–159.
    [126]
    Qian Y., Hu L., Chen J., Guan X., Hassan M.M., Alelaiwi A., Privacy-aware service placement for mobile edge computing via federated learning, Information Sciences 505 (2019) 562–570.
    [127]
    Qiang F., Lixin T., Richard L., et al., White paper-IEEE federated machine learning, 2021.
    [128]
    Qu Y., Gao L., Luan T.H., Xiang Y., Yu S., Li B., et al., Decentralized privacy using blockchain-enabled federated learning in fog computing, IEEE Internet of Things Journal (2020).
    [129]
    Renuka D.K., Hamsapriya T., Chakkaravarthi M.R., Surya P.L., Spam classification based on supervised learning using machine learning techniques, in: 2011 international conference on process automation, control and computing, IEEE, 2011, pp. 1–7.
    [130]
    Rey V., Sánchez P.M.S., Celdrán A.H., Bovet G., Federated learning for malware detection in iot devices, Computer Networks 204 (2022).
    [131]
    Samarakoon S., Bennis M., Saad W., Debbah M., Federated learning for ultra-reliable low-latency V2V communications, in: 2018 IEEE global communications conference (GLOBECOM), 2018, pp. 1–7.
    [132]
    Samarakoon S., Bennis M., Saad W., Debbah M., Distributed federated learning for ultra-reliable low-latency vehicular communications, IEEE Transactions on Communications 68 (2) (2019) 1146–1159.
    [133]
    Samarakoon S., Bennis M., Saad W., Debbah M., Distributed federated learning for ultra-reliable low-latency vehicular communications, IEEE Transactions on Communications 68 (2) (2020) 1146–1159.
    [134]
    Saputra Y.M., Hoang D.T., Nguyen D.N., Dutkiewicz E., Mueck M.D., Srikanteswara S., Energy demand prediction with federated learning for electric vehicle networks, in: 2019 IEEE global communications conference (GLOBECOM), 2019, pp. 1–6.
    [135]
    Sarikaya Y., Ercetin O., Regulating workers in federated learning by yardstick competition, in: Proceedings of the 13th EAI international conference on performance evaluation methodologies and tools, in: VALUETOOLS ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 150–155.
    [136]
    Sariyildiz M.B., Cinbis R.G., Ayday E., Key protected classification for collaborative learning, Pattern Recognition (2020).
    [137]
    Sattler F., Wiedemann S., Müller K.-R., Samek W., Robust and communication-efficient federated learning from non-iid data, IEEE Transactions on Neural Networks and Learning Systems (2019).
    [138]
    Savazzi S., Nicoli M., Rampa V., Federated learning with cooperating devices: A consensus approach for massive IoT networks, IEEE Internet of Things Journal 7 (5) (2020) 4641–4654.
    [139]
    Savazzi S., Nicoli M., Rampa V., Kianoush S., Federated learning with mutually cooperating devices: A consensus approach towards server-less model optimization, in: ICASSP 2020-2020 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, 2020, pp. 3937–3941.
    [140]
    Shan N., Cui X., Gao Z., “DRL+ FL”: An intelligent resource allocation model based on deep reinforcement learning for mobile edge computing, Computer Communications (2020).
    [141]
    Sharma P.K., Park J.H., Cho K., Blockchain and federated learning-based distributed computing defence framework for sustainable society, Sustainable Cities and Society (2020).
    [142]
    Shi W., Zhou S., Niu Z., Device scheduling with fast convergence for wireless federated learning, 2019, arXiv preprint arXiv:1911.00856.
    [143]
    Silva S., Gutman B.A., Romero E., Thompson P.M., Altmann A., Lorenzi M., Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data, in: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), 2019, pp. 270–274.
    [144]
    Singh J., Mittal M., Pareek S., Customer behavior prediction using K-means clustering algorithm, in: Optimal inventory control and management techniques, IGI Global, 2016, pp. 256–267.
    [145]
    Singh S.K., Rathore S., Park J.H., Blockiotintelligence: A blockchain-enabled intelligent IoT architecture with artificial intelligence, Future Generation Computer Systems (2019).
    [146]
    Sohn K., Berthelot D., Carlini N., Zhang Z., Zhang H., Raffel C.A., et al., Fixmatch: Simplifying semi-supervised learning with consistency and confidence, Advances in Neural Information Processing Systems 33 (2020) 596–608.
    [147]
    Song T., Tong Y., Wei S., Profit allocation for federated learning, in: 2019 IEEE international conference on big data (Big data), IEEE, 2019, pp. 2577–2586.
    [148]
    Sozinov K., Vlassov V., Girdzijauskas S., Human activity recognition using federated learning, in: 2018 IEEE intl conf on parallel & distributed processing with applications, ubiquitous computing & communications, big data & cloud computing, social computing & networking, sustainable computing & communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom), IEEE, 2018, pp. 1103–1111.
    [149]
    Sprague M.R., Jalalirad A., Scavuzzo M., Capota C., Neun M., Do L., et al., Asynchronous federated learning for geospatial applications, in: Joint European conference on machine learning and knowledge discovery in databases, Springer, 2018, pp. 21–28.
    [150]
    Strangman G.E., Sawyer A., Fabre K.M., Urquieta E., Hury J., Wu J., et al., Deep-space applications for point-of-care technologies, Current Opinion in Biomedical Engineering 11 (2019) 45–50. Biomechanics and Mechanobiology: multiscale modeling • Novel Biomedical Technologies: Medical devices ¿ point of care (LMIC).
    [151]
    Subramanyan, P., Sinha, R., Lebedev, I., Devadas, S., & Seshia, S. A. (2017). A formal foundation for secure remote execution of enclaves. In Proceedings of the 2017 ACM SIGSAC conference on computer and communications security (pp. 2435–2450).
    [152]
    Sun H., Li S., Yu F.R., Qi Q., Wang J., Liao J., Towards communication-efficient federated learning in the internet of things with edge computing, IEEE Internet of Things Journal (2020) 1.
    [153]
    Sun Y., Zhou S., Gündüz D., Energy-aware analog aggregation for federated learning with redundant data, 2019, arXiv preprint arXiv:1911.00188.
    [154]
    Taïk, A., & Cherkaoui, S. Electrical load forecasting using edge computing and federated learning.
    [155]
    Tang S., Zhou W., Chen L., Lai L., Xia J., Fan L., Battery-constrained federated edge learning in UAV-enabled IoT for B5G/6G networks, Physical Communication 47 (2021).
    [156]
    Toyoda K., Zhang A.N., Mechanism design for an incentive-aware blockchain-enabled federated learning platform, in: 2019 IEEE international conference on big data (Big data), IEEE, 2019, pp. 395–403.
    [157]
    Tran N.H., Bao W., Zomaya A., Nguyen M.N.H., Hong C.S., Federated learning over wireless networks: Optimization model design and analysis, in: IEEE INFOCOM 2019 - IEEE conference on computer communications, 2019, pp. 1387–1395.
    [158]
    Tran H.-V., Kaddoum G., Elgala H., Abou-Rjeily C., Kaushal H., Lightwave power transfer for federated learning-based wireless networks, IEEE Communications Letters (2020).
    [159]
    Triastcyn A., Faltings B., Federated learning with Bayesian differential privacy, in: 2019 IEEE international conference on big data (Big data), IEEE, 2019, pp. 2587–2596.
    [160]
    Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., & Zhang, R., et al. (2019). A hybrid approach to privacy-preserving federated learning. In Proceedings of the 12th ACM workshop on artificial intelligence and security (pp. 1–11).
    [161]
    Truex, S., Liu, L., Chow, K.-H., Gursoy, M. E., & Wei, W. (2020). LDP-Fed: federated learning with local differential privacy. In Proceedings of the third ACM international workshop on edge systems, analytics and networking (pp. 61–66).
    [162]
    Tseng L., Yao X., Otoum S., Aloqaily M., Jararweh Y., Blockchain-based database in an IoT environment: challenges, opportunities, and analysis, Cluster Computing 23 (3) (2020) 2151–2165.
    [163]
    van Berlo B., Saeed A., Ozcelebi T., Towards federated unsupervised representation learning, in: Proceedings of the third ACM international workshop on edge systems, analytics and networking, in: EdgeSys ’20, Association for Computing Machinery, New York, NY, USA, 2020, pp. 31–36,.
    [164]
    Verma D., White G., de Mel G., Federated AI for the enterprise: A web services based implementation, in: 2019 IEEE international conference on web services (ICWS), IEEE, 2019, pp. 20–27.
    [165]
    Wang X., Han Y., Wang C., Zhao Q., Chen X., Chen M., In-edge ai: Intelligentizing mobile edge computing, caching and communication by federated learning, IEEE Network 33 (5) (2019) 156–165.
    [166]
    Wang Z., Song M., Zhang Z., Song Y., Wang Q., Qi H., Beyond inferring class representatives: User-level privacy leakage from federated learning, in: IEEE INFOCOM 2019 - IEEE conference on computer communications, 2019, pp. 2512–2520.
    [167]
    Wang Y., Tong Y., Shi D., Federated latent Dirichlet allocation: A local differential privacy based framework, in: AAAI, 2020, pp. 6283–6290.
    [168]
    Wang S., Tuor T., Salonidis T., Leung K.K., Makaya C., He T., et al., Adaptive federated learning in resource constrained edge computing systems, IEEE Journal on Selected Areas in Communications 37 (6) (2019) 1205–1221.
    [169]
    Wang F., Zhang M., Wang X., Ma X., Liu J., Deep learning for edge computing applications: A state-of-the-art survey, IEEE Access 8 (2020) 58322–58336.
    [170]
    Wei K., Li J., Ding M., Ma C., Yang H.H., Farokhi F., et al., Federated learning with differential privacy: Algorithms and performance analysis, IEEE Transactions on Information Forensics and Security 15 (2020) 3454–3469.
    [171]
    Wu Q., He K., Chen X., Personalized federated learning for intelligent IoT applications: A cloud-edge based framework, IEEE Open Journal of the Computer Society 1 (2020) 35–44.
    [172]
    Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., & Ludwig, H. (2019). Hybridalpha: An efficient approach for privacy-preserving federated learning. In Proceedings of the 12th ACM workshop on artificial intelligence and security (pp. 13–23).
    [173]
    Xu G., Li H., Liu S., Yang K., Lin X., VerifyNet: Secure and verifiable federated learning, IEEE Transactions on Information Forensics and Security 15 (2020) 911–926.
    [174]
    Xu, Z., Li, L., & Zou, W. (2019a). Exploring federated learning on battery-powered devices. In Proceedings of the ACM turing celebration conference-China (pp. 1–6).
    [175]
    Xu Z., Li L., Zou W., Exploring federated learning on battery-powered devices, in: Proceedings of the ACM turing celebration conference - China, in: ACM TURC ’19, Association for Computing Machinery, New York, NY, USA, 2019,.
    [176]
    Yan M., Chen B., Feng G., Qin S., Federated cooperation and augmentation for power allocation in decentralized wireless networks, IEEE Access 8 (2020) 48088–48100.
    [177]
    Yang Z., Chen M., Saad W., Hong C.S., Shikh-Bahaei M., Energy efficient federated learning over wireless communication networks, 2019.
    [178]
    Yang Q., Liu Y., Chen T., Tong Y., Federated machine learning: Concept and applications, ACM Transactions on Intelligent Systems and Technology (TIST) 10 (2) (2019) 1–19.
    [179]
    Yang Q., Liu Y., Chen T., Tong Y., Federated machine learning: Concept and applications, ACM Transactions on Intelligent Systems and Technology 10 (2) (2019).
    [180]
    Yang H.H., Liu Z., Quek T.Q., Poor H.V., Scheduling policies for federated learning in wireless networks, IEEE Transactions on Communications 68 (1) (2019) 317–333.
    [181]
    Yang W., Zhang Y., Ye K., Li L., Xu C.-Z., FFD: A federated learning based method for credit card fraud detection, in: International conference on big data, Springer, 2019, pp. 18–32.
    [182]
    Yao A.C.-C., How to generate and exchange secrets, in: 27th annual symposium on foundations of computer science (Sfcs 1986), IEEE, 1986, pp. 162–167.
    [183]
    Yao X., Huang C., Sun L., Two-stream federated learning: Reduce the communication costs, in: 2018 IEEE visual communications and image processing (VCIP), 2018, pp. 1–4.
    [184]
    Yao X., Huang T., Wu C., Zhang R., Sun L., Towards faster and better federated learning: A feature fusion approach, in: 2019 IEEE international conference on image processing (ICIP), IEEE, 2019, pp. 175–179.
    [185]
    Yu H., Liu Z., Liu Y., Chen T., Cong M., Weng X., et al., A sustainable incentive scheme for federated learning, IEEE Intelligent Systems (2020).
    [186]
    Zellinger W., Wieser V., Kumar M., Brunner D., Shepeleva N., Gálvez R., et al., Beyond federated learning: On confidentiality-critical machine learning applications in industry, Procedia Computer Science (2021) 734–743.
    [187]
    Zeng T., Semiari O., Mozaffari M., Chen M., Saad W., Bennis M., Federated learning in the sky: Joint power allocation and scheduling with UAV swarms, 2020, arXiv:2002.08196.
    [188]
    Zhang, X., Fu, A., Wang, H., Zhou, C., & Chen, Z. A Privacy-Preserving and Verifiable Federated Learning Scheme.
    [189]
    Zhang J., Wang J., Zhao Y., Chen B., An efficient federated learning scheme with differential privacy in mobile edge computing, in: International conference on machine learning and intelligent communications, Springer, 2019, pp. 538–550.
    [190]
    Zhao Y., Chen J., Wu D., Teng J., Yu S., Multi-task network anomaly detection using federated learning, in: Proceedings of the tenth international symposium on information and communication technology, in: SoICT 2019, Association for Computing Machinery, New York, NY, USA, 2019, pp. 273–279,.
    [191]
    Zhao Y., Chen J., Zhang J., Wu D., Teng J., Yu S., PDGAN: A novel poisoning defense method in federated learning using generative adversarial network, in: International conference on algorithms and architectures for parallel processing, Springer, 2019, pp. 595–609.
    [192]
    Zhou W., Li Y., Chen S., Ding B., Real-time data processing architecture for multi-robots based on differential federated learning, in: 2018 IEEE smartworld, ubiquitous intelligence computing, advanced trusted computing, scalable computing communications, cloud big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), 2018, pp. 462–471.
    [193]
    Zhou Z., Yang S., Pu L.J., Yu S., CEFL: Online admission control, data scheduling and accuracy tuning for cost-efficient federated learning across edge nodes, IEEE Internet of Things Journal (2020).
    [194]
    Zhu X., Wang J., Hong Z., Xia T., Xiao J., Federated learning of unsegmented Chinese text recognition model, in: 2019 IEEE 31st international conference on tools with artificial intelligence (ICTAI), IEEE, 2019, pp. 1341–1345.
    [195]
    Ziller A., Trask A., Lopardo A., Szymkow B., Wagner B., Bluemke E., et al., Pysyft: A library for easy federated learning, in: Federated learning systems, Springer, 2021, pp. 111–139.
    [196]
    Zou Y., Feng S., Niyato D., Jiao Y., Gong S., Cheng W., Mobile device training strategies in federated learning: An evolutionary game approach, in: 2019 international conference on internet of things (iThings) and IEEE green computing and communications (GreenCom) and IEEE cyber, physical and social computing (CPSCom) and IEEE smart data (SmartData), 2019, pp. 874–879.
    [197]
    Zou Y., Feng S., Xu J., Gong S., Niyato D., Cheng W., Dynamic games in federated learning training service market, in: 2019 IEEE pacific rim conference on communications, computers and signal processing (PACRIM), IEEE, 2019, pp. 1–6.

    Cited By

    View all

    Index Terms

    1. Federated learning review: Fundamentals, enabling technologies, and future applications
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Information Processing and Management: an International Journal
        Information Processing and Management: an International Journal  Volume 59, Issue 6
        Nov 2022
        640 pages

        Publisher

        Pergamon Press, Inc.

        United States

        Publication History

        Published: 01 November 2022

        Author Tags

        1. Federated learning
        2. Decentralized learning
        3. Distributed learning
        4. Machine learning
        5. Mobile edge networks
        6. Data privacy
        7. Data security

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 10 Aug 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Federated learning–based global road damage detectionComputer-Aided Civil and Infrastructure Engineering10.1111/mice.1318639:14(2223-2238)Online publication date: 5-Mar-2024
        • (2024)FedCRMWExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123776249:PCOnline publication date: 17-Jul-2024
        • (2024)A hierarchical federated learning framework for collaborative quality defect inspection in constructionEngineering Applications of Artificial Intelligence10.1016/j.engappai.2024.108218133:PCOnline publication date: 1-Jul-2024
        • (2024)A comprehensive review on federated learning based models for healthcare applicationsArtificial Intelligence in Medicine10.1016/j.artmed.2023.102691146:COnline publication date: 4-Mar-2024
        • (2024)Transforming educational insights: strategic integration of federated learning for enhanced prediction of student learning outcomesThe Journal of Supercomputing10.1007/s11227-024-06087-980:11(16334-16367)Online publication date: 1-Jul-2024
        • (2024)Depression clinical detection model based on social media: a federated deep learning approachThe Journal of Supercomputing10.1007/s11227-023-05754-780:6(7931-7954)Online publication date: 1-Apr-2024
        • (2023)Mobilizing personalized federated learning in infrastructure-less and heterogeneous environments via random walk stochastic ADMMProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3667720(36726-36737)Online publication date: 10-Dec-2023
        • (2023)Intelligent Mobile User Profiling for Maximum PerformanceApplied Computer Systems10.2478/acss-2023-001428:1(148-155)Online publication date: 1-Jun-2023
        • (2023)Using Federated Learning in Anomaly Detection and Analytics on Real-time Streaming Data of HealthcareProceedings of the 2023 7th International Conference on Graphics and Signal Processing10.1145/3606283.3606288(29-34)Online publication date: 23-Jun-2023
        • (2023)A Survey on Edge Intelligence and Lightweight Machine Learning Support for Future Applications and ServicesJournal of Data and Information Quality10.1145/358175915:2(1-30)Online publication date: 25-Jan-2023
        • Show More Cited By

        View Options

        View options

        Get Access

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media