Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3485730.3485946acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

FedDL: Federated Learning via Dynamic Layer Sharing for Human Activity Recognition

Published: 15 November 2021 Publication History
  • Get Citation Alerts
  • Abstract

    Deep learning has been increasingly applied to improve human activity recognition (HAR) accuracy and reduce the human efforts of handcrafted feature extractions. Federated Learning (FL) is an emerging learning paradigm that enables the collaborative learning of a global model without exposing users' raw data. However, existing FL approaches yield unsatisfactory HAR performance as they fail to dynamically aggregate models according to the statistical diversity of users' data. In this paper, we propose FedDL, a novel federated learning system for HAR that can capture the underlying user relationships and apply them to learn personalized models for different users dynamically. Specifically, we design a dynamic layer sharing scheme that learns the similarity among users' model weights to form the sharing structure and merges models accordingly in an iterative, bottom-up layer-wise manner. FedDL merges local models based on the dynamic sharing scheme, significantly speeding up the convergence while maintaining high accuracy. We have implemented FedDL and evaluated using a new data set we collected using LiDAR and four public real-world datasets involving 178 users in total. The results show that FedDL outperforms several state-of-the-art FL paradigms in terms of model accuracy (by more than 15%), converging rate (by more than 70%), and communication overhead (about 30% reduction). Moreover, the testing results on the datasets of different scales show that FedDL has high scalability and hence can be deployed for large-scale real-world applications.

    References

    [1]
    2021. Federated learning datasets for human activity recognition. https://github.com/xmouyang/FL-Datasets-for-HAR/tree/main/datasets
    [2]
    Karim T Abou-Moustafa and Frank P Ferrie. 2012. A note on metric properties for some divergence measures: The Gaussian case. In Asian Conference on Machine Learning. PMLR, 1--15.
    [3]
    Khan Alam, Salman Qureshi, and Thomas Blaschke. 2011. Monitoring spatio-temporal aerosol patterns over Pakistan based on MODIS, TOMS and MISR satellite data and a HYSPLIT model. Atmospheric environment 45, 27 (2011), 4641--4651.
    [4]
    Elie Aljalbout, Vladimir Golkov, Yawar Siddiqui, Maximilian Strobel, and Daniel Cremers. 2018. Clustering with deep learning: Taxonomy and new methods. arXiv preprint arXiv:1801.07648 (2018).
    [5]
    Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra, and Jorge L Reyes-Ortiz. 2012. Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine. In International workshop on ambient assisted living. Springer, 216--223.
    [6]
    Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra, and Jorge Luis Reyes-Ortiz. 2013. A public domain dataset for human activity recognition using smartphones. In Esann, Vol. 3. 3.
    [7]
    Manoj Ghuhan Arivazhagan, Vinay Aggarwal, Aaditya Kumar Singh, and Sunav Choudhary. 2019. Federated learning with personalization layers. arXiv preprint arXiv:1912.00818 (2019).
    [8]
    Csaba Benedek, Bence Gálai, Balázs Nagy, and Zsolt Jankó. 2016. Lidar-based gait analysis and activity recognition in a 4d surveillance system. IEEE Transactions on Circuits and Systems for Video Technology 28, 1 (2016), 101--113.
    [9]
    Sourav Bhattacharya and Nicholas D Lane. 2016. From smart to deep: Robust activity recognition on smartwatches using deep learning. In 2016 IEEE International conference on pervasive computing and communication workshops (PerCom Workshops). IEEE, 1--6.
    [10]
    Chongguang Bi, Guoliang Xing, Tian Hao, Jina Huh, Wei Peng, and Mengyan Ma. 2017. Familylog: A mobile system for monitoring family mealtime activities. In 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 21--30.
    [11]
    Keith Bonawitz, Hubert Eichner, Wolfgang Grieskamp, Dzmitry Huba, Alex Ingerman, Vladimir Ivanov, Chloe Kiddon, Jakub Konečny, Stefano Mazzocchi, H Brendan McMahan, et al. 2019. Towards federated learning at scale: System design. arXiv preprint arXiv 1902.01046 (2019).
    [12]
    Liang Cao, Yufeng Wang, Bo Zhang, Qun Jin, and Athanasios V Vasilakos. 2018. GCHAR: An efficient Group-based Context---Aware human activity recognition on smartphone. J. Parallel and Distrib. Comput. 118 (2018), 67--80.
    [13]
    Rich Caruana. 1997. Multitask learning. Machine learning 28, 1 (1997), 41--75.
    [14]
    Yuyang Deng, Mohammad Mahdi Kamani, and Mehrdad Mahdavi. 2020. Adaptive personalized federated learning. arXiv preprint arXiv:2003.13461 (2020).
    [15]
    Mariella Dimiccoli, Juan Marín, and Edison Thomaz. 2018. Mitigating bystander privacy concerns in egocentric activity recognition with deep learning and intentional image degradation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1--18.
    [16]
    Shuya Ding, Zhe Chen, Tianyue Zheng, and Jun Luo. 2020. RF-net: a unified meta-learning framework for RF-enabled one-shot human activity recognition. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 517--530.
    [17]
    Canh T Dinh, Nguyen H Tran, and Tuan Dung Nguyen. 2020. Personalized federated learning with Moreau envelopes. arXiv preprint arXiv:2006.08848 (2020).
    [18]
    Yegang Du, Yuto Lim, and Yasuo Tan. 2019. A novel human activity recognition and prediction in smart home based on interaction. Sensors 19, 20 (2019), 4474.
    [19]
    Theodoros Evgeniou, Charles A Micchelli, Massimiliano Pontil, and John Shawe-Taylor. 2005. Learning multiple tasks with kernel methods. Journal of machine learning research 6, 4 (2005).
    [20]
    Alireza Fallah, Aryan Mokhtari, and Asuman Ozdaglar. 2020. Personalized federated learning: A meta-learning approach. arXiv preprint arXiv:2002.07948 (2020).
    [21]
    Gene Glass and Kenneth Hopkins. 1996. Statistical methods in education and psychology. Psyccritiques 41, 12 (1996).
    [22]
    Yu Guan and Thomas Plötz. 2017. Ensembles of deep lstm learners for activity recognition using wearables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 1--28.
    [23]
    Farzin Haddadpour, Mohammad Mahdi Kamani, Aryan Mokhtari, and Mehrdad Mahdavi. 2021. Federated learning with compression: Unified analysis and sharp guarantees. In International Conference on Artificial Intelligence and Statistics. PMLR, 2350--2358.
    [24]
    Nils Y Hammerla, Shane Halloran, and Thomas Plötz. 2016. Deep, convolutional, and recurrent models for human activity recognition using wearables. arXiv preprint arXiv:1604.08880 (2016).
    [25]
    Mohammed Mehedi Hassan, Md Zia Uddin, Amr Mohamed, and Ahmad Almogren. 2018. A robust human activity recognition system using smartphone sensors and deep learning. Future Generation Computer Systems 81 (2018), 307--313.
    [26]
    Andrey Ignatov. 2018. Real-time human activity recognition from accelerometer data using Convolutional Neural Networks. Applied Soft Computing 62 (2018), 915--922.
    [27]
    Laurent Jacob, Francis Bach, and Jean-Philippe Vert. 2008. Clustered multi-task learning: A convex formulation. arXiv preprint arXiv:0809.2085 (2008).
    [28]
    Martin Jaggi, Virginia Smith, Martin Takáč, Jonathan Terhorst, Sanjay Krishnan, Thomas Hofmann, and Michael I Jordan. 2014. Communication-efficient distributed dual coordinate ascent. arXiv preprint arXiv:1409.1458 (2014).
    [29]
    Ahmad Jalal and Shaharyar Kamal. 2014. Real-time life logging via a depth silhouette-based human activity recognition system for smart home services. In 2014 11th IEEE International conference on advanced video and signal based surveillance (AVSS). IEEE, 74--80.
    [30]
    Ahmad Jalal, Md Zia Uddin, and T-S Kim. 2012. Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home. IEEE Transactions on Consumer Electronics 58, 3 (2012), 863--871.
    [31]
    Yanjun Jia. 2009. Diatetic and exercise therapy against diabetes mellitus. In 2009 Second International Conference on Intelligent Networks and Intelligent Systems. IEEE, 693--696.
    [32]
    Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shuochao Yao, Yaqing Wang, Ye Yuan, Hongfei Xue, Chen Song, Xin Ma, Dimitrios Koutsonikolas, et al. 2018. Towards environment independent device free human activity recognition. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 289--304.
    [33]
    Yihan Jiang, Jakub Konečny, Keith Rush, and Sreeram Kannan. 2019. Improving federated learning personalization via model agnostic meta learning. arXiv preprint arXiv:1909.12488 (2019).
    [34]
    Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Kallista Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al. 2019. Advances and open problems in federated learning. arXiv preprint arXiv:1912.04977 (2019).
    [35]
    Md Abdullah Al Hafiz Khan, Nirmalya Roy, and Archan Misra. 2018. Scaling human activity recognition via deep learning-based domain adaptation. In 2018 IEEE international conference on pervasive computing and communications (PerCom). IEEE, 1--9.
    [36]
    Jakub Konečny, H Brendan McMahan, Felix X Yu, Peter Richtárik, Ananda Theertha Suresh, and Dave Bacon. 2016. Federated learning: Strategies for improving communication efficiency. arXiv preprint arXiv:1610.05492 (2016).
    [37]
    Nicholas D Lane, Ye Xu, Hong Lu, Shaohan Hu, Tanzeem Choudhury, Andrew T Campbell, and Feng Zhao. 2011. Enabling large-scale human activity inference on smartphones using community similarity networks (csn). In Proceedings of the 13th international conference on Ubiquitous computing. 355--364.
    [38]
    Jia Li, Yu Rong, Helen Meng, Zhihui Lu, Timothy Kwok, and Hong Cheng. 2018. TATC: predicting Alzheimer's disease with actigraphy data. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 509--518.
    [39]
    Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, and Zhihua Zhang. 2019. On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189 (2019).
    [40]
    Zheng Liu, Fu Zhang, and Xiaoping Hong. 2021. Low-cost retina-like robotic lidars based on incommensurable scanning. IEEE/ASME Transactions on Mechatronics (2021).
    [41]
    Mingsheng Long, Yue Cao, Zhangjie Cao, Jianmin Wang, and Michael I Jordan. 2018. Transferable representation learning with deep adaptation networks. IEEE transactions on pattern analysis and machine intelligence 41, 12 (2018), 3071--3085.
    [42]
    Mingsheng Long, Zhangjie Cao, Jianmin Wang, and Philip S Yu. 2015. Learning multiple tasks with multilinear relationship networks. arXiv preprint arXiv:1506.02117 (2015).
    [43]
    Yongxi Lu, Abhishek Kumar, Shuangfei Zhai, Yu Cheng, Tara Javidi, and Rogerio Feris. 2017. Fully-adaptive feature sharing in multi-task networks with applications in person attribute classification. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5334--5343.
    [44]
    Yishay Mansour, Mehryar Mohri, Jae Ro, and Ananda Theertha Suresh. 2020. Three approaches for personalization with applications to federated learning. arXiv preprint arXiv:2002.10619 (2020).
    [45]
    Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial Intelligence and Statistics. PMLR, 1273--1282.
    [46]
    H. B. McMahan and D. Ramage. 2017. (2017). http://dx.doi.org/10.1007/s00779-014-0773-4
    [47]
    Wanli Min and Laura Wynter. 2011. Real-time road traffic prediction with spatio-temporal correlations. Transportation Research Part C: Emerging Technologies 19, 4 (2011), 606--616.
    [48]
    Ishan Misra, Abhinav Shrivastava, Abhinav Gupta, and Martial Hebert. 2016. Cross-stitch networks for multi-task learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3994--4003.
    [49]
    Mirco Moencks, Varuna De Silva, Jamie Roche, and Ahmet Kondoz. 2019. Adaptive feature processing for robust human activity recognition on a novel multi-modal dataset. arXiv preprint arXiv:1901.02858 (2019).
    [50]
    Lili Mou, Zhao Meng, Rui Yan, Ge Li, Yan Xu, Lu Zhang, and Zhi Jin. 2016. How transferable are neural networks in nlp applications? arXiv preprint arXiv:1603.06111 (2016).
    [51]
    Adrian Nilsson, Simon Smith, Gregor Ulm, Emil Gustavsson, and Mats Jirstrand. 2018. A performance evaluation of federated learning algorithms. In Proceedings of the Second Workshop on Distributed Infrastructures for Deep Learning. 1--8.
    [52]
    Xiaomin Ouyang, Zhiyuan Xie, Jiayu Zhou, Jianwei Huang, and Guoliang Xing. 2021. ClusterFL: a similarity-aware federated learning system for human activity recognition. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services. 54--66.
    [53]
    Liangying Peng, Ling Chen, Zhenan Ye, and Yi Zhang. 2018. Aroma: A deep multi-task learning based simple and complex human activity recognition method using wearable sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--16.
    [54]
    Valentin Radu, Nicholas D Lane, Sourav Bhattacharya, Cecilia Mascolo, Mahesh K Marina, and Fahim Kawsar. 2016. Towards multimodal deep learning for activity recognition on mobile devices. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. 185--188.
    [55]
    Daniele Riboni and Claudio Bettini. 2011. COSAR: hybrid reasoning for context-aware activity recognition. Personal and Ubiquitous Computing 15, 3 (2011), 271--289.
    [56]
    Daniel Jorge Loureiro Fidalgo do Vale Rodrigues. 2019. Risk Assessment for Alzheimer Patients, using GPS and Accelerometers with a Machine Learning Approach. Ph.D. Dissertation.
    [57]
    Charissa Ann Ronao and Sung-Bae Cho. 2016. Human activity recognition with smartphone sensors using deep learning neural networks. Expert systems with applications 59 (2016), 235--244.
    [58]
    Patrice C Roy, Sylvain Giroux, Bruno Bouchard, Abdenour Bouzouane, Clifton Phua, Andrei Tolstikov, and Jit Biswas. 2011. A possibilistic approach for activity recognition in smart homes for cognitive assistance to Alzheimer's patients. In Activity Recognition in Pervasive Intelligent Environments. Springer, 33--58.
    [59]
    Sebastian Ruder. 2017. An overview of multi-task learning in deep neural networks. arXiv preprint arXiv:1706.05098 (2017).
    [60]
    Felix Sattler, Simon Wiedemann, Klaus-Robert Müller, and Wojciech Samek. 2019. Robust and communication-efficient federated learning from non-iid data. IEEE transactions on neural networks and learning systems (2019).
    [61]
    Virginia Smith, Chao-Kai Chiang, Maziar Sanjabi, and Ameet S Talwalkar. 2017. Federated multi-task learning. In Advances in Neural Information Processing Systems. 4424--4434.
    [62]
    Konstantin Sozinov, Vladimir Vlassov, and Sarunas Girdzijauskas. 2018. Human activity recognition using federated learning. In 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom). IEEE, 1103--1111.
    [63]
    Arijit Ukil, Soma Bandyoapdhyay, Chetanya Puri, and Arpan Pal. 2016. IoT healthcare analytics: The importance of anomaly detection. In 2016 IEEE 30th international conference on advanced information networking and applications (AINA). IEEE, 994--997.
    [64]
    Kang Wei, Jun Li, Ming Ding, Chuan Ma, Howard H Yang, Farhad Farokhi, Shi Jin, Tony QS Quek, and H Vincent Poor. 2020. Federated learning with differential privacy: Algorithms and performance analysis. IEEE Transactions on Information Forensics and Security 15 (2020), 3454--3469.
    [65]
    Liyang Xie, Inci M Baytas, Kaixiang Lin, and Jiayu Zhou. 2017. Privacy-preserving distributed multi-task learning with asynchronous updates. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1195--1204.
    [66]
    Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. 2019. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST) 10, 2 (2019), 1--19.
    [67]
    Jie Yin, Qiang Yang, and Jeffrey Junfeng Pan. 2008. Sensor-based abnormal human-activity detection. IEEE Transactions on Knowledge and Data Engineering 20, 8 (2008), 1082--1090.
    [68]
    Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks? In Advances in neural information processing systems. 3320--3328.
    [69]
    Shizhen Zhao, Wenfeng Li, and Jingjing Cao. 2018. A user-adaptive algorithm for activity recognition based on k-means clustering, local outlier factor, and multivariate gaussian distribution. Sensors 18, 6 (2018), 1850.
    [70]
    Yue Zhao, Meng Li, Liangzhen Lai, Naveen Suda, Damon Civin, and Vikas Chandra. 2018. Federated learning with non-iid data. arXiv preprint arXiv:1806.00582 (2018).
    [71]
    Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. 2014. Learning deep features for scene recognition using places database. (2014).

    Cited By

    View all
    • (2024)Enhancing Communication Efficiency and Training Time Uniformity in Federated Learning through Multi-Branch Networks and the Oort AlgorithmAlgorithms10.3390/a1702005217:2(52)Online publication date: 23-Jan-2024
    • (2024)ShuffleFL: Addressing Heterogeneity in Multi-Device Federated LearningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596218:2(1-34)Online publication date: 15-May-2024
    • (2024)Federated Learning for Mobility ApplicationsACM Computing Surveys10.1145/363786856:5(1-28)Online publication date: 12-Jan-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SenSys '21: Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems
    November 2021
    686 pages
    ISBN:9781450390972
    DOI:10.1145/3485730
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 November 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Federated Learning Personalization
    2. Federated learning
    3. Human activity recognition
    4. Multi-task learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • Research Grants Council (RGC) of Hong Kong

    Conference

    Acceptance Rates

    SenSys '21 Paper Acceptance Rate 25 of 139 submissions, 18%;
    Overall Acceptance Rate 174 of 867 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)355
    • Downloads (Last 6 weeks)37

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enhancing Communication Efficiency and Training Time Uniformity in Federated Learning through Multi-Branch Networks and the Oort AlgorithmAlgorithms10.3390/a1702005217:2(52)Online publication date: 23-Jan-2024
    • (2024)ShuffleFL: Addressing Heterogeneity in Multi-Device Federated LearningProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596218:2(1-34)Online publication date: 15-May-2024
    • (2024)Federated Learning for Mobility ApplicationsACM Computing Surveys10.1145/363786856:5(1-28)Online publication date: 12-Jan-2024
    • (2024)Driver Maneuver Interaction Identification with Anomaly-Aware Federated Learning on Heterogeneous Feature RepresentationsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314217:4(1-28)Online publication date: 12-Jan-2024
    • (2024)DFL: Dynamic Federated Split Learning in Heterogeneous IoTIEEE Transactions on Machine Learning in Communications and Networking10.1109/TMLCN.2024.34092052(733-752)Online publication date: 2024
    • (2024)Towards Hierarchical Clustered Federated Learning With Model Stability on Mobile DevicesIEEE Transactions on Mobile Computing10.1109/TMC.2023.333263723:6(7148-7164)Online publication date: Jun-2024
    • (2024)Learn From Others and Be Yourself in Federated Human Activity Recognition via Attention-Based Pairwise CollaborationsIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.335126073(1-15)Online publication date: 2024
    • (2024)SLMFed: A Stage-Based and Layerwise Mechanism for Incremental Federated Learning to Assist Dynamic and Ubiquitous IoTIEEE Internet of Things Journal10.1109/JIOT.2024.335379311:9(16364-16381)Online publication date: 1-May-2024
    • (2024)HydraJournal of Systems Architecture: the EUROMICRO Journal10.1016/j.sysarc.2023.103052147:COnline publication date: 17-Apr-2024
    • (2024)FedHM: Practical federated learning for heterogeneous model deploymentsICT Express10.1016/j.icte.2023.07.01310:2(387-392)Online publication date: Apr-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media