Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

FS-Real: A Real-World Cross-Device Federated Learning Platform

Published: 01 August 2023 Publication History

Abstract

Federated learning (FL) is a general distributed machine learning paradigm that provides solutions for tasks where data cannot be shared directly. Due to the difficulties in communication management and heterogeneity of distributed data and devices, initiating and using an FL algorithm for real-world cross-device scenarios requires significant repetitive effort but may not be transferable to similar projects. To reduce the effort required for developing and deploying FL algorithms, we present FS-Real, an open-source FL platform designed to address the need of a general and efficient infrastructure for real-world cross-device FL. In this paper, we introduce the key components of FS-Real and demonstrate that FS-Real has the following capabilities: 1) reducing the programming burden of FL algorithm development with plug-and-play and adaptable runtimes on Android and other Internet of Things (IoT) devices; 2) handling a large number of heterogeneous devices efficiently and robustly with our communication management components; 3) supporting a wide range of advanced FL algorithms with flexible configuration and extension; 4) alleviating the costs and efforts for deployment, evaluation, simulation, and performance optimization of FL algorithms with automatized tool kits.

References

[1]
Brendan McMahan, Eider Moore, Daniel Ramage, et al. 2017. Communication-Efficient Learning of Deep Networks from Decentralized Data. In AISTATS'17, Vol. 54. 1273--1282.
[2]
Daoyuan Chen, Dawei Gao, Weirui Kuang, et al. 2022. pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learning. In NeurIPS'22, Datasets and Benchmarks Track.
[3]
Daoyuan Chen, Dawei Gao, Yuexiang Xie, et al. 2023. FS-Real: Towards Real-World Cross-Device Federated Learning. arXiv preprint:2303.13363 (2023).
[4]
Fan Lai, Yinwei Dai, Sanjay Sri Vallabh Singapuram, et al. 2022. FedScale: Bench-marking Model and System Performance of Federated Learning at Scale. In ICML'22, Vol. 162. 11814--11827.
[5]
Imteaj, Ahmed, et al. 2022. A Survey on Federated Learning for Resource-Constrained IoT Devices. IEEE Internet of Things Journal 9, 1 (2022), 1--24.
[6]
Kairouz, Peter, et al. 2021. Advances and open problems in federated learning. Foundations and Trends in Machine Learning 14, 1--2 (2021), 1--210.
[7]
Lv, Chengfei, et al. 2022. Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning. In OSDI'22. 249--265.
[8]
Nguyen, John, et al. 2022. Federated learning with buffered asynchronous aggregation. In AISTATS'22. 3581--3607.
[9]
Jaehoon Oh, SangMook Kim, and Se-Young Yun. 2022. FedBABU: Toward Enhanced Representation for Federated Image Classification. In ICLR'22.
[10]
Yuexiang Xie, Zhen Wang, Dawei Gao, et al. 2023. FederatedScope: A Flexible Federated Learning Platform for Heterogeneity. PVLDB 16, 5 (2023), 1059--1072.

Cited By

View all
  • (2024)Survey of Federated Learning Models for Spatial-Temporal Mobility ApplicationsACM Transactions on Spatial Algorithms and Systems10.1145/366608910:3(1-39)Online publication date: 1-Jun-2024
  • (2024)Toward Context-Aware Federated Learning Assessment: A Reality CheckIEEE Internet of Things Journal10.1109/JIOT.2023.333827511:7(12567-12578)Online publication date: 1-Apr-2024
  • (2024)A Multifaceted Survey on Federated Learning: Fundamentals, Paradigm Shifts, Practical Issues, Recent Developments, Partnerships, Trade-Offs, Trustworthiness, and Ways ForwardIEEE Access10.1109/ACCESS.2024.341306912(84643-84679)Online publication date: 2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the VLDB Endowment
Proceedings of the VLDB Endowment  Volume 16, Issue 12
August 2023
685 pages
ISSN:2150-8097
Issue’s Table of Contents

Publisher

VLDB Endowment

Publication History

Published: 01 August 2023
Published in PVLDB Volume 16, Issue 12

Check for updates

Badges

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)88
  • Downloads (Last 6 weeks)4
Reflects downloads up to 30 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Survey of Federated Learning Models for Spatial-Temporal Mobility ApplicationsACM Transactions on Spatial Algorithms and Systems10.1145/366608910:3(1-39)Online publication date: 1-Jun-2024
  • (2024)Toward Context-Aware Federated Learning Assessment: A Reality CheckIEEE Internet of Things Journal10.1109/JIOT.2023.333827511:7(12567-12578)Online publication date: 1-Apr-2024
  • (2024)A Multifaceted Survey on Federated Learning: Fundamentals, Paradigm Shifts, Practical Issues, Recent Developments, Partnerships, Trade-Offs, Trustworthiness, and Ways ForwardIEEE Access10.1109/ACCESS.2024.341306912(84643-84679)Online publication date: 2024

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media