Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3652963.3655055acmconferencesArticle/Chapter ViewAbstractPublication PagesmetricsConference Proceedingsconference-collections
abstract

FedQV: Leveraging Quadratic Voting in Federated Learning

Published: 10 June 2024 Publication History

Abstract

Federated Learning (FL) permits different parties to collaboratively train a global model without disclosing their respective local labels. A crucial step of FL, that of aggregating local models to produce the global one, shares many similarities with public decision-making, and elections in particular. In that context, a major weakness of FL, namely its vulnerability to poisoning attacks, can be interpreted as a consequence of the one person one vote (henceforth 1p1v) principle that underpins most contemporary aggregation rules.
In this paper, we introduce FedQV, a novel aggregation algorithm built upon the quadratic voting, recently proposed as a better alternative to 1p1v-based elections. Our theoretical analysis establishes that FedQV is a truthful mechanism in which bidding according to one's true valuation is a dominant strategy that achieves a convergence rate matching that of state-of-the-art methods. Furthermore, our empirical analysis using multiple real-world datasets validates the superior performance of FedQV against poisoning attacks. It also shows that combining FedQV with unequal voting "budgets'' according to a reputation score increases its performance benefits even further. Finally, we show that FedQV can be easily combined with Byzantine-robust privacy-preserving mechanisms to enhance its robustness against both poisoning and privacy attacks. This extended abstract is an abridged version of [3].

References

[1]
Peva Blanchard, El Mahdi El Mhamdi, Rachid Guerraoui, and Julien Stainer. 2017. Machine Learning with Adversaries: Byzantine Tolerant Gradient Descent. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Long Beach, CA, USA, 119--129.
[2]
Tianyue Chu, Á lvaro Garc'i a-Recuero, Costas Iordanou, Georgios Smaragdakis, and Nikolaos Laoutaris. 2023. Securing Federated Sensitive Topic Classification against Poisoning Attacks. In 30th Annual Network and Distributed System Security Symposium, NDSS 2023. San Diego, California, USA.
[3]
Tianyue Chu and Nikolaos Laoutaris. 2024. FedQV: Leveraging Quadratic Voting in Federated Learning. Proceedings of the ACM on Measurement and Analysis of Computing Systems, Vol. 8, 2 (2024).
[4]
Andrew Hard, Kanishka Rao, Rajiv Mathews, Francc oise Beaufays, Sean Augenstein, Hubert Eichner, Chloé Kiddon, and Daniel Ramage. [n.,d.]. Federated Learning for Mobile Keyboard Prediction. ( [n.,d.]). showeprint[arXiv]1811.03604 http://arxiv.org/abs/1811.03604
[5]
Steven P Lalley and E Glen Weyl. 2018. Quadratic voting: How mechanism design can radicalize democracy. In AEA Papers and Proceedings, Vol. 108. 33--37.
[6]
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273--1282.
[7]
Eric A Posner and E Glen Weyl. 2015. Voting squared: Quadratic voting in democratic politics. Vand. L. Rev., Vol. 68 (2015), 441.
[8]
Swaroop Ramaswamy, Rajiv Mathews, Kanishka Rao, and Francc oise Beaufays. 2019. Federated learning for emoji prediction in a mobile keyboard. arXiv preprint arXiv:1906.04329 (2019).
[9]
E Glen Weyl. 2017. The robustness of quadratic voting. Public choice, Vol. 172, 1 (2017), 75--107.
[10]
Dong Yin, Yudong Chen, Ramchandran Kannan, and Peter Bartlett. 2018. Byzantine-robust distributed learning: Towards optimal statistical rates. In International Conference on Machine Learning. PMLR, 5650--5659.

Cited By

View all
  • (2024)FedQV: Leveraging Quadratic Voting in Federated LearningACM SIGMETRICS Performance Evaluation Review10.1145/3673660.365505552:1(91-92)Online publication date: 13-Jun-2024
  • (2024)FedQV: Leveraging Quadratic Voting in Federated LearningAbstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3652963.3655055(91-92)Online publication date: 10-Jun-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems
June 2024
120 pages
ISBN:9798400706240
DOI:10.1145/3652963
  • cover image ACM SIGMETRICS Performance Evaluation Review
    ACM SIGMETRICS Performance Evaluation Review  Volume 52, Issue 1
    SIGMETRICS '24
    June 2024
    104 pages
    DOI:10.1145/3673660
    • Editor:
    • Bo Ji
    Issue’s Table of Contents
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 June 2024

Check for updates

Author Tags

  1. distributed training
  2. federated learning

Qualifiers

  • Abstract

Funding Sources

  • Ministry of Economic Affairs and Digital Transformation and the European Union-NextGenerationEU/PRTR

Conference

SIGMETRICS/PERFORMANCE '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)41
  • Downloads (Last 6 weeks)6
Reflects downloads up to 01 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)FedQV: Leveraging Quadratic Voting in Federated LearningACM SIGMETRICS Performance Evaluation Review10.1145/3673660.365505552:1(91-92)Online publication date: 13-Jun-2024
  • (2024)FedQV: Leveraging Quadratic Voting in Federated LearningAbstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3652963.3655055(91-92)Online publication date: 10-Jun-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media