Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Towards fair and personalized federated recommendation

Published: 25 June 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Recommender systems have gained immense popularity in recent years for predicting users’ interests by learning embeddings. The majority of existing recommendation approaches, represented by graph neural network-based recommendation algorithms, rely on centralized storage of user-item graphs for model learning, which raises privacy issues in the process of collecting and sharing user data. Federated recommendation can mitigate privacy concerns by preventing the server from collecting sensitive data from clients while there still exist unfairness and personalization issues. To address these challenges, we propose a novel framework named Fair and Personalized Federated Recommendation (FPFR). On the client-side, the soft attention mechanism is designed to learn the representation of user/item by combining interaction and attribute information, and the filter network is combined to better characterize user preferences. On the server-side, we cluster users into different groups and learn personalized models for each user. Then, we select representative users from each group to participate in the global model parameters update. Finally, the fairness of federated recommendation is implemented by adding the fairness constraint to recommendation loss. We conduct experiments on five real-world recommendation datasets, and the results demonstrate that the proposed FPFR not only balances group fairness and recommendation accuracy but also improves personalization.

    Highlights

    We design a novel federated recommendation framework, which takes fairness and personalization of recommendation into consideration simultaneously.
    In the proposed framework, user local model, cluster-level model, and global model are adopted to obtain personalized recommendation.
    On the client, FFFR adopts graph neural network and filter network to better learn users and items representations.

    References

    [1]
    Wu L., He X., Wang X., Zhang K., Wang M., A survey on accuracy-oriented neural recommendation: From collaborative filtering to information-rich recommendation, IEEE Trans. Knowl. Data Eng. 35 (5) (2022) 4425–4445.
    [2]
    Zhang S., Yao L., Sun A., Tay Y., Deep learning based recommender system: A survey and new perspectives, ACM Comput. Surv. 52 (1) (2019) 1–38.
    [3]
    Gao C., Zheng Y., Li N., Li Y., Qin Y., Piao J., Quan Y., Chang J., Jin D., He X., et al., A survey of graph neural networks for recommender systems: Challenges, methods, and directions, ACM Trans. Recomm. Syst. 1 (1) (2023) 1–51.
    [4]
    Huang J., Xie R., Cao Q., Shen H., Zhang S., Xia F., Cheng X., Negative can be positive: Signed graph neural networks for recommendation, Inf. Process. Manag. 60 (4) (2023).
    [5]
    Zhu T., Sun L., Chen G., Graph-based embedding smoothing for sequential recommendation, IEEE Trans. Knowl. Data Eng. 35 (1) (2021) 496–508.
    [6]
    Zheng Z., Wang C., Xu T., Shen D., Qin P., Zhao X., Huai B., Wu X., Chen E., Interaction-aware drug package recommendation via policy gradient, ACM Trans. Inf. Syst. 41 (1) (2023) 1–32.
    [7]
    Wang W., Zhang W., Liu S., Liu Q., Zhang B., Lin L., Zha H., Incorporating link prediction into multi-relational item graph modeling for session-based recommendation, IEEE Trans. Knowl. Data Eng. 35 (3) (2023) 2683–2696.
    [8]
    McMahan B., Moore E., Ramage D., Hampson S., y Arcas B.A., Communication-efficient learning of deep networks from decentralized data, in: Artif. Intell. Stat., PMLR, 2017, pp. 1273–1282.
    [9]
    Yang L., Zhang J., Chai D., Wang L., Guo K., Chen K., Yang Q., Practical and secure federated recommendation with personalized mask, in: Int. Workshop Trustworthy Federated Learn., Springer, 2022, pp. 33–45.
    [10]
    J. Qin, B. Liu, J. Qian, A novel privacy-preserved recommender system framework based on federated learning, in: Proc. 4th Int. Conf. Software Eng. Inform. Manag., 2021, pp. 82–88.
    [11]
    L. Minto, M. Haller, B. Livshits, H. Haddadi, Stronger privacy for federated collaborative filtering with implicit feedback, in: Proc. 15th ACM Conf. Recomm. Syst., 2021, pp. 342–350.
    [12]
    Flanagan A., Oyomno W., Grigorievskiy A., Tan K.E., Khan S.A., Ammad-Ud-Din M., Federated multi-view matrix factorization for personalized recommendations, in: Eur. Conf. Mach. Learn. Knowl. Discov. Datab., Springer, 2021, pp. 324–347.
    [13]
    S. Liu, Y. Ge, S. Xu, Y. Zhang, A. Marian, Fairness-aware federated matrix factorization, in: Proc. 16th ACM Conf. Recomm. Syst., 2022, pp. 168–178.
    [14]
    Feng S., Xu C., Zuo Y., Chen G., Lin F., XiaHou J., Relation-aware dynamic attributed graph attention network for stocks recommendation, Pattern Recognit. 121 (2022).
    [15]
    Hao Y., Ma J., Zhao P., Liu G., Xian X., Zhao L., Sheng V.S., Multi-dimensional graph neural network for sequential recommendation, Pattern Recognit. 139 (2023).
    [16]
    Dai Q., Wu X.-M., Fan L., Li Q., Liu H., Zhang X., Wang D., Lin G., Yang K., Personalized knowledge-aware recommendation with collaborative and attentive graph convolutional networks, Pattern Recognit. 128 (2022).
    [17]
    J. Wu, X. Wang, F. Feng, X. He, L. Chen, J. Lian, X. Xie, Self-supervised graph learning for recommendation, in: Proc. 44th Int. ACM SIGIR Conf. Res. Develop. Inform. Retr., 2021, pp. 726–735.
    [18]
    Sun J., Zhang Y., Ma C., Coates M., Guo H., Tang R., He X., Multi-graph convolution collaborative filtering, in: 2019 IEEE Int. Conf. Data Mining, IEEE, 2019, pp. 1306–1311.
    [19]
    W. Fan, Y. Ma, Q. Li, Y. He, E. Zhao, J. Tang, D. Yin, Graph neural networks for social recommendation, in: Proc. 2019 World Wide Web Conf., 2019, pp. 417–426.
    [20]
    Lu Y., Gao M., Liu H., Liu Z., Yu W., Li X., Jiao P., Neighborhood overlap-aware heterogeneous hypergraph neural network for link prediction, Pattern Recognit. (2023).
    [21]
    Sang L., Xu M., Qian S., Wu X., Adversarial heterogeneous graph neural network for robust recommendation, IEEE Trans. Comput. Soc. Syst. (2023).
    [22]
    Chai D., Wang L., Chen K., Yang Q., Secure federated matrix factorization, IEEE Intell. Syst. 36 (5) (2020) 11–20.
    [23]
    Lin G., Liang F., Pan W., Ming Z., Fedrec: Federated recommendation with explicit feedback, IEEE Intell. Syst. 36 (5) (2020) 21–30.
    [24]
    K. Maeng, H. Lu, L. Melis, J. Nguyen, M. Rabbat, C.-J. Wu, Towards fair federated recommendation learning: Characterizing the inter-dependence of system and data heterogeneity, in: Proc. 16th ACM Conf. Recomm. Syst., 2022, pp. 156–167.
    [25]
    Ribero M., Henderson J., Williamson S., Vikalo H., Federating recommendations using differentially private prototypes, Pattern Recognit. 129 (2022).
    [26]
    T. Qi, F. Wu, C. Wu, Y. Huang, X. Xie, Privacy-Preserving News Recommendation Model Learning, in: Findings of the Association for Computational Linguistics: EMNLP 2020, 2020, pp. 1423–1432.
    [27]
    Wu C., Wu F., Lyu L., Qi T., Huang Y., Xie X., A federated graph neural network framework for privacy-preserving personalization, Nature Commun. 13 (1) (2022) 3091.
    [28]
    Wang Y., Ma W., Zhang M., Liu Y., Ma S., A survey on the fairness of recommender systems, ACM Trans. Inf. Syst. 41 (3) (2023) 1–43.
    [29]
    L. Xiao, Z. Min, Z. Yongfeng, G. Zhaoquan, L. Yiqun, M. Shaoping, Fairness-aware group recommendation with pareto-efficiency, in: Proc. 11th ACM Conf. Recomm. Syst., 2017, pp. 107–115.
    [30]
    Amigó E., Deldjoo Y., Mizzaro S., Bellogín A., A unifying and general account of fairness measurement in recommender systems, Inf. Process. Manag. 60 (1) (2023).
    [31]
    G.K. Patro, A. Biswas, N. Ganguly, K.P. Gummadi, A. Chakraborty, Fairrec: Two-sided fairness for personalized recommendations in two-sided platforms, in: Proc. Web Conf. 2020, 2020, pp. 1194–1204.
    [32]
    Y. Li, H. Chen, S. Xu, Y. Ge, Y. Zhang, Towards personalized fairness based on causal notion, in: Proc. 44th Int. ACM SIGIR Conf. Res. Dev. Inform. Retr., 2021, pp. 1054–1063.
    [33]
    J. Li, Y. Ren, K. Deng, FairGAN: GANs-based fairness-aware learning for recommendations with implicit feedback, in: Proc. ACM Web Conf. 2022, 2022, pp. 297–307.
    [34]
    Y. Li, H. Chen, Z. Fu, Y. Ge, Y. Zhang, User-oriented fairness in recommendation, in: Proc. Web Conf. 2021, 2021, pp. 624–632.
    [35]
    Y. Ge, S. Liu, R. Gao, Y. Xian, Y. Li, X. Zhao, C. Pei, F. Sun, J. Ge, W. Ou, et al., Towards long-term fairness in recommendation, in: Proc. 14th ACM Int. Conf. Web Search Data Mining, 2021, pp. 445–453.
    [36]
    Zhu Z., Si S., Wang J., Xiao J., Cali3F: Calibrated fast fair federated recommendation system, in: 2022 Int. Joint Conf. Neural Netw., IEEE, 2022, pp. 1–8.
    [37]
    S. Luo, Y. Xiao, L. Song, Personalized federated recommendation via joint representation learning, user clustering, and model adaptation, in: Proc. 31st ACM Int. Conf. Inform. Knowl. Manag., 2022, pp. 4289–4293.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Pattern Recognition
    Pattern Recognition  Volume 149, Issue C
    May 2024
    904 pages

    Publisher

    Elsevier Science Inc.

    United States

    Publication History

    Published: 25 June 2024

    Author Tags

    1. Federated learning
    2. Fairness
    3. Graph neural network
    4. Personalized recommendation

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 13 Aug 2024

    Other Metrics

    Citations

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media