Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3357384.3357942acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Adaptive Feature Sampling for Recommendation with Missing Content Feature Values

Published: 03 November 2019 Publication History

Abstract

Most recommendation algorithms mainly make use of user history interactions in the model, while these methods often suffer from the cold-start problem (user/item has no history information). On the other sides, content features help on cold-start scenarios for modeling new users or items. So it is essential to utilize content features to enhance different recommendation models. To take full advantage of content features, feature interactions such as cross features are used by some models and outperform than using raw features. However, in real-world systems, many content features are incomplete, e.g., we may know the occupation and gender of a user, but the values of other features (location, interests, etc.) are missing. This missing-feature-value (MFV) problem is harmful to the model performance, especially for models that rely heavily on rich feature interactions. Unfortunately, this problem has not been well studied previously.
In this work, we propose a new adaptive "Feature Sampling'' strategy to help train different models to fit distinct scenarios, no matter for cold-start or missing feature value cases. With the help of this strategy, more feature interactions can be utilized. A novel model named CC-CC is proposed. The model takes both raw features and the feature interactions into consideration. It has a linear part to memorize useful variant information from the user or item contents and contexts (Content & Context Module), and a deep attentive neural module that models both content and collaborate information to enhance the generalization ability (Content & Collaborate Module). Both parts have feature interactions. The model is evaluated on two public datasets. Comparative results show that the proposed CC-CC model outperforms the state-of-the-art algorithms on both warm and cold scenarios significantly (up to 6.3%). To the best of our knowledge, this model is the first clear and powerful model that proposed to handle the missing feature values problem in deep neural network frameworks for recommender systems.

References

[1]
Charu C Aggarwal. 2016. Content-based recommender systems. In Recommender systems . Springer, 139--166.
[2]
Trapit Bansal, David Belanger, and Andrew McCallum. 2016. Ask the gru: Multi-task learning for deep text recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 107--114.
[3]
Brett K Beaulieu-Jones and Jason H Moore. 2017. Missing data imputation in the electronic health record using deeply learned autoencoders. In Pacific Symposium on Biocomputing 2017. World Scientific, 207--218.
[4]
Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto, and Ed H Chi. 2018. Latent cross: Making use of context in recurrent recommender systems. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. ACM, 46--54.
[5]
Alexander Binder, Sebastian Bach, Gregoire Montavon, Klaus-Robert Müller, and Wojciech Samek. 2016. Layer-wise relevance propagation for deep neural network architectures. In Information Science and Applications (ICISA) 2016. Springer, 913--922.
[6]
Xu Chen, Hongteng Xu, Yongfeng Zhang, Jiaxi Tang, Yixin Cao, Zheng Qin, and Hongyuan Zha. 2018. Sequential recommendation with user memory networks. In Proceedings of the 11th ACM International Conference on Web Search and Data Mining. ACM, 108--116.
[7]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et almbox. 2016. Wide & deep learning for recommender systems. In Proceedings of the 1st workshop on deep learning for recommender systems. ACM, 7--10.
[8]
Mukund Deshpande and George Karypis. 2004. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems (TOIS), Vol. 22, 1 (2004), 143--177.
[9]
John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. The Journal of Machine Learning Research, Vol. 12 (2011), 2121--2159.
[10]
Michael D Ekstrand, John T Riedl, and Joseph A Konstan. 2011. Collaborative Filtering Recommender Systems. Foundations and Trends in Human-Computer Interaction, Vol. 4, 2 (2011), 81--173.
[11]
Ruining He and Julian McAuley. 2016a. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In proceedings of the 25th international conference on world wide web. International World Wide Web Conferences Steering Committee, 507--517.
[12]
Ruining He and Julian McAuley. 2016b. VBPR: visual Bayesian Personalized Ranking from implicit feedback. In Proceedings of the 30th AAAI Conference on Artificial Intelligence. AAAI Press, 144--150.
[13]
Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 355--364.
[14]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 173--182.
[15]
Anvitha Hegde and Savitha K Shetty. 2015. Collaborative filtering recommender system. Int J Emerg Trends Sci Technol, Vol. 2, 07 (2015), 291--324.
[16]
José Miguel Hernández-Lobato, Neil Houlsby, and Zoubin Ghahramani. 2014. Probabilistic matrix factorization with non-random missing data. In Proceedings of the 31st International Conference on International Conference on Machine Learning-Volume 32. JMLR. org, II--1512.
[17]
Balázs Hidasi and Alexandros Karatzoglou. 2018. Recurrent neural networks with top-k gains for session-based recommendations. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 843--852.
[18]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
[19]
Balázs Hidasi, Massimo Quadrana, Alexandros Karatzoglou, and Domonkos Tikk. 2016. Parallel recurrent neural network architectures for feature-rich session-based recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 241--248.
[20]
Jin Huang, Wayne Xin Zhao, Hongjian Dou, Ji-Rong Wen, and Edward Y Chang. 2018. Improving sequential recommendation with knowledge-enhanced memory networks. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. ACM, 505--514.
[21]
Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd International Conference on International Conference on Machine Learning-Volume 37. JMLR. org, 448--456.
[22]
Joseph A Konstan, Bradley N Miller, David Maltz, Jonathan L Herlocker, Lee R Gordon, and John Riedl. 1997. GroupLens: applying collaborative filtering to Usenet news. Commun. ACM, Vol. 40, 3 (1997), 77--87.
[23]
Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 426--434.
[24]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8 (2009), 30--37.
[25]
Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam. 2017. Neural rating regression with abstractive tips generation for recommendation. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 345--354.
[26]
Sheng Li, Jaya Kawale, and Yun Fu. 2015. Deep collaborative filtering via marginalized denoising auto-encoder. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management . ACM, 811--820.
[27]
Xiaopeng Li and James She. 2017. Collaborative variational autoencoder for recommender systems. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 305--314.
[28]
Benjamin M Marlin and Richard S Zemel. 2009. Collaborative prediction and ranking with non-random missing data. In Proceedings of the 3rd ACM conference on Recommender systems. ACM, 5--12.
[29]
Ruilin Pan, Tingsheng Yang, Jianhua Cao, Ke Lu, and Zhanchao Zhang. 2015. Missing data imputation by K nearest neighbours based on grey relational structure and mutual information. Applied Intelligence, Vol. 43, 3 (2015), 614--632.
[30]
Steffen Rendle. 2010. Factorization machines. In 2010 IEEE International Conference on Data Mining. IEEE, 995--1000.
[31]
Steffen Rendle. 2012. Factorization machines with libfm. ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 3, 3 (2012), 57.
[32]
Shaoyun Shi, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018. Attention-based Adaptive Model to Unify Warm and Cold Starts Recommendation. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management . ACM, 127--136.
[33]
Manasi Vartak, Arvind Thiagarajan, Conrado Miranda, Jeshua Bratman, and Hugo Larochelle. 2017. A meta-learning perspective on cold-start recommendations for items. In Proceedings of the 31st International Conference on Neural Information Processing Systems . Curran Associates Inc., 6907--6917.
[34]
Maksims Volkovs, Guangwei Yu, and Tomi Poutanen. 2017. DropoutNet: addressing cold start in recommender systems. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc., 4964--4973.
[35]
Jian Wei, Jianhua He, Kai Chen, Yi Zhou, and Zuoyin Tang. 2016. Collaborative filtering and deep learning based hybrid recommendation for cold start problem. In Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech), 2016 IEEE 14th Intl C. IEEE, 874--877.
[36]
Jian Wei, Jianhua He, Kai Chen, Yi Zhou, and Zuoyin Tang. 2017. Collaborative filtering and deep learning based recommendation system for cold start items. Expert Systems with Applications, Vol. 69 (2017), 29--39.
[37]
Yongfeng Zhang, Qingyao Ai, Xu Chen, and W Bruce Croft. 2017. Joint representation learning for top-n recommendation with heterogeneous information sources. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. ACM, 1449--1458.
[38]
Lei Zheng, Vahid Noroozi, and Philip S Yu. 2017. Joint deep modeling of users and items using reviews for recommendation. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining. ACM, 425--434.

Cited By

View all
  • (2024)Configurable Fairness for New Item Recommendation Considering Entry Time of ItemsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657694(437-447)Online publication date: 10-Jul-2024
  • (2024)Attribute Simulation for Item Embedding Enhancement in Multi-interest RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635841(482-491)Online publication date: 4-Mar-2024
  • (2024)Zero-Shot Content-Based Crossmodal Recommendation SystemExpert Systems with Applications10.1016/j.eswa.2024.125108258(125108)Online publication date: Dec-2024
  • Show More Cited By

Index Terms

  1. Adaptive Feature Sampling for Recommendation with Missing Content Feature Values

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CIKM '19: Proceedings of the 28th ACM International Conference on Information and Knowledge Management
    November 2019
    3373 pages
    ISBN:9781450369763
    DOI:10.1145/3357384
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 November 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. feature interaction
    2. feature sampling
    3. missing feature value
    4. neural recommendation model

    Qualifiers

    • Research-article

    Funding Sources

    • National Key Research and Development Program of China
    • Natural Science Foundation of China

    Conference

    CIKM '19
    Sponsor:

    Acceptance Rates

    CIKM '19 Paper Acceptance Rate 202 of 1,031 submissions, 20%;
    Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

    Upcoming Conference

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)35
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 04 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Configurable Fairness for New Item Recommendation Considering Entry Time of ItemsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657694(437-447)Online publication date: 10-Jul-2024
    • (2024)Attribute Simulation for Item Embedding Enhancement in Multi-interest RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635841(482-491)Online publication date: 4-Mar-2024
    • (2024)Zero-Shot Content-Based Crossmodal Recommendation SystemExpert Systems with Applications10.1016/j.eswa.2024.125108258(125108)Online publication date: Dec-2024
    • (2023)Using Neural and Graph Neural Recommender Systems to Overcome Choice Overload: Evidence From a Music Education PlatformACM Transactions on Information Systems10.1145/363787342:4(1-26)Online publication date: 20-Dec-2023
    • (2023)Self-supervised Contrastive Enhancement with Symmetric Few-shot Learning Towers for Cold-start News RecommendationProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615053(945-954)Online publication date: 21-Oct-2023
    • (2023)CoMeta: Enhancing Meta Embeddings with Collaborative Information in Cold-Start Problem of RecommendationKnowledge Science, Engineering and Management10.1007/978-3-031-40289-0_17(213-225)Online publication date: 9-Aug-2023
    • (2022)Generative Adversarial Framework for Cold-Start Item RecommendationProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531897(2565-2571)Online publication date: 6-Jul-2022
    • (2022)A Survey on Dropout Methods and Experimental Verification in RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.3187013(1-20)Online publication date: 2022
    • (2022)CateReg: category regularization of graph convolutional networks based collaborative filteringApplied Intelligence10.1007/s10489-022-04073-353:9(10751-10765)Online publication date: 24-Aug-2022
    • (2022)Context-aware Graph Collaborative Recommendation Without Feature EntanglementCollaborative Computing: Networking, Applications and Worksharing10.1007/978-3-030-92635-9_16(259-276)Online publication date: 1-Jan-2022
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media