Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
survey

Survey on the Objectives of Recommender Systems: Measures, Solutions, Evaluation Methodology, and New Perspectives

Published: 03 December 2022 Publication History

Abstract

Recently, recommender systems have played an increasingly important role in a wide variety of commercial applications to help users find favourite products. Research in the recommender system field has traditionally focused on the accuracy of predictions and the relevance of recommendations. However, other recommendation quality measures may have a significant impact on the overall performance of a recommender system and the satisfaction of users. Hence, researchers’ attention in this field has recently shifted to include other recommender system objectives. This article aims to provide a comprehensive review of recent research efforts on recommender systems based on the objectives achieved: relevance, diversity, novelty, coverage, and serendipity. In addition, the definitions and measures associated with these objectives are reviewed. Furthermore, the article surveys the evaluation methodology used to measure the impact of the main challenges on performance and the new applications of the recommender system. Finally, new perspectives, open issues, and future directions are provided to develop the field.

References

[1]
Giuseppe Agapito, Mariadelina Simeoni, Barbara Calabrese, Ilaria Caré, Theodora Lamprinoudi, Pietro H. Guzzi, Arturo Pujia, Giorgio Fuiano, and Mario Cannataro. 2018. DIETOS: A dietary recommender system for chronic diseases monitoring and management. Comput. Methods Programs Biomed. 153 (2018), 93–104.
[2]
Charu C. Aggarwal. 2016. Recommender Systems the Textbook. Springer International Publishing.
[3]
Sajad Ahmadian, Majid Meghdadi, and Mohsen Afsharchi. 2018. Incorporating reliable virtual ratings into social recommendation systems. Appl. Intell. 48, 11 (2018), 4448–4469.
[4]
Bushra Alhijawi. 2019. Improving collaborative filtering recommender system results using optimization technique. In Proceedings of the 3rd International Conference on Advances in Artificial Intelligence. 183–187.
[5]
Bushra Alhijawi, Ghazi Al-Naymat, Nadim Obeid, and Arafat Awajan. 2019. Mitigating the effect of data sparsity: A case study on collaborative filtering recommender system. In Proceedings of the 2nd International Conference on New Trends in Computing Sciences. 1–6.
[6]
Bushra Alhijawi, Ghazi Al-Naymat, Nadim Obeid, and Arafat Awajan. 2021. Novel predictive model to improve the accuracy of collaborative filtering recommender systems. Info. Syst. 96 (2021), 101670.
[7]
Bushra Alhijawi and Yousef Kilani. 2016. Using genetic algorithms for measuring the similarity values between users in collaborative filtering recommender systems. In Proceedings of the IEEE/ACIS 15th International Conference on Computer and Information Science. 1–6.
[8]
Bushra Alhijawi and Yousef Kilani. 2020. A collaborative filtering recommender system using genetic algorithm. Info. Process. Manage. 57, 6 (2020), 102310.
[9]
Bushra Alhijawi and Yousef Kilani. 2020. The recommender system: A survey. Int. J. Adv. Intell. Paradigms 15, 3 (2020), 229–251.
[10]
Bushra Alhijawi, Nadim Obeid, Arafat Awajan, and Sara Tedmori. 2018. Improving collaborative filtering recommender systems using semantic information. In Proceedings of the 9th International Conference on Information and Communication Systems. 127–132.
[11]
Ya-Hui An, Qiang Dong, Quan Yuan, and Chao Wang. 2020. Improving recommendation diversity by highlighting the ExTrA fabricated experts. IEEE Access 8 (2020), 64422–64433.
[12]
Chris Anderson. 2006. The Long Tail: Why the Future of Business is Selling Less of More. Hachette Books.
[13]
Azin Ashkan, Branislav Kveton, Shlomo Berkovsky, and Zheng Wen. 2015. Optimal greedy diversity for recommendation. In Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI’15). AAAI Press, 1742–1748.
[14]
Ehsan Aslanian, Mohammadreza Radmanesh, and Mahdi Jalili. 2016. Hybrid recommender systems based on content feature relationship. IEEE Trans. Industr. Info. (2016), 1. https://ieeexplore.ieee.org/document/775055.
[15]
Mohammad Mahdi Azadjalal, Parham Moradi, Alireza Abdollahpouri, and Mahdi Jalili. 2017. A trust-aware recommendation method based on Pareto dominance and confidence concepts. Knowl.-Based Syst. 116 (2017), 130–143.
[16]
Sujoy Bag, Abhijeet Ghadge, and Manoj Kumar Tiwari. 2019. An integrated recommender system for improved accuracy and aggregate diversity. Comput. Industr. Eng. 130 (2019), 187–197.
[17]
Jinze Bai, Chang Zhou, Junshuai Song, Xiaoru Qu, Weiting An, Zhao Li, and Jun Gao. 2019. Personalized bundle list recommendation. In Proceedings of the World Wide Web Conference.60–71.
[18]
Fabiano M. Belém, Carolina S. Batista, Rodrygo L. T. Santos, Jussara M. Almeida, and Marcos A. Gonçalves. 2016. Beyond relevance: Explicitly promoting novelty and diversity in tag recommendation. ACM Trans. Intell. Syst. Technol. 7, 3 (2016), 1–34.
[19]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. J. Mach. Learn. Res. 3 (2003), 993–1022.
[20]
Carlos Bocanegra, Jose Ramos, Carlos Rizo, Anton Civit, and Luis Fernandez-Luque. 2017. HealthRecSys: A semantic content-based recommender system to complement health videos. BMC Med. Info. Decision Making 17, 1 (2017).
[21]
Ludovico Boratto, Salvatore Carta, and Gianni Fenu. 2017. Investigating the role of the rating prediction task in granularity-based group recommender systems and big data scenarios. Info. Sci. 378 (2017), 424–443.
[22]
Buqing Cao, Xiaoqing Liu, MD Mahfuzer Rahman, Bing Li, Jianxun Liu, and Mingdong Tang. 2020. Integrated content and network-based service clustering and web APIs recommendation for mashup development. IEEE Trans. Serv. Comput. 13, 1 (2020), 99–113.
[23]
Bin Cao, Jianwei Zhao, Xin Liu, Xinyuan Kang, Shan Yang, Kai Kang, and Ming Yu. 2018. Multiobjective recommendation optimization via utilizing distributed parallel algorithm. Future Gen. Comput. Syst. 86 (2018), 1259–1268.
[24]
Fran Casino and Constantinos Patsakis. 2019. An efficient blockchain-based privacy-preserving collaborative filtering architecture. IEEE Trans. Eng. Manage. 67, 4 (2019), 1–13.
[25]
Fran Casino, Constantinos Patsakis, Edgar Batista, Frederic Borras, and Antoni Martinez-Balleste. 2017. Healthy routes in the smart city: A context-aware mobile recommender. IEEE Softw. 34, 6 (2017), 42–47.
[26]
Zhengyi Chai, Ya-Lun Li, Ya-Min Han, and Si-Feng Zhu. 2018. Recommendation system based on singular value decomposition and multi-objective immune optimization. IEEE Access 7 (2018), 6060–6071.
[27]
Guilin Chen, Tianrun Gao, Xuzhen Zhu, Hui Tian, and Zhao Yang. 2017. Personalized recommendation based on preferential bidirectional mass diffusion. Physica A: Stat. Mech. Appl. 469 (2017), 397–404.
[28]
Laming Chen, Guoxin Zhang, and Eric Zhou. 2018. Fast greedy map inference for determinantal point process to improve recommendation diversity. In Proceedings of the 32nd International Conference on Neural Information Processing. 5622–5633.
[29]
Ling-Jiao Chen and Jian Gao. 2018. A trust-based recommendation method using network diffusion processes. Physica A: Stat. Mech. Appl. 506 (2018), 679–691.
[30]
Ling-Jiao Chen, Zi-Ke Zhang, Jin-Hu Liu, Jian Gao, and Tao Zhou. 2017. A vertex similarity index for better personalized recommendation. Physica A: Stat. Mech. Appl. 466 (2017), 607–615.
[31]
Xuefeng Chen, Yifeng Zeng, Gao Cong, Shengchao Qin, Yanping Xiang, and Yuanshun Dai. 2015. On information coverage for location category based point-of-interest recommendation. In Proceedings of the 29th AAAI Conference on Artificial Intelligence. 37–43.
[32]
Dahye Chung, Kaiyuan Zhang, and Jihoon Yang. 2019. Method for identifying cancer-related genes using gene similarity-based collaborative filtering. J. Comput. Biol. 26, 8 (2019), 875–881.
[33]
Charles L. A. Clarke, Maheedhar Kolla, Gordon V. Cormack, Olga Vechtomova, Azin Ashkan, Stefan Büttcher, and Ian MacKinnon. 2008. Novelty and diversity in information retrieval evaluation. In Proceedings of the 31st Annual International ACM Conference on Research and Development in Information Retrieval. 659–666.
[34]
Laizhong Cui, Peng Ou, Xianghua Fu, Zhenkun Wen, and Nan Lu. 2017. A novel multi-objective evolutionary algorithm for recommendation systems. J. Parallel Distrib. Comput. 103 (2017), 53–63.
[35]
Zhihua Cui, Xianghua Xu, Fei Xue, Xingjuan Cai, Yang Cao, Wensheng Zhang, and Jinjun Chen. 2020. Personalized recommendation system based on collaborative filtering for IoT scenarios. IEEE Trans. Serv. Comput. (2020), 1–1.
[36]
Aminu Da'u and Naomie Salim. 2019. Sentiment-aware deep recommender system with neural attention networks. IEEE Access 7 (2019), 45472–45484.
[37]
Marco de Gemmis, Pasquale Lops, Giovanni Semeraro, and Cataldo Musto. 2015. An investigation on the serendipity problem in recommender systems. Info. Process. Manage. 51, 5 (2015), 695–717.
[38]
Xiaofang Deng, Yuansheng Zhong, Linyuan Lü, Naixue Xiong, and Chiho Yeung. 2017. A general and effective diffusion-based recommendation scheme on coupled social networks. Info. Sci. 417 (2017), 420–434.
[39]
Anup Anand Deshmukh, Pratheeksha Nair, and Shrisha Rao. 2018. A scalable clustering algorithm for serendipity in recommender systems. In Proceedings of the IEEE International Conference on Data Mining Workshops.
[40]
Danilo Dessì, Diego Reforgiato Recupero, Gianni Fenu, and Sergio Consoli. 2018. A recommender system of medical reports leveraging cognitive computing and frame semantics. In Machine Learning Paradigms. Springer, 7–30.
[41]
Rong Du, Paolo Santi, Ming Xiao, Athanasios V. Vasilakos, and Carlo Fischione. 2019. The sensable city: A survey on the deployment and management for smart city monitoring. IEEE Commun. Surveys Tutor. 21, 2 (2019), 1533–1560.
[42]
Seda Polat Erdeniz, Ilias Maglogiannis, Andreas Menychtas, Alexander Felfernig, and Thi Ngoc Trang Tran. 2018. Recommender systems for IoT enabled m-health applications. In IFIP Advances in Information and Communication Technology. 227–237.
[43]
Seda Polat Erdeniz, Andreas Menychtas, Ilias Maglogiannis, Alexander Felfernig, and Thi Ngoc Trang Tran. 2019. Recommender systems for IoT enabled quantified-self applications. Evolv. Syst. 11, 2 (2019), 291–304.
[44]
Farzad Eskandanian, Bamshad Mobasher, and Robin Burke. 2017. A clustering approach for personalizing diversity in collaborative recommender systems. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization.
[45]
Aurora Esteban, Amelia Zafra, and Cristóbal Romero. 2018. A hybrid multi-criteria approach using a genetic algorithm for recommending courses to university students. In Proceedings of the 11th International Conference on Educational Data Mining.
[46]
A. Esteban, A. Zafra, and C. Romero. 2019. Helping university students to choose elective courses by using a hybrid multi-criteria recommendation system with genetic optimization. Knowl.-Based Syst. 194 (2019), 105385.
[47]
Nicola Ferro and Gianmaria Silvello. 2015. Rank-biased precision reloaded: Reproducibility and generalization. In Lecture Notes in Computer Science. 768–780.
[48]
Agostino Forestiero. 2017. Multi-agent recommendation system in Internet of Things. In Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.
[49]
Rodrigo Zenun Franco. 2017. Online recommender system for personalized nutrition advice. In Proceedings of the ACM Conference on Recommender Systems.
[50]
Lele Fu, Pengfei Lin, Athanasios V. Vasilakos, and Shiping Wang. 2020. An overview of recent multi-view clustering. Neurocomputing 402 (Aug.2020), 148–161.
[51]
Wensheng Gan, Jerry Chun-Wei Lin, Han-Chieh Chao, Athanasios V. Vasilakos, and Philip S. Yu. 2020. Utility-driven data analytics on uncertain data. IEEE Syst. J. 14, 3 (Sept.2020), 4442–4453.
[52]
Anupriya Gogna and Angshul Majumdar. 2017. Balancing accuracy and diversity in recommendations using matrix completion framework. Knowl.-Based Syst. 125 (2017), 83–95.
[53]
Felix Gräßer, Stefanie Beckert, Denise Küster, Jochen Schmitt, Susanne Abraham, Hagen Malberg, and Sebastian Zaunseder. 2017. Therapy decision support based on recommender system methods. J. Healthcare Eng. 2017 (2017), 1–11.
[54]
Xing Guo, Shi-Chao Yin, Yi-Wen Zhang, Wei Li, and Qiang He. 2019. Cold start recommendation based on attribute-fused singular value decomposition. IEEE Access 7 (2019), 11349–11359.
[55]
Jyoti Gupta and Jayant Gadge. 2015. Performance analysis of recommendation system based on collaborative filtering and demographics. In Proceedings of the International Conference on Communication, Information & Computing Technology.
[56]
Hadi Habibzadeh, Andrew Boggio-Dandry, Zhou Qin, Tolga Soyata, Burak Kantarci, and Hussein T. Mouftah. 2018. Soft sensing in smart cities: Handling 3Vs using recommender systems, machine intelligence, and data analytics. IEEE Commun. Mag. 56, 2 (2018), 78–86.
[57]
Badr Ait Hammou, Ayoub Ait Lahcen, and Salma Mouline. 2018. APRA: An approximate parallel recommendation algorithm for big data. Knowl.-Based Syst. 157 (2018), 10–19.
[58]
Khalid Haruna, Maizatul Akmar Ismail, Suhendroyono Suhendroyono, Damiasih Damiasih, Adi Pierewan, Haruna Chiroma, and Tutut Herawan. 2017. Context-aware recommender system: A review of recent developmental process and future research direction. Appl. Sci. 7, 12 (2017), 1211.
[59]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.
[60]
Yu-Chieh Ho, Yi-Ting Chiang, and Jane Yung-Jen Hsu. 2014. Who likes it more? In Proceedings of the ACM International Conference on Web Search and Data Mining.
[61]
Thomas Hofmann. 2001. Unsupervised learning by probabilistic latent semantic analysis. Mach. Learn. 42, 1/2 (2001), 177–196.
[62]
Lei Hou, Kecheng Liu, Jianguo Liu, and Runtong Zhang. 2017. Solving the stability–accuracy–diversity dilemma of recommender systems. Physica A: Stat. Mech. Appl. 468 (2017), 415–424.
[63]
Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip Yu. 2018. Leveraging meta-path based context for top- N recommendation with A neural co-attention model. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1531–1540.
[64]
Qintai Hu, Zhongmei Han, Xiaofan Lin, Qionghao Huang, and Xiaomei Zhang. 2019. Learning peer recommendation using attention-driven CNN with interaction tripartite graph. Info. Sci. 479 (2019), 231–249.
[65]
Xiaomei Huang, Guoqiong Liao, Naixue Xiong, Athanasios V. Vasilakos, and Tianming Lan. 2020. A survey of context-aware recommendation schemes in event-based social networks. Electronics 9, 1583 (2020), 1–35.
[66]
Zhenhua Huang, Xin Xu, Honghao Zhu, and MengChu Zhou. 2020. An efficient group recommendation model with multiattention-based neural networks. IEEE Trans. Neural Netw. Learn. Syst. 31, 11 (2020), 1–14.
[67]
Mohammed E. Ibrahim, Yanyan Yang, David L. Ndzi, Guangguang Yang, and Murtadha Al-Maliki. 2019. Ontology-based personalized course recommendation framework. IEEE Access 7 (2019), 5180–5199.
[68]
F. O. Isinkaye, Y. O. Folajimi, and B. A. Ojokoh. 2015. Recommendation systems: Principles, methods and evaluation. Egypt. Info. J. 16, 3 (2015), 261–273.
[69]
Fouzia Jabeen, Muazzam Maqsood, Mustansar Ghazanfar, Farhan Aadil, Salabat Khan, Muhammad Fahad Khan, and Irfan Mehmood. 2019. An IoT-based efficient hybrid recommender system for cardiovascular disease. Peer-to-Peer Netw. Appl. 12, 5 (2019), 1263–1276.
[70]
Amin Javari and Mahdi Jalili. 2014. A probabilistic model to resolve diversity–accuracy challenge of recommendation systems. Knowl. Info. Syst. 44, 3 (2014), 609–627.
[71]
Dazhi Jiang, Zhichao Liu, Lin Zheng, and Jianwei Chen. 2020. Factorization meets neural networks: A scalable and efficient recommender for solving the new user problem. IEEE Access 8 (2020), 18350–18361.
[72]
Michael Jugovac, Dietmar Jannach, and Lukas Lerche. 2017. Efficient optimization of multiple recommendation quality factors according to individual user tendencies. Expert Syst. Appl. 81 (2017), 321–331.
[73]
Marius Kaminskas and Derek Bridge. 2017. Diversity, serendipity, novelty, and coverage: A survey and empirical analysis of beyond-accuracy objectives in recommender systems. ACM Trans. Interact. Intell. Syst. 7, 1 (2017), 1–42.
[74]
Guosheng Kang, Mingdong Tang, Jianxun Liu, Xiaoqing Liu, and Buqing Cao. 2016. Diversifying web service recommendation results via exploring service usage history. IEEE Trans. Serv. Comput. 9, 4 (2016), 566–579.
[75]
Surya Kant, Tripti Mahara, Vinay Kumar Jain, Deepak Kumar Jain, and Arun Kumar Sangaiah. 2018. LeaderRank based k-means clustering initialization method for collaborative filtering. Comput. Electr. Eng. 69 (2018), 598–609.
[76]
Komal Kapoor, Vikas Kumar, Loren Terveen, Joseph Konstan, and Paul Schrater. 2015. “I like to explore sometimes”: Adapting to dynamic user novelty preferences. In Proceedings of the ACM Conference on Recommender Systems.
[77]
Mozhgan Karimi, Dietmar Jannach, and Michael Jugovac. 2018. News recommender systems—Survey and roads ahead. Info. Process. Manage. 54, 6 (2018), 1203–1227.
[78]
Rahul Katarya and Om Prakash Verma. 2017. Efficient music recommender system using context graph and particle swarm. Multimedia Tools Appl. 77, 2 (2017), 2673–2687.
[79]
Mesut Kaya and Derek Bridge. 2019. A comparison of calibrated and intent-aware recommendations. In Proceedings of the ACM Conference on Recommender Systems. ACM.
[80]
M. G. Kendall. 1938. A new measure of rank correlation. Biometrika 30, 1/2 (1938), 81.
[81]
Zafran Khan, Naima Iltaf, Hammad Afzal, and Haider Abbas. 2020. Enriching non-negative matrix factorization with contextual embeddings for recommender systems. Neurocomputing 380 (2020), 246–258.
[82]
Han-Gyu Ko, In-Young Ko, and Dongman Lee. 2017. Multi-criteria matrix localization and integration for personalized collaborative filtering in IoT environments. Multimedia Tools Appl. 77, 4 (2017), 4697–4730.
[83]
Hamidreza Koohi and Kourosh Kiani. 2016. User based Collaborative Filtering using fuzzy C-means. Measurement 91 (2016), 134–139.
[84]
Denis Kotkov, Jari Veijalainen, and Shuaiqiang Wang. 2018. How does serendipity affect diversity in recommender systems? A serendipity-oriented greedy algorithm. Computing 102, 2 (2018), 393–411.
[85]
Matevž Kunaver and Tomaž Požrl. 2017. Diversity in recommender systems—A survey. Knowl.-Based Syst. 123 (2017), 154–162.
[86]
Ayangleima Laishram and Vineet Padmanabhan. 2019. Discovery of user-item subgroups via genetic algorithm for effective prediction of ratings in collaborative filtering. Appl. Intell. 49, 11 (2019), 3990–4006.
[87]
Pan Li, Maofei Que, Zhichao Jiang, YAO HU, and Alexander Tuzhilin. 2020. PURS: Personalized unexpected recommender system for improving user satisfaction. In Proceedings of the 14th ACM Conference on Recommender Systems. ACM.
[88]
Qiuzhen Lin, Xiaozhou Wang, Bishan Hu, Lijia Ma, Fei Chen, Jianqiang Li, and Carlos A. Coello Coello. 2018. Multiobjective personalized recommendation algorithm using extreme point guided evolutionary computation. Complexity 2018 (2018), 1–18.
[89]
Andrea Lisi, Andrea De Salve, Paolo Mori, and Laura Ricci. 2019. A smart contract based recommender system. In Proceedings of the 16th International Conference on Economics of Grids, Clouds, Systems, and Services (GECON’19). 29–42.
[90]
Guannan Liu, Yanjie Fu, Guoqing Chen, Hui Xiong, and Can Chen. 2017. Modeling buying motives for personalized product bundle recommendation. ACM Trans. Knowl. Discov. Data 11, 3 (2017), 1–26.
[91]
Haifeng Liu, Xiaomei Bai, Zhuo Yang, Amr Tolba, and Feng Xia. 2015. Trust-aware recommendation for improving aggregate diversity. New Rev. Hypermedia Multimedia 21, 3–4 (2015), 242–258.
[92]
Hongzhi Liu, Zhengshen Jiang, Yang Song, Tao Zhang, and Zhonghai Wu. 2019. User preference modeling based on meta paths and diversity regularization in heterogeneous information networks. Knowl.-Based Syst. 181 (2019), 104784.
[93]
Wei Liu, Hanjiang Lai, Jing Wang, Geyang Ke, Weiwei Yang, and Jian Yin. 2020. Mix geographical information into local collaborative ranking for POI recommendation. World Wide Web 23, 1 (2020), 131–152.
[94]
Ramon Lopes, Renato Assunção, and Rodrygo Santos. 2016. Efficient Bayesian methods for graph-based recommendation. In Proceedings of the ACM Conference on Recommender Systems. 333–340.
[95]
Feng Lu and Nava Tintarev. 2018. A diversity adjusting strategy with personality for music recommendation. In Proceedings of the ACM Conference on Recommender Systems. 7–14.
[96]
Linyuan Lü, Matúš Medo, Chi Ho Yeung, Yi-Cheng Zhang, Zi-Ke Zhang, and Tao Zhou. 2012. Recommender systems. Phys. Rep. 519, 1 (2012), 1–49.
[97]
Ziyu Lu, Hao Wang, Nikos Mamoulis, Wenting Tu, and David W. Cheung. 2017. Personalized location recommendation by aggregating multiple recommenders in diversity. GeoInformatica 21, 3 (2017), 459–484.
[98]
Ling Luo, Haoran Xie, Yanghui Rao, and Fu Lee Wang. 2019. Personalized recommendation by matrix co-factorization with tags and time information. Expert Syst. Appl. 119 (2019), 311–321.
[99]
Gang Lv, Chunling Hu, and Shengbing Chen. 2016. Research on recommender system based on ontology and genetic algorithm. Neurocomputing 187 (2016), 92–97.
[100]
Xiang Ma, Xiaojiang Lei, Guoshuai Zhao, and Xueming Qian. 2017. Rating prediction by exploring user’s preference and sentiment. Multimedia Tools Appl. 77, 6 (2017), 6425–6444.
[101]
Xiao Ma, Hongwei Lu, Zaobin Gan, and Jiangfeng Zeng. 2017. An explicit trust and distrust clustering based collaborative filtering recommendation approach. Electronic Comm. Res. Appl. 25 (2017), 29–39.
[102]
Anbazhagan Mahadevan and Michael Arock. 2020. Review rating prediction using combined latent topics and associated sentiments: An empirical review. Service Orient. Comput. Appl. 14, 1 (2020), 19–34.
[103]
Supriyo Mandal and Abyayananda Maiti. 2020. Explicit feedback meet with implicit feedback in GPMF: A generalized probabilistic matrix factorization model for recommendation. Appl. Intell. 50, 6 (2020).
[104]
R. Manikandan and V. Saravanan. 2019. A novel approach on particle agent swarm optimization (PASO) in semantic mining for web page recommender system of multimedia data: A health care perspective. Multimedia Tools Appl. 79, 5-6 (2019), 3807–3829.
[105]
Qiaozhu Mei, Jian Guo, and Dragomir Radev. 2010. DivRank: The interplay of prestige and diversity in information networks. In Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining. 1009–1018.
[106]
Yijun Mo, Bixi Li, Bang Wang, Laurence T. Yang, and Minghua Xu. 2018. Event recommendation in social networks based on reverse random walk and participant scale control. Future Gen. Comput. Syst. 79 (2018), 383–395.
[107]
Alistair Moffat and Justin Zobel. 2008. Rank-biased precision for measurement of retrieval effectiveness. ACM Trans. Info. Syst. 27, 1 (2008), 1–27.
[108]
Parham Moradi and Sajad Ahmadian. 2015. A reliability-based recommendation method to improve trust-aware recommender systems. Expert Syst. Appl. 42, 21 (2015), 7386–7398.
[109]
Gabriel De Souza P. Moreira, Dietmar Jannach, and Adilson Marques Da Cunha. 2019. Contextual hybrid session-based news recommendation with recurrent neural networks. IEEE Access 7 (2019), 169185–169203.
[110]
Cataldo Musto, Marco de Gemmis, Giovanni Semeraro, and Pasquale Lops. 2017. A multi-criteria recommender system exploiting aspect-based sentiment analysis of users’ Reviews. In Proceedings of the ACM Conference on Recommender Systems. 321–325.
[111]
Maryam Khanian Najafabadi, Azlinah Hj. Mohamed, and Mohd Naz’ri Mahrin. 2017. A survey on data mining techniques in recommender systems. Soft Comput. 23, 2 (2017), 627–654.
[112]
Felipe Neves, Fernanda Campos, Victor Stroele, Miriam A. M. Capretz, Morgan Jennings, Dianne Bryant, and Mario Dantas. 2020. Heath-PRIOR: An intelligent ensemble architecture to identify risk cases in healthcare. IEEE Access 8 (2020), 217150–217168.
[113]
Athanasios Nikolakopoulos and George Karypis. 2019. RecWalk: Nearly uncoupled random walks for top-N recommendation. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 150–158.
[114]
Ke Niu, Xiangyu Zhao, Fangfang Li, Ning Li, Xueping Peng, and Wei Chen. 2019. UTSP: User-based two-step recommendation with popularity normalization towards diversity and novelty. IEEE Access 7 (2019), 145426–145434.
[115]
Navya Sri Nizamkari. 2017. A graph-based trust-enhanced recommender system for service selection in IOT. In Proceedings of the International Conference on Inventive Systems and Control.
[116]
Tommaso Di Noia, Jessica Rosati, Paolo Tomeo, and Eugenio Di Sciascio. 2017. Adaptive multi-attribute diversity for recommender systems. Info. Sci. 382-383 (2017), 234–253.
[117]
Soroush Ojagh, Mohammad Reza Malek, Sara Saeedi, and Steve Liang. 2020. A location-based orientation-aware recommender system using IoT smart devices and social networks. Future Gen. Comput. Syst. 108 (2020), 97–118.
[118]
Sergio Oramas, Vito Claudio Ostuni, Tommaso Di Noia, Xavier Serra, and Eugenio Di Sciascio. 2017. Sound and music recommendation with knowledge graphs. ACM Trans. Intell. Syst. Technol. 8, 2 (2017), 1–21.
[119]
Mahmut Özge Karakaya and Tevfik Aytekin. 2017. Effective methods for increasing aggregate diversity in recommender systems. Knowl. Info. Syst. 56, 2 (2017), 355–372.
[120]
Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The Pagerank Citation Ranking: Bringing Order to the Web.Technical Report. Stanford InfoLab.
[121]
Yoon-Joo Park and Alexander Tuzhilin. 2008. The long tail of recommender systems and how to leverage it. In Proceedings of the ACM Conference on Recommender Systems. 11–18.
[122]
Hashem Parvin, Parham Moradi, Shahrokh Esmaeili, and Nooruldeen Nasih Qader. 2019. A scalable and robust trust-based nonnegative matrix factorization recommender using the alternating direction method. Knowl.-Based Syst. 166 (2019), 92–107.
[123]
Thi-Ngan Pham, Thi-Hong Vuong, Thi-Hoai Thai, Mai-Vu Tran, and Quang-Thuy Ha. 2016. Sentiment analysis and user similarity for social recommender system: An experimental study. In Lecture Notes in Electrical Engineering. 1147–1156.
[124]
Tu Minh Phuong, Do Thi Lien, and Nguyen Duy Phuong. 2019. Graph-based context-aware collaborative filtering. Expert Syst. Appl. 126 (2019), 9–19.
[125]
Ivens Portugal, Paulo Alencar, and Donald Cowan. 2018. The use of machine learning algorithms in recommender systems: A systematic review. Expert Syst. Appl. 97 (2018), 205–227.
[126]
Sandeep K. Raghuwanshi and R. K. Pateriya. 2019. Collaborative filtering techniques in recommendation systems. In Data, Engineering and Applications. Springer, Singapore, 11–21.
[127]
Kumar Raja and S. Pushpa. 2018. Novelty-driven recommendation by using integrated matrix factorization and temporal-aware clustering optimization. Int. J. Commun. Syst. 33, 13 (2018), e3851.
[128]
Morteza Rashidi, Ab Razak Che Hussin, and Mehrbakhsh Nilashi. 2015. Entropy-based ranking approach for enhancing diversity in tag-based community recommendation. J. Soft Comput. Decision Supp. Syst. 3, 1 (2015), 1–7.
[129]
Xiaolong Ren, Linyuan Lü, Runran Liu, and Jianlin Zhang. 2014. Avoiding congestion in recommender systems. New J. Phys. 16, 6 (2014), 063057.
[130]
Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor (Eds.). 2011. Recommender Systems Handbook. Springer US.
[131]
Abhaya Kumar Sahoo, Chittaranjan Pradhan, Rabindra Kumar Barik, and Harishchandra Dubey. 2019. DeepReco: Deep learning based health recommender system using collaborative filtering. Computation 7, 2 (2019), 25.
[132]
Rong-Ping Shen, Heng-Ru Zhang, Hong Yu, and Fan Min. 2019. Sentiment based matrix factorization with reliability for recommendation. Expert Syst. Appl. 135 (2019), 249–258.
[133]
Leily Sheugh and Sasan H. Alizadeh. 2018. A novel 2D-Graph clustering method based on trust and similarity measures to enhance accuracy and coverage in recommender systems. Info. Sci. 432 (2018), 210–230.
[134]
Thiago Silveira, Min Zhang, Xiao Lin, Yiqun Liu, and Shaoping Ma. 2017. How good your recommender system is? A survey on evaluations in recommendation. Int. J. Mach. Learn. Cybernet. 10, 5 (2017), 813–831.
[135]
Juyeon Son, Wonyoung Choi, and Sang-Min Choi. 2020. Trust information network in social Internet of things using trust-aware recommender systems. Int. J. Distrib. Sensor Netw. 16, 4 (2020), 155014772090877.
[136]
V. Subramaniyaswamy, Gunasekaran Manogaran, R. Logesh, V. Vijayakumar, Naveen Chilamkurti, D. Malathi, and N. Senthilselvan. 2019. An ontology-driven personalized food recommendation in IoT-based healthcare system. J. Supercomput. 75, 6 (2019), 3184–3216.
[137]
Lihua Sun, Junpeng Guo, and Yanlin Zhu. 2019. Applying uncertainty theory into the restaurant recommender system based on sentiment analysis of online Chinese reviews. World Wide Web 22, 1 (2019), 83–100.
[138]
Saúl Vargas, Linas Baltrunas, Alexandros Karatzoglou, and Pablo Castells. 2014. Coverage, redundancy and size-awareness in genre diversity for recommender systems. In Proceedings of the ACM Conference on Recommender systems. 209–216.
[139]
Saúl Vargas and Pablo Castells. 2011. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of the ACM Conference on Recommender Systems. 109–116.
[140]
Hao Wang, Yanmei Fu, Qinyong Wang, Hongzhi Yin, Changying Du, and Hui Xiong. 2017. A location-sentiment-aware recommender system for both home-town and out-of-town users. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
[141]
Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. RippleNet: Propagating user preferences on the knowledge graph for recommender systems. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management.
[142]
Shanfeng Wang, Maoguo Gong, Haoliang Li, and Junwei Yang. 2016. Multi-objective optimization for long tail recommendation. Knowl.-Based Syst. 104 (2016), 145–155.
[143]
Shanfeng Wang, Maoguo Gong, Yue Wu, and Mingyang Zhang. 2020. Multi-objective optimization for location-based and preferences-aware recommendation. Info. Sci. 513 (2020), 614–626.
[144]
Shoujin Wang, Liang Hu, Longbing Cao, Xiaoshui Huang, Defu Lian, and Wei Liu. 2018. Attention-based transactional context embedding for next-item recommendation. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence.
[145]
Shuai Wang, Chenchen Huang, Juanjuan Li, Yong Yuan, and Fei-Yue Wang. 2019. Decentralized construction of knowledge graphs for deep recommender systems based on blockchain-powered smart contracts. IEEE Access 7 (2019), 136951–136961.
[146]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.
[147]
Ximeng Wang, Yun Liu, and Fei Xiong. 2016. Improved personalized recommendation based on a similarity network. Physica A: Stat. Mech. Appl. 456 (2016), 271–280.
[148]
Ximeng Wang, Yun Liu, Guangquan Zhang, Fei Xiong, and Jie Lu. 2017. Diffusion-based recommendation with trust relations on tripartite graphs. J. Stat. Mech.: Theory Exper. 2017, 8 (2017), 083405.
[149]
Yibo Wang, Mingming Wang, and Wei Xu. 2018. A sentiment-enhanced hybrid recommender system for movie recommendation: A big data analytics framework. Wireless Commun. Mobile Comput. 2018 (2018), 1–9.
[150]
Jacek Wasilewski and Neil Hurley. 2016. Intent-aware diversification using a constrained PLSA. In Proceedings of the ACM Conference on Recommender Systems. 39–42.
[151]
Jian Wei, Jianhua He, Kai Chen, Yi Zhou, and Zuoyin Tang. 2017. Collaborative filtering and deep learning based recommendation system for cold start items. Expert Syst. Appl. 69 (2017), 29–39.
[152]
Hao Wu, Yijian Pei, Bo Li, Zongzhan Kang, Xiaoxin Liu, and Hao Li. 2015. Item recommendation in collaborative tagging systems via heuristic data fusion. Knowl.-Based Syst. 75 (2015), 124–140.
[153]
Hao Wu, Kun Yue, Yijian Pei, Bo Li, Yiji Zhao, and Fan Dong. 2016. Collaborative topic regression with social trust ensemble for recommendation in social media systems. Knowl.-Based Syst. 97 (2016), 111–122.
[154]
Wen Wu, Li Chen, and Yu Zhao. 2018. Personalizing recommendation diversity based on user personality. User Model. User-Adapt. Interact. 28, 3 (2018), 237–276.
[155]
Tian wu Zhang, Wei ping Li, Lu Wang, and Jie Yang. 2020. Social recommendation algorithm based on stochastic gradient matrix decomposition in social network. J. Ambient Intell. Hum. Comput. 11, 2 (2020), 601–608.
[156]
Feng Xie, Zhen Chen, Jiaxing Shang, Xiaoping Feng, and Jun Li. 2015. A link prediction approach for item recommendation with complex number. Knowl.-Based Syst. 81 (2015), 148–158.
[157]
Shiqi Yang, Ping Zhou, Kui Duan, M. Shamim Hossain, and Mohammed F. Alhamid. 2018. emHealth: Towards emotion health through depression prediction and intelligent health recommender system. Mobile Netw. Appl. 23, 2 (2018), 216–226.
[158]
Hafed Zarzour, Faiz Maazouzi, Mohamed Soltani, and Chaouki Chemam. 2018. An improved collaborative filtering recommendation algorithm for big data. In Computational Intelligence and Its Applications. Springer, 660–668.
[159]
ChengXiang Zhai, William W. Cohen, and John Lafferty. 2015. Beyond independent relevance: Methods and evaluation metrics for subtopic retrieval. ACM SIGIR Forum 49, 1 (2015), 2–9.
[160]
Chenyi Zhang, Hongwei Liang, and Ke Wang. 2016. Trip recommendation meets real-world constraints. ACM Trans. Info. Syst. 35, 1 (2016), 1–28.
[161]
Hong Zhang, Dechu Ge, and Siyu Zhang. 2017. Hybrid recommendation system based on semantic interest community and trusted neighbors. Multimedia Tools Appl. 77, 4 (2017), 4187–4202.
[162]
Mi Zhang and Neil Hurley. 2008. Avoiding monotony: Improving the diversity of recommendation lists. In Proceedings of the ACM Conference on Recommender systems. 123–130.
[163]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. Comput. Surveys 52, 1 (2019), 1–38.
[164]
Wen Zhang, Yuhang Du, Taketoshi Yoshida, and Ye Yang. 2019. DeepRec: A deep neural network approach to recommendation with item embedding and weighted loss function. Info. Sci. 470 (2019), 121–140.
[165]
Yi-Cheng Zhang, Marcel Blattner, and Yi-Kuo Yu. 2007. Heat conduction process on community networks as a recommendation model. Phys. Rev. Lett. 99, 15 (2007).
[166]
Zhu Zhang, Xiaolong Zheng, and Daniel Dajun Zeng. 2016. A framework for diversifying recommendation lists by user interest expansion. Knowledge-Based Syst. 105 (2016), 83–95.
[167]
Guoshuai Zhao, Xiaojiang Lei, Xueming Qian, and Tao Mei. 2019. Exploring users' internal influence from reviews for social recommendation. IEEE Trans. Multimedia 21, 3 (2019), 771–781.
[168]
Guanjie Zheng, Fuzheng Zhang, Zihan Zheng, Yang Xiang, Nicholas Jing Yuan, Xing Xie, and Zhenhui Li. 2018. DRN: A deep reinforcement learning framework for news recommendation. In Proceedings of the World Wide Web Conference.167–176.
[169]
Tao Zhou, Jie Ren, Matúš Medo, and Yi-Cheng Zhang. 2007. Bipartite network projection and personal recommendation. Phys. Rev. E 76, 4 (2007).
[170]
Cai-Nicolas Ziegler, Sean M. McNee, Joseph A. Konstan, and Georg Lausen. 2005. Improving recommendation lists through topic diversification. In Proceedings of the World Wide Web Conference.22–32.
[171]
Zainab Zolaktaf, Reza Babanezhad, and Rachel Pottinger. 2018. A generic top-N recommendation framework for trading-off accuracy, novelty, and coverage. In Proceedings of the IEEE 34th International Conference on Data Engineering.
[172]
Yi Zuo, Maoguo Gong, Jiulin Zeng, Lijia Ma, and Licheng Jiao. 2015. Personalized recommendation based on evolutionary multi-objective optimization [research frontier]. IEEE Comput. Intell. Mag. 10, 1 (2015), 52–62.

Cited By

View all
  • (2024)Emerging Perspectives on the Application of Recommender Systems in Smart CitiesElectronics10.3390/electronics1307124913:7(1249)Online publication date: 27-Mar-2024
  • (2024)Exploring the Landscape of Recommender Systems Evaluation: Practices and PerspectivesACM Transactions on Recommender Systems10.1145/36291702:1(1-31)Online publication date: 7-Mar-2024
  • (2024)Modeling User Fatigue for Sequential RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657802(996-1005)Online publication date: 10-Jul-2024
  • Show More Cited By

Index Terms

  1. Survey on the Objectives of Recommender Systems: Measures, Solutions, Evaluation Methodology, and New Perspectives

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Computing Surveys
    ACM Computing Surveys  Volume 55, Issue 5
    May 2023
    810 pages
    ISSN:0360-0300
    EISSN:1557-7341
    DOI:10.1145/3567470
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 03 December 2022
    Online AM: 31 March 2022
    Accepted: 16 March 2022
    Revised: 20 November 2021
    Received: 16 December 2020
    Published in CSUR Volume 55, Issue 5

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Recommender system
    2. evaluation measures
    3. diversity
    4. novelty
    5. coverage
    6. serendipity

    Qualifiers

    • Survey
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)645
    • Downloads (Last 6 weeks)50
    Reflects downloads up to 14 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Emerging Perspectives on the Application of Recommender Systems in Smart CitiesElectronics10.3390/electronics1307124913:7(1249)Online publication date: 27-Mar-2024
    • (2024)Exploring the Landscape of Recommender Systems Evaluation: Practices and PerspectivesACM Transactions on Recommender Systems10.1145/36291702:1(1-31)Online publication date: 7-Mar-2024
    • (2024)Modeling User Fatigue for Sequential RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657802(996-1005)Online publication date: 10-Jul-2024
    • (2024)Recommender Systems in the Era of Large Language Models (LLMs)IEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.339233536:11(6889-6907)Online publication date: Nov-2024
    • (2024)Individual Persistence Adaptation for User-Centric Evaluation of User Satisfaction in Recommender SystemsIEEE Access10.1109/ACCESS.2024.336069312(23626-23635)Online publication date: 2024
    • (2024)Exploring the impacts of a recommendation system on an e-platform based on consumers’ online behavioral dataInformation and Management10.1016/j.im.2023.10390561:2Online publication date: 25-Jun-2024
    • (2024)Target-driven user preference transferring recommendationExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121773238:PBOnline publication date: 27-Feb-2024
    • (2024)Economic recommender systems – a systematic reviewElectronic Commerce Research and Applications10.1016/j.elerap.2023.10135263:COnline publication date: 17-Apr-2024
    • (2024)Sports recommender systems: overview and research directionsJournal of Intelligent Information Systems10.1007/s10844-024-00857-w62:4(1125-1164)Online publication date: 1-Aug-2024
    • (2023)The Influence of Social Stratification on Trust in Recommender SystemsElectronics10.3390/electronics1210216012:10(2160)Online publication date: 9-May-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media