Just Accepted
A DQN-based traffic classification method for mobile application recommendation with continual learning
Authors: 
ZiXuan Wang, Pan Wang, ZhiXin Sun, Lu Chen, MengYi Fu, MinYao Liu, Ze ZhangAuthors Info & Claims
ZiXuan Wang, Pan Wang, ZhiXin Sun, Lu Chen, MengYi Fu, MinYao Liu, Ze ZhangAuthors Info & ClaimsAbstract
With the popularity and development of smartphones, many mobile applications of various types have emerged. How to recommend mobile applications that match the user’s preferences and usage habits among the massive applications is a problem that needs to be solved. Traditional mobile application recommendation methods cannot dynamically track user behavior and preference changes in time and cannot timely correct the recommendation model, resulting in poor recommendation effects. The continual update of mobile applications will also invalidate the recommendation model based on traffic classification. To solve these problems, this paper proposes A Deep Q-Network (DQN) based traffic classification method for mobile application recommendation with continual learning, which embeds a DQN-based traffic classification model in the mobile terminal and sets up a reward and punishment mechanism to achieve self-supervised learning. By continuously adjusting and optimizing the model, the effectiveness of the traffic classification model is ensured, and the recommendation model is provided with accurate and reliable user behavior data support. Experiments on the ISCX and private datasets show that the proposed method performs better and can effectively guarantee the accuracy of the classification model.
References
[1]
M Mehdi Afsar, Trafford Crump, and Behrouz Far. 2022. Reinforcement learning based recommender systems: A survey. Comput. Surveys 55, 7 (2022), 1–38.
[2]
M Mehdi Afsar, Trafford Crump, and Behrouz Far. 2022. Reinforcement learning based recommender systems: A survey. Comput. Surveys 55, 7 (2022), 1–38.
[3]
Supriya Agrahari and Anil Kumar Singh. 2022. Concept drift detection in data stream mining: A literature review. Journal of King Saud University-Computer and Information Sciences 34, 10(2022), 9523–9540.
[4]
Rahaf Aljundi, Marcus Rohrbach, and Tinne Tuytelaars. 2018. Selfless sequential learning. arXiv preprint arXiv:1806.05421(2018).
[5]
Marc G Bellemare, Yavar Naddaf, Joel Veness, and Michael Bowling. 2013. The arcade learning environment: An evaluation platform for general agents. Journal of Artificial Intelligence Research 47 (2013), 253–279.
[6]
Jing Chen and Wenjun Jiang. 2019. Context-aware personalized POI sequence recommendation. In Smart City and Informatization: 7th International Conference, iSCI 2019, Guangzhou, China, November 12–15, 2019, Proceedings 7. Springer, 197–210.
[7]
Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Aleš Leonardis, Gregory Slabaugh, and Tinne Tuytelaars. 2021. A continual learning survey: Defying forgetting in classification tasks. IEEE transactions on pattern analysis and machine intelligence 44, 7(2021), 3366–3385.
[8]
Mohsen Jamali and Martin Ester. 2009. Trustwalker: a random walk model for combining trust-based and item-based recommendation. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining. 397–406.
[9]
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences 114, 13(2017), 3521–3526.
[10]
Marios Kokkodis and Panagiotis G Ipeirotis. 2021. Demand-aware career path recommendations: A reinforcement learning approach. Management Science 67, 7 (2021), 4362–4383.
[11]
Zefang Liu, Shuran Wen, and Yinzhu Quan. 2021. Deep reinforcement learning based group recommender system. arXiv preprint arXiv:2106.06900(2021).
[12]
David Lopez-Paz and Marc’Aurelio Ranzato. 2017. Gradient episodic memory for continual learning. Advances in neural information processing systems 30 (2017).
[13]
Chencheng Ma, Xuehui Du, and Lifeng Cao. 2020. Improved KNN algorithm for fine-grained classification of encrypted network flow. Electronics 9, 2 (2020), 324.
[14]
German I Parisi, Ronald Kemker, Jose L Part, Christopher Kanan, and Stefan Wermter. 2019. Continual lifelong learning with neural networks: A review. Neural networks 113(2019), 54–71.
[15]
Iman Sharafaldin, Arash Habibi Lashkari, and Ali A Ghorbani. 2018. Toward generating a new intrusion detection dataset and intrusion traffic characterization.ICISSp 1(2018), 108–116.
[16]
Jan Van Balen and Bart Goethals. 2021. High-dimensional sparse embeddings for collaborative filtering. In Proceedings of the Web Conference 2021. 575–581.
[17]
Gido M Van de Ven and Andreas S Tolias. 2018. Generative replay with feedback connections as a general strategy for continual learning. arXiv preprint arXiv:1809.10635(2018).
[18]
Katrien Verbert, Nikos Manouselis, Xavier Ochoa, Martin Wolpers, Hendrik Drachsler, Ivana Bosnic, and Erik Duval. 2012. Context-aware recommender systems for learning: a survey and future challenges. IEEE transactions on learning technologies 5, 4 (2012), 318–335.
[19]
Donghui Wang, Yanchun Liang, Dong Xu, Xiaoyue Feng, and Renchu Guan. 2018. A content-based recommender system for computer science publications. Knowledge-Based Systems 157 (2018), 1–9.
[20]
Pan Wang, Feng Ye, Xuejiao Chen, and Yi Qian. 2018. Datanet: Deep learning based encrypted network traffic classification in sdn home gateway. IEEE Access 6(2018), 55380–55391.
[21]
Yu Wang. 2020. A hybrid recommendation for music based on reinforcement learning. In Advances in Knowledge Discovery and Data Mining: 24th Pacific-Asia Conference, PAKDD 2020, Singapore, May 11–14, 2020, Proceedings, Part I 24. Springer, 91–103.
[22]
Teng Xiao and Donglin Wang. 2021. A general offline reinforcement learning framework for interactive recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 4512–4520.
[23]
Ruixi Yuan, Zhu Li, Xiaohong Guan, and Li Xu. 2010. An SVM-based machine learning method for accurate internet traffic classification. Information Systems Frontiers 12 (2010), 149–156.
[24]
Sultan Zavrak and Murat İskefiyeli. 2020. Anomaly-based intrusion detection from network flow features using variational autoencoder. IEEE Access 8(2020), 108346–108358.
[25]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR) 52, 1 (2019), 1–38.
[26]
Shuai Zhang, Lina Yao, Yi Tay, Xiwei Xu, Xiang Zhang, and Liming Zhu. 2018. Metric factorization: Recommendation beyond matrix factorization. arXiv preprint arXiv:1802.04606(2018).
[27]
Hengshu Zhu, Hui Xiong, Yong Ge, and Enhong Chen. 2014. Discovery of ranking fraud for mobile apps. IEEE Transactions on knowledge and data engineering 27, 1(2014), 74–87.
Recommendations
Network Traffic Classification Using Deep Learning Networks and Bayesian Data Fusion
AbstractThe rapid growth of current computer networks and their applications has made network traffic classification more important. The latest approach in this field is the use of deep learning. But the problem of deep learning is that it needs a lot of ...
Learning for accurate classification of real-time traffic
CoNEXT '06: Proceedings of the 2006 ACM CoNEXT conferenceAccurate network traffic classification is an important task. We intend to develop an intelligent classification system by learning the types of service inside a network flow using machine learning techniques. Previous work used Bayesian methods for ...
Traffic classification using deep learning: being highly accurate is not enough
SIGCOMM '20: Proceedings of the SIGCOMM '20 Poster and Demo SessionsAs Deep Learning (DL) algorithms have rapidly become a methodology of choice in various domains, they have recently entered also the field of the Internet traffic classification, successfully demonstrating impressive results. Most of the research work up ...
Comments
Information & Contributors
Information
Published In
EISSN:2770-6699
Table of ContentsCopyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Online AM: 16 April 2024
Accepted: 26 March 2024
Revised: 03 March 2024
Received: 30 August 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 208Total Downloads
- Downloads (Last 12 months)208
- Downloads (Last 6 weeks)55
Reflects downloads up to 21 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in