Abstract
Along with the development of mobile network communication standards to the fifth generation, the complexity of network usage patterns has increased. The concept of network slicing is proposed to improve the utilization rate of network and computing resources, and to provide corresponding service quality for different network applications. In this paper, we propose a self-adaptive quality of service (QoS) management system which can be added to the 5G core network architecture, using network usage behavior and service level agreements (SLA) to generate corresponding QoS marking rules and enhance 5G core networks’ QoS mechanism. In response to the fact that user behavior changes over time, our system leverages deep reinforcement learning methods to dynamically generate QoS marking rules based on user behavior. In terms of experiments, we use a NS-3 network simulator to initially validate the system and observe that, as the training progresses, the measured network QoS KPIs of users become closer to the SLA.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Khan, B. S., Jangsher, S., Ahmed, A., & Al-Dweik, A. (2022). URLLC and eMBB in 5G Industrial IoT: A survey. IEEE Open Journal of the Communications Society, 3, 1134–1163. https://doi.org/10.1109/OJCOMS.2022.3189013
Pokhrel, S. R., Ding, J., Park, J., Park, O.-S., & Choi, J. (2020). Towards enabling critical mMTC: A review of URLLC within mMTC. IEEE Access, 8, 131796–131813. https://doi.org/10.1109/ACCESS.2020.3010271
Wijethilaka, S., & Liyanage, M. (2021). Survey on network slicing for Internet of Things realization in 5G networks. IEEE Communications Surveys & Tutorials, 23(2), 957–994. https://doi.org/10.1109/COMST.2021.3067807
Navarro-Ortiz, J., Romero-Diaz, P., Sendra, S., Ameigeiras, P., Ramos-Munoz, J. J., & Lopez-Soler, J. M. (2020). A survey on 5G usage scenarios and traffic models. IEEE Communications Surveys & Tutorials, 22(2), 905–929. https://doi.org/10.1109/COMST.2020.2971781
Chandrasekaran, B. (2006). Survey of network TrafficModels. Technical report, Computer Science & Engineering Department, McKelvey School of Engineering. https://www.cse.wustl.edu/~jain/cse567-06/ftp/traffic_models3/index.html
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D. and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. https://doi.org/10.48550/arXiv.1312.5602.
T. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D. and Wierstra, D. (2015).Continuous control with deep reinforcement learning. https://doi.org/10.48550/arXiv.1509.02971.
Shen, Z., Yang, K., Xi, Z., Zou, J., & Du, W. (2021). DeepAPP: A deep reinforcement learningframework for mobile application usageprediction. IEEE Transactions on Mobile Computing. https://doi.org/10.1109/TMC.2021.3093619
5G; System architecture for the 5G System (5GS) (3GPP TS 23.501 version 16.6.0 Release 16). (2020). ETSI. https://www.etsi.org/deliver/etsi_ts/123500_123599/123501/16.06.00_60/ts_123501v160600p.pdf
LTE; 5G; Interface between the control plane and the user plane nodes (3GPP TS 29.244 version 16.5.0 Release 16). (2020). ETSI. https://www.etsi.org/deliver/etsi_ts/129200_129299/129244/16.05.00_60/ts_129244v160500p.pdf
Network Functions Virtualisation (NFV) Release 3; Evolution and Ecosystem; Report on Network Slicing Support with ETSI NFV Architecture Framework. (2017). ETSI. https://www.etsi.org/deliver/etsi_gr/NFV-EVE/001_099/012/03.01.01_60/gr_nfv-eve012v030101p.pdf
Singh, M. K., Vittal, S., and Franklin, A. A. (2020). SERENS: Self regulating network slicing in 5G for efficient resource utilization. In Proceedings of the 2020 IEEE 3rd 5G World Forum (5GWF).
Abbas, K., Khan, T. A., Afaq, M., & Song, W.-C. (2021). Network slice lifecycle management for 5G mobile networks: An intent-based networking approach. IEEE Access. https://doi.org/10.1109/ACCESS.2021.3084834.
A. Thantharate, R. Paropkari, V. Walunj, and C. Beard, (2019). "DeepSlice: A Deep Learning Approach towards an Efficient and Reliable Network Slicing in 5G Networks," In Presented at the 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).
Chinchali, S., Hu, P., Chu, T., Sharma, M., Bansal, M., Misra, R., Pavone, M., & Katti, S. (2018). Cellular network traffic scheduling with deep reinforcement learning, In Proceedings of the AAAI Conference on Artificial Intelligence. https://doi.org/10.1609/aaai.v32i1.11339.
Wang, J., Xu, C., Huangfu, Y., Li, R., Ge, Y., and Wang, J. (2019). Deep reinforcement learning for scheduling in cellular networks. https://doi.org/10.48550/arXiv.1905.05914.
Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., and Tuytelaars, T. (2018). Memory aware synapses: Learning what (not) to forget, arXiv:1711.09601v4.
Aminikhanghahi, S., Wang, T., & Cook, D. J. (2018). Real-Time change point detectionwith application to smart home time series data. IEEE Transactions on Knowledge and Data Engineering, 31, 1010.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Cheng, ST., He, C.Y., Lyu, YJ. et al. On self-adaptive 5G network slice QoS management system: a deep reinforcement learning approach. Wireless Netw 29, 1269–1279 (2023). https://doi.org/10.1007/s11276-022-03181-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-022-03181-9