Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3579895.3579924acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicnccConference Proceedingsconference-collections
research-article

Research on Intelligent Routing Technology Based on Improved DQN

Published: 04 April 2023 Publication History

Abstract

With the rise of artificial intelligence, intelligent routing technology has become a research hotspot in the current academic circles. In view of the problems of poor load balancing ability of traditional routing algorithms and difficulty in guaranteeing quality of service (QoS), this paper proposes an intelligent routing algorithm DQN-Route based on deep reinforcement learning (DRL). The algorithm adopts the deep Q network (DQN) as the training framework, and introduces the convolutional neural network (CNN) as the neural network. Based on the algorithm advantages of DQN processing continuous state space, as well as the local perception and parameter sharing capabilities of CNN, we can input the dynamically changing network state into the neural network for training. After the algorithm training converges, the action value output by the neural network is used as the network link weight to realize the dynamic adjustment of the routing strategy. Finally, the DQN-Route routing algorithm is compared with the OSPF, ECMP and Q-Learning routing algorithms respectively. The results show that the DQN-Route has better convergence, and compared with the Q-Learning routing algorithm, DQN-Route reduces the delay by 14.13%, increases the throughput by 11.34%, and reduces the packet loss rate by 9.17%.

References

[1]
Huang Wanwei, Zheng Xiangyu, Zhang Chaoqin, Wang Sunan, Zhang Xiaohui. Research on intelligent routing technology based on deep reinforcement learning [J/OL]. Journal of Zhengzhou University (Engineering Edition): 1-8[2022-07-20].DOI :10.13705/j.issn.1671-6833.2022.04.018.
[2]
Alidadi A, Arab S, Askari T . A novel optimized routing algorithm for QoS traffic engineering in SDN-based mobile networks[J]. ICT Express, 2021.
[3]
YAN R, LIU R. Principal component analysis based network traffic classification[J]. Journal of computers, 2014, 9(5): 1234-1240.
[4]
Nei, Kato, Zubair, The Deep Learning Vision for Heterogeneous Network Traffic Control: Proposal, Challenges, and Future Perspective[J]. IEEE Wireless Communications, 2017.
[5]
Tang Xin, Xu Yanyan, Pan Shaoming. Intelligent routing algorithm based on graph convolutional neural network [J]. Computer Engineering, 2022, 48(03): 38-45. j.issn.1000-3428. 0060768.
[6]
Chen Ke. Research on network traffic scheduling of SDN data center based on machine learning [D]. North China University of Technology, 2020.
[7]
Almasan P, José Suárez-Varela, Badia-Sampera A, Deep Reinforcement Learning meets Graph Neural Networks: exploring a routing optimization use case[J]. 2019.
[8]
Zheng X, Huang W, Wang S, Research on Energy-Saving Routing Technology Based on Deep Reinforcement Learning[J]. Electronics, 2022, 11(13): 2035.
[9]
Xiaodong, Yuan Haitao, Bi Jing, Ship path planning and simulation in naval battlefield based on DQN [J]. Journal of System Simulation, 2021, 33(10):2440-2448.
[10]
Alom M Z, Taha T M, Yakopcic C, A State-of-the-Art Survey on Deep Learning Theory and Architectures[J]. Electronics, 2019, 8(3).
[11]
Lv L, Zhang S, Ding D, Path planning via an improved DQN-based learning policy[J]. IEEE Access, 2019, 7: 67319-67330.
[12]
De Oliveira R L S, Schweitzer C M, Shinoda A A, Using mininet for emulation and prototyping software-defined networks[C]//2014 IEEE Colombian conference on communications and computing (COLCOM). IEEE, 2014: 1-6.
[13]
Li Y, Pan D. OpenFlow based load balancing for fat-tree networks with multipath support[C]//Proc. 12th ieee international conference on communications (icc’13), Budapest, Hungary. 2013: 1-5.
[14]
Manzoor A, Hussain M, Mehrban S. Performance analysis and route optimization: redistribution between EIGRP, OSPF & BGP routing protocols[J]. Computer Standards & Interfaces, 2020, 68: 103391.
[15]
Hiryanto L, Soh S, Chin K W, Green multi-stage upgrade for bundled-links SDN/OSPF-ECMP networks[C]//ICC 2021-IEEE International Conference on Communications. IEEE, 2021: 1-7.

Index Terms

  1. Research on Intelligent Routing Technology Based on Improved DQN
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Other conferences
          ICNCC '22: Proceedings of the 2022 11th International Conference on Networks, Communication and Computing
          December 2022
          365 pages
          ISBN:9781450398039
          DOI:10.1145/3579895
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 04 April 2023

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. Deep Q network
          2. Quality of service
          3. Software-defined network
          4. deep reinforcement learning

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Funding Sources

          • 1. National Natural Science Foundation of China
          • ostgraduate Education Reform and Quality Improvement Project of Henan Province
          • 2. National Natural Science Foundation of China
          • 2. Project of Science and Technology in Henan Province
          • 1. Project of Science and Technology in Henan Province

          Conference

          ICNCC 2022

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 39
            Total Downloads
          • Downloads (Last 12 months)22
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 26 Sep 2024

          Other Metrics

          Citations

          View Options

          Get Access

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media