Wavelet-Enhanced Graph Neural Networks: Towards Non-Parametric Network Traffic Modeling
Authors: 
Carlos Güemes-Palau, Miquel Ferriol-Galmés, Jordi Paillisse-Vilanova, Albert López-Brescó, Pere Barlet-Ros, Albert Cabellos-AparicioAuthors Info & Claims
Carlos Güemes-Palau, Miquel Ferriol-Galmés, Jordi Paillisse-Vilanova, Albert López-Brescó, Pere Barlet-Ros, Albert Cabellos-AparicioAuthors Info & ClaimsPages 14 - 19
Abstract
Network modeling is crucial for the design, management, and optimization of modern telecommunications and data networks. Recent advancements in Machine Learning (ML), specifically Graph Neural Networks (GNNs), offer promising solutions but rely on parameterized traffic representations, necessitating retraining for new traffic patterns. This paper explores integrating the Discrete Wavelet Transform (DWT) with GNNs to enhance network traffic modeling. By leveraging wavelets, which decompose signals into both time and frequency components, we aim to encode traffic patterns without assuming specific distributions, improving model adaptability and accuracy. We modify the state-of-the-art RouteNet-Fermi model to incorporate wavelet-based traffic encoding and evaluate its performance across different synthetic and real traffic scenarios. Our findings show that wavelet-based encoding handles unseen traffic distributions with minimal impact on performance, unlike traditional parameter-based approaches. This work represents a step forward in bridging the gap between non-parametric traffic representation and advanced network modeling, offering a promising solution for dynamic and complex network environments.
References
[1]
Martín Abadi et al. 2016. TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). USENIX Association, Savannah, GA, 265--283. https://www.usenix. org/conference/osdi16/technical-sessions/presentation/abadi
[2]
Mina Tahmasbi Arashloo, Ryan Beckett, and Rachit Agarwal. 2023. Formal methods for network performance analysis. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). 645--661.
[3]
G. Beylkin, R. Coifman, and V. Rokhlin. 1991. Fast wavelet transforms and numerical algorithms I. Communications on Pure and Applied Mathematics 44, 2 (1991), 141--183. https://doi.org/10.1002/cpa.3160440202 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/cpa.3160440202
[4]
Peter Bodík, Ishai Menache, Mosharaf Chowdhury, Pradeepkumar Mani, David A. Maltz, and Ion Stoica. 2012. Surviving failures in bandwidth-constrained datacenters. SIGCOMM Comput. Commun. Rev. 42, 4 (aug 2012), 431--442. https: //doi.org/10.1145/2377677.2377760
[5]
Amit Chaurasia, Vijay Shankar Sharma, Chiranji Lal Chowdhary, Shakila Basheer, and Thippa Reddy Gadekallu. 2023. Non-Gaussian Traffic Modeling for Multicore Architecture Using Wavelet Based Rosenblatt Process. IEEE Access 11 (2023), 38523--38533. https://doi.org/10.1109/ACCESS.2023.3265572
[6]
Li Chen, Justinas Lingys, Kai Chen, and Feng Liu. 2018. AuTO: Scaling Deep Reinforcement Learning for Datacenter-Scale Automatic Traffic Optimization. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (Budapest, Hungary) (SIGCOMM '18). Association for Computing Machinery, New York, NY, USA, 191--205. https://doi.org/10.1145/3230543.3230551
[7]
Kenjiro Cho, Koushirou Mitsuya, and Akira Kato. 2000. Traffic data repository at the WIDE project. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (San Diego, California) (ATEC 00). USENIX Association, USA, 51.
[8]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014).
[9]
Zhiyong Cui, Ruimin Ke, Ziyuan Pu, Xiaolei Ma, and YinhaiWang. 2020. Learning traffic as a graph: A gated graph wavelet recurrent neural network for networkscale traffic prediction. Transportation Research Part C: Emerging Technologies 115 (2020), 102620. https://doi.org/10.1016/j.trc.2020.102620
[10]
Ingrid Daubechies. 1988. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics 41, 7 (1988), 909--996. https://doi.org/10.1002/cpa.3160410705 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/cpa.3160410705
[11]
I. Daubechies. 1990. The wavelet transform, time-frequency localization and signal analysis. IEEE Transactions on Information Theory 36, 5 (1990), 961--1005. https://doi.org/10.1109/18.57199
[12]
Miquel Ferriol-Galmés, Krzysztof Rusek, José Suárez-Varela, Shihan Xiao, Xiang Shi, Xiangle Cheng, Bo Wu, Pere Barlet-Ros, and Albert Cabellos-Aparicio. 2022. Routenet-erlang: A graph neural network for network performance evaluation. In IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE, 2018--2027.
[13]
Miquel Ferriol-Galmés, Jordi Paillisse, José Suárez-Varela, Krzysztof Rusek, Shihan Xiao, Xiang Shi, Xiangle Cheng, Pere Barlet-Ros, and Albert Cabellos-Aparicio. 2022. RouteNet-Fermi: Network Modeling with Graph Neural Networks. arXiv:2212.12070 [cs.NI]
[14]
D. Gabor. 1946. Theory of communication. Part 1: The analysis of information. Journal of the Institution of Electrical Engineers - Part III: Radio and Communication Engineering 93 (November 1946), 429--441(12). Issue 26. https://digital-library. theiet.org/content/journals/10.1049/ji-3--2.1946.0074
[15]
Kaihui Gao, Li Chen, Dan Li, Vincent Liu, Xizheng Wang, Ran Zhang, and Lu Lu. 2023. DONS: Fast and Affordable Discrete Event Network Simulation with Automatic Parallelization. In Proceedings of the ACM SIGCOMM 2023 Conference (New York, NY, USA) (ACM SIGCOMM 23). Association for Computing Machinery, New York, NY, USA, 167--181. https://doi.org/10.1145/3603269.3604844
[16]
P. Goupillaud, A. Grossmann, and J. Morlet. 1984. Cycle-octave and related transforms in seismic signal analysis. Geoexploration 23, 1 (1984), 85--102. https://doi.org/10.1016/0016--7142(84)90025--5 Seismic Signal Analysis and Discrimination III.
[17]
Vu Dang Hoang. 2014. Wavelet-based spectral analysis. TrAC Trends in Analytical Chemistry 62 (2014), 144--153. https://doi.org/10.1016/j.trac.2014.07.010
[18]
Benedikt Jaeger, Max Helm, Lars Schwegmann, and Georg Carle. 2022. Modeling TCP performance using graph neural networks. In Proceedings of the 1st International Workshop on Graph Neural Networking (Rome, Italy) (GNNet 22). Association for Computing Machinery, New York, NY, USA, 18--23. https://doi.org/10.1145/3565473.3569190
[19]
Gregory R. Lee, Ralf Gommers, Filip Waselewski, Kai Wohlfahrt, and Aaron O'Leary. 2019. PyWavelets: A Python package for wavelet analysis. Journal of Open Source Software 4, 36 (2019), 1237. https://doi.org/10.21105/joss.01237
[20]
Sheng Ma and Chuanyi Ji. 2001. Modeling heterogeneous network traffic in wavelet domain. IEEE/ACM Transactions on Networking 9, 5 (2001), 634--649. https://doi.org/10.1109/90.958331
[21]
Rishabh Madan and Partha Sarathi Mangipudi. 2018. Predicting Computer Network Traffic: A Time Series Forecasting Approach Using DWT, ARIMA and RNN. In 2018 Eleventh International Conference on Contemporary Computing (IC3). 1--5. https://doi.org/10.1109/IC3.2018.8530608
[22]
S.G. Mallat. 1989. A theory for multiresolution signal decomposition: the wavelet representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 11, 7 (1989), 674--693. https://doi.org/10.1109/34.192463
[23]
J.C. Neumann. 2015. The Book of GNS3: Build Virtual Network Labs Using Cisco, Juniper, and More. No Starch Press. https://books.google.es/books?id= 9wcvDwAAQBAJ
[24]
J Popoola and RA Ipinyomi. 2017. Empirical performance of weibull self-similar tele-traffic model. International Journal of Engineering and Applied Sciences 4, 8 (2017), 257389.
[25]
Majid Rabbani and Rajan Joshi. 2002. An overview of the JPEG 2000 still image compression standard. Signal Processing: Image Communication 17, 1 (2002), 3--48. https://doi.org/10.1016/S0923--5965(01)00024--8 JPEG 2000.
[26]
Thomas G Robertazzi. 2000. Computer networks and systems: queueing theory and performance evaluation. Springer Science & Business Media.
[27]
Sajal Saha and Anwar Haque. 2023. Wavelet-Based Hybrid Machine Learning Model for Out-of-distribution Internet Traffic Prediction. In NOMS 2023--2023 IEEE/IFIP Network Operations and Management Symposium. 1--8. https://doi.org/ 10.1109/NOMS56928.2023.10154337
[28]
Sajal Saha, Moinul Islam Sayed, and Anwar Haque. 2023. Empirical Mode Decomposition and StationaryWavelet Transformation in Internet Traffic Prediction. In IEEE INFOCOM 2023 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 1--6. https://doi.org/10.1109/INFOCOMWKSHPS57453. 2023.10226162
[29]
Mallat Stéphane. 2009. CHAPTER 7 - Wavelet Bases. In A Wavelet Tour of Signal Processing (Third Edition) (third edition ed.), Mallat Stéphane (Ed.). Academic Press, Boston, 263--376. https://doi.org/10.1016/B978-0--12--374370--1.00011--2
[30]
Andras Varga. 2019. A Practical Introduction to the OMNeT Simulation Framework. Springer International Publishing, Cham, 3--51. https://doi.org/10.1007/ 978--3-030--12842--5_1
[31]
Michael Welzl. 2005. Network congestion control: managing internet traffic. John Wiley & Sons.
[32]
Zhiyuan Xu et al. 2018. Experience-driven networking: A deep reinforcement learning based approach. In IEEE INFOCOM. 1871--1879.
[33]
Qingqing Yang, Xi Peng, Li Chen, Libin Liu, Jingze Zhang, Hong Xu, Baochun Li, and Gong Zhang. 2022. DeepQueueNet: Towards Scalable and Generalized Network Performance Estimation with Packet-Level Visibility. In Proceedings of the ACM SIGCOMM 2022 Conference (Amsterdam, Netherlands) (SIGCOMM 22). Association for Computing Machinery, New York, NY, USA, 441--457. https: //doi.org/10.1145/3544216.3544248
[34]
Kun Zhang, Yinping Chai, and Xing-an Fu. 2012. A network traffic prediction model based on recurrent wavelet neural network. In Proceedings of 2012 2nd International Conference on Computer Science and Network Technology. 1630--1633. https://doi.org/10.1109/ICCSNT.2012.6526232
[35]
Qinghua Zhang and Albert Benveniste. 1992. Wavelet networks. IEEE transactions on Neural Networks 3, 6 (1992), 889--898.
Index Terms
- Wavelet-Enhanced Graph Neural Networks: Towards Non-Parametric Network Traffic Modeling
Recommendations
Multiresolution FIR neural-network-based learning algorithm applied to network traffic prediction
In this paper, a multiresolution finite-impulse-response (FIR) neural-network-based learning algorithm using the maximal overlap discrete wavelet transform (MODWT) is proposed. The multiresolution learning algorithm employs the analysis framework of ...
TBA-GNN: A Traffic Behavior Analysis Model with Graph Neural Networks for Malicious Traffic Detection
Wireless Artificial Intelligent Computing Systems and ApplicationsAbstractGiven the surge in network attack behavior, detecting malicious traffic has become a pivotal cybersecurity task. Many existing methods for malicious traffic detection rely on machine learning and deep learning, but they exhibit certain ...
Research on improved wavelet convolutional wavelet neural networks
AbstractConvolutional neural network (CNN) is recognized as state of the art of deep learning algorithm, which has a good ability on the image classification and recognition. The problems of CNN are as follows: the precision, accuracy and efficiency of ...
Comments
Information & Contributors
Information
Published In
December 2024
58 pages
ISBN:9798400712548
DOI:10.1145/3694811
- General Chairs:
- Pere Barlet-Ros,
- Pedro Casas,
- Franco Scarselli,
- José Suárez-Varela,
- Albert Cabellos
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
CoNEXT '24
Sponsor:
CoNEXT '24: The 20th International Conference on emerging Networking EXperiments and Technologies
December 9 - 12, 2024
CA, Los Angeles, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 57Total Downloads
- Downloads (Last 12 months)57
- Downloads (Last 6 weeks)16
Reflects downloads up to 03 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in