-
Multi-Task Learning to Enhance Generalizability of Neural Network Equalizers in Coherent Optical Systems
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Ashraful Alam,
Nelson Costa,
Bernhard Spinnler,
Antonio Napoli,
Egor Sedov,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance.
For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance.
△ Less
Submitted 3 November, 2023; v1 submitted 4 July, 2023;
originally announced July 2023.
-
Hardware Realization of Nonlinear Activation Functions for NN-based Optical Equalizers
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Antonio Napoli,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model.
To reduce the complexity of the hardware implementation of neural network-based optical channel equalizers, we demonstrate that the performance of the biLSTM equalizer with approximated activation functions is close to that of the original model.
△ Less
Submitted 16 May, 2023;
originally announced May 2023.
-
Implementing Neural Network-Based Equalizers in a Coherent Optical Transmission System Using Field-Programmable Gate Arrays
Authors:
Pedro J. Freire,
Sasipim Srivallapanondh,
Michael Anderson,
Bernhard Spinnler,
Thomas Bex,
Tobias A. Eriksson,
Antonio Napoli,
Wolfgang Schairer,
Nelson Costa,
Michaela Blott,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardwa…
▽ More
In this work, we demonstrate the offline FPGA realization of both recurrent and feedforward neural network (NN)-based equalizers for nonlinearity compensation in coherent optical transmission systems. First, we present a realization pipeline showing the conversion of the models from Python libraries to the FPGA chip synthesis and implementation. Then, we review the main alternatives for the hardware implementation of nonlinear activation functions. The main results are divided into three parts: a performance comparison, an analysis of how activation functions are implemented, and a report on the complexity of the hardware. The performance in Q-factor is presented for the cases of bidirectional long-short-term memory coupled with convolutional NN (biLSTM + CNN) equalizer, CNN equalizer, and standard 1-StpS digital back-propagation (DBP) for the simulation and experiment propagation of a single channel dual-polarization (SC-DP) 16QAM at 34 GBd along 17x70km of LEAF. The biLSTM+CNN equalizer provides a similar result to DBP and a 1.7 dB Q-factor gain compared with the chromatic dispersion compensation baseline in the experimental dataset. After that, we assess the Q-factor and the impact of hardware utilization when approximating the activation functions of NN using Taylor series, piecewise linear, and look-up table (LUT) approximations. We also show how to mitigate the approximation errors with extra training and provide some insights into possible gradient problems in the LUT approximation. Finally, to evaluate the complexity of hardware implementation to achieve 200G and 400G throughput, fixed-point NN-based equalizers with approximated activation functions are developed and implemented in an FPGA.
△ Less
Submitted 19 February, 2023; v1 submitted 9 December, 2022;
originally announced December 2022.
-
Knowledge Distillation Applied to Optical Channel Equalization: Solving the Parallelization Problem of Recurrent Connection
Authors:
Sasipim Srivallapanondh,
Pedro J. Freire,
Bernhard Spinnler,
Nelson Costa,
Antonio Napoli,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB.
To circumvent the non-parallelizability of recurrent neural network-based equalizers, we propose knowledge distillation to recast the RNN into a parallelizable feedforward structure. The latter shows 38\% latency decrease, while impacting the Q-factor by only 0.5dB.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation
Authors:
Pedro J. Freire,
Antonio Napoli,
Diego Arguello Ron,
Bernhard Spinnler,
Michael Anderson,
Wolfgang Schairer,
Thomas Bex,
Nelson Costa,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky
Abstract:
In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we provide a comprehensive description and comparison of various deep model compression approaches that have been applied to feed-forward and recurrent NN designs. Add…
▽ More
In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we provide a comprehensive description and comparison of various deep model compression approaches that have been applied to feed-forward and recurrent NN designs. Additionally, we evaluate the influence these strategies have on the performance of each NN equalizer. Quantization, weight clustering, pruning, and other cutting-edge strategies for model compression are taken into consideration. In this work, we propose and evaluate a Bayesian optimization-assisted compression, in which the hyperparameters of the compression are chosen to simultaneously reduce complexity and improve performance. In conclusion, the trade-off between the complexity of each compression approach and its performance is evaluated by utilizing both simulated and experimental data in order to complete the analysis. By utilizing optimal compression approaches, we show that it is possible to design an NN-based equalizer that is simpler to implement and has better performance than the conventional digital back-propagation (DBP) equalizer with only one step per span. This is accomplished by reducing the number of multipliers used in the NN equalizer after applying the weighted clustering and pruning algorithms. Furthermore, we demonstrate that an equalizer based on NN can also achieve superior performance while still maintaining the same degree of complexity as the full electronic chromatic dispersion compensation block. We conclude our analysis by highlighting open questions and existing challenges, as well as possible future research directions.
△ Less
Submitted 26 November, 2022; v1 submitted 26 August, 2022;
originally announced August 2022.
-
Computational Complexity Evaluation of Neural Network Applications in Signal Processing
Authors:
Pedro Freire,
Sasipim Srivallapanondh,
Antonio Napoli,
Jaroslaw E. Prilepsky,
Sergei K. Turitsyn
Abstract:
In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent la…
▽ More
In this paper, we provide a systematic approach for assessing and comparing the computational complexity of neural network layers in digital signal processing. We provide and link four software-to-hardware complexity measures, defining how the different complexity metrics relate to the layers' hyper-parameters. This paper explains how to compute these four metrics for feed-forward and recurrent layers, and defines in which case we ought to use a particular metric depending on whether we characterize a more soft- or hardware-oriented application. One of the four metrics, called `the number of additions and bit shifts (NABS)', is newly introduced for heterogeneous quantization. NABS characterizes the impact of not only the bitwidth used in the operation but also the type of quantization used in the arithmetical operations. We intend this work to serve as a baseline for the different levels (purposes) of complexity estimation related to the neural networks' application in real-time digital signal processing, aiming at unifying the computational complexity estimation.
△ Less
Submitted 10 March, 2024; v1 submitted 24 June, 2022;
originally announced June 2022.
-
Towards FPGA Implementation of Neural Network-Based Nonlinearity Mitigation Equalizers in Coherent Optical Transmission Systems
Authors:
Pedro J. Freire,
Michael Anderson,
Bernhard Spinnler,
Thomas Bex,
Jaroslaw E. Prilepsky,
Tobias A. Eriksson,
Nelson Costa,
Wolfgang Schairer,
Michaela Blott,
Antonio Napoli,
Sergei K. Turitsyn
Abstract:
For the first time, recurrent and feedforward neural network-based equalizers for nonlinearity compensation are implemented in an FPGA, with a level of complexity comparable to that of a dispersion equalizer. We demonstrate that the NN-based equalizers can outperform a 1 step-per-span DBP.
For the first time, recurrent and feedforward neural network-based equalizers for nonlinearity compensation are implemented in an FPGA, with a level of complexity comparable to that of a dispersion equalizer. We demonstrate that the NN-based equalizers can outperform a 1 step-per-span DBP.
△ Less
Submitted 24 June, 2022;
originally announced June 2022.
-
Model-Based Deep Learning of Joint Probabilistic and Geometric Shaping for Optical Communication
Authors:
Vladislav Neskorniuk,
Andrea Carnio,
Domenico Marsella,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky,
Vahid Aref
Abstract:
Autoencoder-based deep learning is applied to jointly optimize geometric and probabilistic constellation shaping for optical coherent communication. The optimized constellation shaping outperforms the 256 QAM Maxwell-Boltzmann probabilistic distribution with extra 0.05 bits/4D-symbol mutual information for 64 GBd transmission over 170 km SMF link.
Autoencoder-based deep learning is applied to jointly optimize geometric and probabilistic constellation shaping for optical coherent communication. The optimized constellation shaping outperforms the 256 QAM Maxwell-Boltzmann probabilistic distribution with extra 0.05 bits/4D-symbol mutual information for 64 GBd transmission over 170 km SMF link.
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
Domain Adaptation: the Key Enabler of Neural Network Equalizers in Coherent Optical Systems
Authors:
Pedro J. Freire,
Bernhard Spinnler,
Daniel Abode,
Jaroslaw E. Prilepsky,
Abdallah A. I. Ali,
Nelson Costa,
Wolfgang Schairer,
Antonio Napoli,
Andrew D. Ellis,
Sergei K. Turitsyn
Abstract:
We introduce the domain adaptation and randomization approach for calibrating neural network-based equalizers for real transmissions, using synthetic data. The approach renders up to 99\% training process reduction, which we demonstrate in three experimental setups.
We introduce the domain adaptation and randomization approach for calibrating neural network-based equalizers for real transmissions, using synthetic data. The approach renders up to 99\% training process reduction, which we demonstrate in three experimental setups.
△ Less
Submitted 25 February, 2022;
originally announced February 2022.
-
Experimental Evaluation of Computational Complexity for Different Neural Network Equalizers in Optical Communications
Authors:
Pedro J. Freire,
Yevhenii Osadchuk,
Antonio Napoli,
Bernhard Spinnler,
Wolfgang Schairer,
Nelson Costa,
Jaroslaw E. Prilepsky,
Sergei K. Turitsyn
Abstract:
Addressing the neural network-based optical channel equalizers, we quantify the trade-off between their performance and complexity by carrying out the comparative analysis of several neural network architectures, presenting the results for TWC and SSMF set-ups.
Addressing the neural network-based optical channel equalizers, we quantify the trade-off between their performance and complexity by carrying out the comparative analysis of several neural network architectures, presenting the results for TWC and SSMF set-ups.
△ Less
Submitted 17 September, 2021;
originally announced September 2021.
-
End-to-End Deep Learning of Long-Haul Coherent Optical Fiber Communications via Regular Perturbation Model
Authors:
Vladislav Neskorniuk,
Andrea Carnio,
Vinod Bajaj,
Domenico Marsella,
Sergei K. Turitsyn,
Jaroslaw E. Prilepsky,
Vahid Aref
Abstract:
We present a novel end-to-end autoencoder-based learning for coherent optical communications using a "parallelizable" perturbative channel model. We jointly optimized constellation shaping and nonlinear pre-emphasis achieving mutual information gain of 0.18 bits/sym./pol. simulating 64 GBd dual-polarization single-channel transmission over 30x80 km G.652 SMF link with EDFAs.
We present a novel end-to-end autoencoder-based learning for coherent optical communications using a "parallelizable" perturbative channel model. We jointly optimized constellation shaping and nonlinear pre-emphasis achieving mutual information gain of 0.18 bits/sym./pol. simulating 64 GBd dual-polarization single-channel transmission over 30x80 km G.652 SMF link with EDFAs.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
Capacity Lower Bounds of the Noncentral Chi-Channel with Applications to Soliton Amplitude Modulation
Authors:
Nikita A. Shevchenko,
Stanislav A. Derevyanko,
Jaroslaw E. Prilepsky,
Alex Alvarado,
Polina Bayvel,
Sergei K. Turitsyn
Abstract:
The channel law for amplitude-modulated solitons transmitted through a nonlinear optical fibre with ideal distributed amplification and a receiver based on the nonlinear Fourier transform is a noncentral chi-distribution with $2n$ degrees of freedom, where $n=2$ and $n=3$ correspond to the single- and dual-polarisation cases, respectively. In this paper, we study capacity lower bounds of this chan…
▽ More
The channel law for amplitude-modulated solitons transmitted through a nonlinear optical fibre with ideal distributed amplification and a receiver based on the nonlinear Fourier transform is a noncentral chi-distribution with $2n$ degrees of freedom, where $n=2$ and $n=3$ correspond to the single- and dual-polarisation cases, respectively. In this paper, we study capacity lower bounds of this channel under an average power constraint in bits per channel use. We develop an asymptotic semi-analytic approximation for a capacity lower bound for arbitrary $n$ and a Rayleigh input distribution. It is shown that this lower bound grows logarithmically with signal-to-noise ratio (SNR), independently of the value of $n$. Numerical results for other continuous input distributions are also provided. A half-Gaussian input distribution is shown to give larger rates than a Rayleigh input distribution for $n=1,2,3$. At an SNR of $25$ dB, the best lower bounds we developed are approximately $3.68$ bit per channel use. The practically relevant case of amplitude shift-keying (ASK) constellations is also numerically analysed. For the same SNR of $25$ dB, a $16$-ASK constellation yields a rate of approximately $3.45$ bit per channel use.
△ Less
Submitted 16 February, 2018; v1 submitted 8 September, 2016;
originally announced September 2016.
-
A Lower Bound on the per Soliton Capacity of the Nonlinear Optical Fibre Channel
Authors:
Nikita A. Shevchenko,
Jaroslaw E. Prilepsky,
Stanislav A. Derevyanko,
Alex Alvarado,
Polina Bayvel,
Sergei K. Turitsyn
Abstract:
A closed-form expression for a lower bound on the per soliton capacity of the nonlinear optical fibre channel in the presence of (optical) amplifier spontaneous emission (ASE) noise is derived. This bound is based on a non-Gaussian conditional probability density function for the soliton amplitude jitter induced by the ASE noise and is proven to grow logarithmically as the signal-to-noise ratio in…
▽ More
A closed-form expression for a lower bound on the per soliton capacity of the nonlinear optical fibre channel in the presence of (optical) amplifier spontaneous emission (ASE) noise is derived. This bound is based on a non-Gaussian conditional probability density function for the soliton amplitude jitter induced by the ASE noise and is proven to grow logarithmically as the signal-to-noise ratio increases.
△ Less
Submitted 21 August, 2015; v1 submitted 19 August, 2015;
originally announced August 2015.
-
Digital Backpropagation in the Nonlinear Fourier Domain
Authors:
Sander Wahls,
Son T. Le,
Jaroslaw E. Prilepsky,
H. Vincent Poor,
Sergei K. Turitsyn
Abstract:
Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schrödinger equation, which describes the evolution of the signal in the link, numerically. This technique is known as digital backpropagation. Typical digital backpropagation algorithms are based on split-step Fourier methods in which the signal has to b…
▽ More
Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schrödinger equation, which describes the evolution of the signal in the link, numerically. This technique is known as digital backpropagation. Typical digital backpropagation algorithms are based on split-step Fourier methods in which the signal has to be discretized in time and space. The need to discretize in both time and space however makes the real-time implementation of digital backpropagation a challenging problem. In this paper, a new fast algorithm for digital backpropagation based on nonlinear Fourier transforms is presented. Aiming at a proof of concept, the main emphasis will be put on fibers with normal dispersion in order to avoid the issue of solitonic components in the signal. However, it is demonstrated that the algorithm also works for anomalous dispersion if the signal power is low enough. Since the spatial evolution of a signal governed by the nonlinear Schrödinger equation can be reverted analytically in the nonlinear Fourier domain through simple phase-shifts, there is no need to discretize the spatial domain. The proposed algorithm requires only $\mathcal{O}(D\log^{2}D)$ floating point operations to backpropagate a signal given by $D$ samples, independently of the fiber's length, and is therefore highly promising for real-time implementations. The merits of this new approach are illustrated through numerical simulations.
△ Less
Submitted 29 September, 2015; v1 submitted 24 April, 2015;
originally announced April 2015.