gluonts.mx.activation module#
- class gluonts.mx.activation.LipSwish(beta_initializer: mxnet.initializer.Initializer = <mxnet.initializer.Constant object>, **kwargs)[source]#
Bases:
mxnet.gluon.block.HybridBlock
Implemented LipSwish activation, i.e. LipSwish(z) := Swish(z)/ 1.1 with a learnable parameter beta.
- hybrid_forward(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol], beta: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol]) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
- Parameters
F – A module that can either refer to the Symbol API or the NDArray API in MXNet.
x – Input tensor
beta – beta parameter of activation
- Returns
output of forward
- Return type
Tensor
- gluonts.mx.activation.deriv_elu(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol], alpha: float = 1.0) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
Derivative function of Elu activation computed at point x.
- Parameters
F – A module that can either refer to the Symbol API or the NDArray API in MXNet.
x – Input tensor
alpha – alpha parameter of Elu
- Returns
Derivative tensor
- Return type
Tensor
- gluonts.mx.activation.deriv_lipswish(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol], beta: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol]) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
Derivative function of LipSwish activation computed at point x. :param F: A module that can either refer to the Symbol API or the NDArray API in
MXNet.
- Parameters
x – Input tensor
beta – beta parameter in LipSwish activation
- Returns
Derivative tensor
- Return type
Tensor
- gluonts.mx.activation.deriv_softrelu(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol]) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
Derivative function of SoftRelu activation computed at point x.
- Parameters
F – A module that can either refer to the Symbol API or the NDArray API in MXNet.
x – Input tensor
- Returns
Derivative tensor
- Return type
Tensor
- gluonts.mx.activation.deriv_swish(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol], beta: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol]) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
Derivative function of Swish activation computed at point x.
- Parameters
F – A module that can either refer to the Symbol API or the NDArray API in MXNet.
x – Input tensor
beta – beta parameter of LipSwish
- Returns
Derivative tensor
- Return type
Tensor
- gluonts.mx.activation.deriv_tanh(F, x: Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol]) Union[mxnet.ndarray.ndarray.NDArray, mxnet.symbol.symbol.Symbol] [source]#
Derivative function of Tanh activation computed at point x.
- Parameters
F – A module that can either refer to the Symbol API or the NDArray API in MXNet.
x – Input tensor
- Returns
Derivative tensor
- Return type
Tensor